Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi070.front.sepia.ceph.com smithi True True 2024-06-02 18:12:48.049835 scheduled_yuriw@teuthology ubuntu 22.04 x86_64 /home/teuthworker/archive/yuriw-2024-06-02_17:29:02-rados-wip-yuri7-testing-2024-05-20-1227-distro-default-smithi/7737637
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7737637 2024-06-02 17:31:39 2024-06-02 18:12:27 2024-06-02 20:22:22 2:11:24 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7737492 2024-06-02 05:24:49 2024-06-02 07:36:10 2024-06-02 08:06:00 0:29:50 0:19:20 0:10:30 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_python}} 3
pass 7737454 2024-06-02 05:18:25 2024-06-02 07:07:30 2024-06-02 07:36:42 0:29:12 0:16:30 0:12:42 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_latest tasks/{0-install test/cfuse_workunit_suites_pjd}} 3
pass 7737402 2024-06-02 05:17:30 2024-06-02 06:23:34 2024-06-02 07:08:48 0:45:14 0:36:24 0:08:50 smithi main rhel 8.6 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/rhel_8 tasks/{0-install test/rgw_s3tests}} 3
pass 7737357 2024-06-02 05:16:44 2024-06-02 05:48:06 2024-06-02 06:25:15 0:37:09 0:28:19 0:08:50 smithi main rhel 8.6 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/rhel_8 tasks/{0-install test/cfuse_workunit_suites_iozone}} 3
pass 7737318 2024-06-02 05:01:57 2024-06-02 05:19:17 2024-06-02 05:49:06 0:29:49 0:20:15 0:09:34 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_python}} 3
fail 7736803 2024-06-01 14:25:52 2024-06-01 15:33:41 2024-06-01 15:57:05 0:23:24 0:12:36 0:10:48 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

"2024-06-01T15:53:46.564937+0000 mon.a (mon.0) 109 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

dead 7736789 2024-06-01 14:25:36 2024-06-01 15:18:13 2024-06-01 15:22:48 0:04:35 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi176

pass 7736753 2024-06-01 14:24:57 2024-06-01 14:47:06 2024-06-01 15:21:40 0:34:34 0:20:45 0:13:49 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 4
dead 7736712 2024-06-01 03:09:49 2024-06-01 15:57:16 2024-06-02 04:07:18 12:10:02 smithi main centos 9.stream upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

hit max job timeout

fail 7736563 2024-05-31 22:40:55 2024-06-02 10:28:28 2024-06-02 12:57:25 2:28:57 2:18:56 0:10:01 smithi main centos 9.stream rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_latest} tasks/test_multi} 2
Failure Reason:

rgw multisite test failures

pass 7736183 2024-05-31 20:18:47 2024-06-01 00:00:58 2024-06-01 03:51:08 3:50:10 3:38:37 0:11:33 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-radosbench} 4
pass 7736128 2024-05-31 20:17:47 2024-05-31 23:32:52 2024-06-01 00:01:42 0:28:50 0:18:23 0:10:27 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} 4
dead 7736102 2024-05-31 20:17:19 2024-05-31 23:21:11 2024-05-31 23:22:15 0:01:04 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi070

fail 7736079 2024-05-31 20:16:55 2024-05-31 22:45:36 2024-05-31 23:21:09 0:35:33 0:25:03 0:10:30 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi070 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d419da7308886948280548a2c13bfe50ac9995ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7736047 2024-05-31 20:16:19 2024-05-31 22:24:01 2024-05-31 22:46:10 0:22:09 0:11:49 0:10:20 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7735977 2024-05-31 20:15:03 2024-05-31 21:44:39 2024-05-31 22:24:02 0:39:23 0:30:44 0:08:39 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-05-31T22:02:44.424433+0000 mon.smithi070 (mon.0) 117 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

dead 7735953 2024-05-31 20:14:37 2024-05-31 21:29:07 2024-05-31 21:30:07 0:01:00 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi120

dead 7735942 2024-05-31 20:14:25 2024-05-31 21:25:03 2024-05-31 21:26:37 0:01:34 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi070

pass 7735851 2024-05-31 17:41:00 2024-05-31 20:46:26 2024-05-31 21:25:29 0:39:03 0:27:16 0:11:47 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 4