Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi153.front.sepia.ceph.com smithi True True 2024-05-27 16:39:46.862365 scheduled_teuthology@teuthology centos 9 x86_64 /home/teuthworker/archive/teuthology-2024-05-21_20:16:16-rbd-main-distro-default-smithi/7718843
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7727931 2024-05-27 14:00:39 2024-05-27 14:01:27 2024-05-27 15:38:33 1:37:06 1:27:55 0:09:11 smithi main centos 9.stream rbd:valgrind/{base/install centos_latest clusters/{fixed-1 openstack} conf/{disable-pool-app} objectstore/bluestore-bitmap validator/memcheck workloads/c_api_tests_with_defaults} 1
Failure Reason:

Command failed (workunit test rbd/test_librbd.sh) on smithi153 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a2c259f3024b60a259d8b31eb216d3aa61698d07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 VALGRIND=\'--tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'

pass 7727497 2024-05-26 22:05:57 2024-05-27 12:34:59 2024-05-27 13:11:00 0:36:01 0:22:07 0:13:54 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 7727207 2024-05-26 21:28:00 2024-05-27 00:21:46 2024-05-27 12:40:27 12:18:41 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} 2
Failure Reason:

hit max job timeout

pass 7727112 2024-05-26 21:26:24 2024-05-26 22:58:50 2024-05-27 00:23:15 1:24:25 1:13:42 0:10:43 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} 3
pass 7727040 2024-05-26 21:25:10 2024-05-26 21:51:22 2024-05-26 22:59:32 1:08:10 0:57:37 0:10:33 smithi main centos 9.stream fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} 2
pass 7726724 2024-05-26 21:02:23 2024-05-26 21:19:52 2024-05-26 21:51:56 0:32:04 0:21:39 0:10:25 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
dead 7726705 2024-05-26 21:02:04 2024-05-26 21:08:13 2024-05-26 21:10:38 0:02:25 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi111

fail 7726344 2024-05-26 10:48:29 2024-05-26 12:11:49 2024-05-26 13:08:07 0:56:18 0:44:57 0:11:21 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} 3
Failure Reason:

error during quiesce thrashing: Error quiescing set '420c46f1': 110 (ETIMEDOUT)

fail 7726256 2024-05-26 05:24:43 2024-05-26 07:22:11 2024-05-26 09:31:27 2:09:16 1:56:38 0:12:38 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_bench}} 3
Failure Reason:

reached maximum tries (801) after waiting for 4800 seconds

fail 7726210 2024-05-26 05:18:09 2024-05-26 06:48:09 2024-05-26 07:23:27 0:35:18 0:26:05 0:09:13 smithi main rhel 8.6 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/rhel_8 tasks/{0-install test/rados_python}} 3
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=19f3c03194952f81fb0d3dd9621f2ed4b14b4e1d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

pass 7726160 2024-05-26 05:17:18 2024-05-26 06:09:13 2024-05-26 06:49:33 0:40:20 0:32:26 0:07:54 smithi main rhel 8.6 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/rhel_8 tasks/{0-install test/rados_cls_all}} 3
pass 7726124 2024-05-26 05:16:40 2024-05-26 06:09:39 780 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/centos_latest tasks/{0-install test/cfuse_workunit_suites_fsstress}} 3
dead 7726107 2024-05-26 05:08:52 2024-05-26 05:29:16 2024-05-26 05:31:20 0:02:04 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rados_api_tests}} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi113

dead 7726102 2024-05-26 05:08:46 2024-05-26 05:26:34 2024-05-26 05:27:58 0:01:24 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/kclient_workunit_suites_dbench}} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi153

pass 7726003 2024-05-25 22:49:00 2024-05-26 20:41:28 2024-05-26 21:09:31 0:28:03 0:15:43 0:12:20 smithi main centos 8.stream krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 7725957 2024-05-25 21:49:22 2024-05-26 01:33:33 2024-05-26 02:05:53 0:32:20 0:19:09 0:13:11 smithi main centos 8.stream krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
fail 7725902 2024-05-25 21:20:10 2024-05-26 00:35:12 2024-05-26 01:33:54 0:58:42 0:45:15 0:13:27 smithi main centos 9.stream rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} workloads/c_api_tests_with_defaults} 3
Failure Reason:

"2024-05-26T01:13:26.550713+0000 mon.a (mon.0) 886 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7725866 2024-05-25 21:19:34 2024-05-26 00:09:15 2024-05-26 00:38:02 0:28:47 0:17:31 0:11:16 smithi main centos 9.stream rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_latest} workloads/fsx} 3
pass 7725790 2024-05-25 21:18:17 2024-05-25 22:59:39 2024-05-26 00:09:33 1:09:54 0:59:45 0:10:09 smithi main centos 9.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} 2
pass 7725513 2024-05-24 22:40:51 2024-05-26 20:01:55 2024-05-26 20:41:29 0:39:34 0:29:53 0:09:41 smithi main centos 8.stream rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{centos_8} tasks/{0-install first ststests}} 2