Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi192.front.sepia.ceph.com smithi True True 2024-06-02 19:55:06.324239 scheduled_yuriw@teuthology centos 9 x86_64 /home/teuthworker/archive/yuriw-2024-06-02_17:29:02-rados-wip-yuri7-testing-2024-05-20-1227-distro-default-smithi/7737806
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7737806 2024-06-02 17:34:49 2024-06-02 19:55:06 2024-06-02 21:46:17 1:53:07 smithi main centos 9.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
dead 7737782 2024-06-02 17:34:22 2024-06-02 19:39:35 2024-06-02 19:40:39 0:01:04 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi016

dead 7737746 2024-06-02 17:33:42 2024-06-02 19:24:09 2024-06-02 19:25:13 0:01:04 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi130

dead 7737720 2024-06-02 17:33:13 2024-06-02 19:08:47 2024-06-02 19:09:51 0:01:04 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 4
Failure Reason:

Error reimaging machines: Failed to power on smithi192

pass 7737660 2024-06-02 17:32:05 2024-06-02 18:31:29 2024-06-02 19:08:45 0:37:16 0:24:43 0:12:33 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 4
fail 7737629 2024-06-02 17:31:30 2024-06-02 18:07:44 2024-06-02 18:31:19 0:23:35 0:13:14 0:10:21 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} 3
Failure Reason:

"2024-06-02T18:28:23.957218+0000 mon.a (mon.0) 105 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7737548 2024-06-02 15:35:36 2024-06-02 15:41:40 2024-06-02 16:07:51 0:26:11 0:15:10 0:11:01 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7737490 2024-06-02 05:24:47 2024-06-02 07:33:49 2024-06-02 08:06:21 0:32:32 0:21:38 0:10:54 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_cls_all}} 3
pass 7737455 2024-06-02 05:18:26 2024-06-02 07:08:51 2024-06-02 07:35:12 0:26:21 0:15:00 0:11:21 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/centos_8 tasks/{0-install test/kclient_workunit_direct_io}} 3
pass 7737424 2024-06-02 05:17:54 2024-06-02 06:37:59 2024-06-02 07:09:54 0:31:55 0:18:12 0:13:43 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_latest tasks/{0-install test/rbd_workunit_suites_iozone}} 3
pass 7737377 2024-06-02 05:17:04 2024-06-02 06:00:38 2024-06-02 06:41:50 0:41:12 0:34:30 0:06:42 smithi main rhel 8.6 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/rhel_8 tasks/{0-install test/rgw_ec_s3tests}} 3
dead 7737349 2024-06-02 05:09:05 2024-06-02 05:42:08 2024-06-02 05:45:33 0:03:25 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rbd_python_api_tests}} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi076

pass 7737322 2024-06-02 05:02:02 2024-06-02 05:22:09 2024-06-02 05:44:27 0:22:18 0:11:58 0:10:20 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rbd_fsx}} 3
pass 7737286 2024-06-01 22:49:46 2024-06-02 12:00:11 2024-06-02 12:36:03 0:35:52 0:26:11 0:09:41 smithi main centos 9.stream krbd/fsx/{ceph/ceph clusters/3-node conf features/no-deep-flatten ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 7737255 2024-06-01 22:49:16 2024-06-02 11:37:16 2024-06-02 12:00:51 0:23:35 0:12:07 0:11:28 smithi main centos 9.stream krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Command failed (workunit test suites/fsx.sh) on smithi192 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71c5cfc99f93c162032256d34d9b60b8288fad91 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh'

fail 7737219 2024-06-01 22:48:40 2024-06-02 11:01:58 2024-06-02 11:37:41 0:35:43 0:23:27 0:12:16 smithi main centos 9.stream krbd/fsx/{ceph/ceph clusters/3-node conf features/no-deep-flatten ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

SELinux denials found on ubuntu@smithi064.front.sepia.ceph.com: ['type=AVC msg=audit(1717326845.510:196): avc: denied { checkpoint_restore } for pid=1089 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1']

pass 7737212 2024-06-01 21:49:29 2024-06-02 02:02:34 2024-06-02 02:34:17 0:31:43 0:19:49 0:11:54 smithi main centos 9.stream krbd/fsx/{ceph/ceph clusters/3-node conf features/no-deep-flatten ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 7737081 2024-06-01 21:19:30 2024-06-01 23:45:50 2024-06-02 02:02:40 2:16:50 2:06:24 0:10:26 smithi main ubuntu 22.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{ubuntu_latest} 5-data-pool/replicated 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup conf/{disable-pool-app}} 3
pass 7737057 2024-06-01 21:19:07 2024-06-01 23:24:05 2024-06-01 23:45:33 0:21:28 0:12:05 0:09:23 smithi main ubuntu 22.04 rbd/singleton/{all/permissions conf/{disable-pool-app} objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7736977 2024-06-01 21:17:46 2024-06-01 22:05:46 2024-06-01 23:23:37 1:17:51 1:07:26 0:10:25 smithi main centos 9.stream rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} workloads/qemu_xfstests_luks2_luks1} 3