Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi094.front.sepia.ceph.com smithi True True 2024-06-02 20:33:46.073901 scheduled_yuriw@teuthology x86_64 /home/teuthworker/archive/yuriw-2024-06-02_17:29:02-rados-wip-yuri7-testing-2024-05-20-1227-distro-default-smithi/7737869
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
waiting 7737869 2024-06-02 17:36:00 2024-06-02 20:33:35 2024-06-02 20:33:47 0:00:44 0:00:44 smithi main centos 9.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} 2
fail 7737850 2024-06-02 17:35:40 2024-06-02 20:25:07 2024-06-02 20:33:24 0:08:17 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} 8
Failure Reason:

too many values to unpack (expected 1)

pass 7737811 2024-06-02 17:34:56 2024-06-02 19:57:18 2024-06-02 20:25:42 0:28:24 0:16:34 0:11:50 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect} 4
pass 7737741 2024-06-02 17:33:37 2024-06-02 19:21:26 2024-06-02 19:57:15 0:35:49 0:25:47 0:10:02 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 4
pass 7737688 2024-06-02 17:32:37 2024-06-02 18:46:22 2024-06-02 19:21:25 0:35:03 0:23:38 0:11:25 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 4
pass 7737587 2024-06-02 17:30:44 2024-06-02 17:33:28 2024-06-02 18:46:14 1:12:46 0:57:32 0:15:14 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 4
pass 7737543 2024-06-02 15:35:29 2024-06-02 15:39:38 2024-06-02 16:16:40 0:37:02 0:28:15 0:08:47 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/snaps-few-objects-balanced} 2
dead 7737151 2024-06-01 21:48:27 2024-06-02 00:53:55 2024-06-02 13:05:26 12:11:31 smithi main centos 9.stream krbd/singleton-msgr-failures/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

hit max job timeout

pass 7737115 2024-06-01 21:20:03 2024-06-02 00:16:52 2024-06-02 00:55:21 0:38:29 0:28:21 0:10:08 smithi main centos 9.stream rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/replicated extra-conf/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} workloads/c_api_tests_with_journaling} 3
pass 7737083 2024-06-01 21:19:32 2024-06-01 23:49:11 2024-06-02 00:18:20 0:29:09 0:20:16 0:08:53 smithi main centos 9.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} workloads/python_api_tests_with_defaults} 3
pass 7737043 2024-06-01 21:18:53 2024-06-01 23:12:17 2024-06-01 23:50:39 0:38:22 0:24:41 0:13:41 smithi main ubuntu 22.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/replicated extra-conf/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 7736927 2024-06-01 21:16:58 2024-06-01 21:28:08 2024-06-01 23:12:58 1:44:50 1:33:35 0:11:15 smithi main ubuntu 22.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} 2
pass 7736836 2024-06-01 14:26:30 2024-06-01 15:50:37 2024-06-01 16:48:21 0:57:44 0:45:06 0:12:38 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 4
fail 7736799 2024-06-01 14:25:48 2024-06-01 15:27:58 2024-06-01 15:51:24 0:23:26 0:10:39 0:12:47 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d419da7308886948280548a2c13bfe50ac9995ae shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c140492-202e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4'

fail 7736765 2024-06-01 14:25:10 2024-06-01 15:04:23 2024-06-01 15:28:01 0:23:38 0:12:30 0:11:08 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-06-01T15:25:14.601059+0000 mon.a (mon.0) 109 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log

pass 7736457 2024-05-31 21:11:31 2024-06-01 02:46:54 2024-06-01 03:54:43 1:07:49 0:57:49 0:10:00 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
fail 7736374 2024-05-31 21:10:09 2024-06-01 01:44:36 2024-06-01 02:47:36 1:03:00 0:52:47 0:10:13 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-06-01T02:10:15.655443+0000 mon.a (mon.0) 932 : cluster [WRN] Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7736344 2024-05-31 21:09:40 2024-06-01 01:21:42 2024-06-01 01:44:36 0:22:54 0:12:55 0:09:59 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
dead 7736324 2024-05-31 21:09:19 2024-06-01 01:07:23 2024-06-01 01:08:27 0:01:04 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi094

pass 7736195 2024-05-31 20:18:59 2024-06-01 00:11:41 2024-06-01 01:07:21 0:55:40 0:44:25 0:11:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 4