Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi178.front.sepia.ceph.com smithi True True 2024-05-21 14:52:36.988548 scheduled_pdonnell@teuthology x86_64 /home/teuthworker/archive/pdonnell-2024-05-21_13:18:14-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7718563
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7718627 2024-05-21 13:31:44 2024-05-21 13:51:37 2024-05-21 14:21:05 0:29:28 0:17:31 0:11:57 smithi fix-install-task centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/readwrite} 2
Failure Reason:

"2024-05-21T14:13:24.681212+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

dead 7718563 2024-05-21 13:18:50 2024-05-21 14:52:26 2024-05-21 14:53:40 0:01:14 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi069

pass 7718546 2024-05-21 13:18:31 2024-05-21 14:19:09 2024-05-21 14:52:33 0:33:24 0:21:55 0:11:29 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota} 2
pass 7718517 2024-05-21 13:02:26 2024-05-21 13:23:51 2024-05-21 13:53:20 0:29:29 0:19:21 0:10:08 smithi install-fix centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} 2
pass 7716840 2024-05-20 20:51:26 2024-05-21 12:55:37 2024-05-21 13:23:54 0:28:17 0:11:02 0:17:15 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7716797 2024-05-20 20:50:41 2024-05-21 12:32:17 2024-05-21 12:58:21 0:26:04 0:15:31 0:10:33 smithi main ubuntu 22.04 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7716753 2024-05-20 20:49:53 2024-05-21 12:01:36 2024-05-21 12:32:14 0:30:38 0:19:17 0:11:21 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 4
pass 7716734 2024-05-20 20:49:34 2024-05-21 11:37:59 2024-05-21 12:02:13 0:24:14 0:13:18 0:10:56 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/{1-install 2-ceph 3-mgrmodules 4-units/failover}} 2
pass 7716708 2024-05-20 20:49:07 2024-05-21 11:12:15 2024-05-21 11:38:43 0:26:28 0:13:35 0:12:53 smithi main ubuntu 22.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/{1-install 2-ceph 3-mgrmodules 4-units/devicehealth}} 2
pass 7716644 2024-05-20 20:48:31 2024-05-21 10:42:28 2024-05-21 11:14:32 0:32:04 0:22:08 0:09:56 smithi main ubuntu 22.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 7716595 2024-05-20 20:48:06 2024-05-21 10:16:46 2024-05-21 10:42:23 0:25:37 0:15:43 0:09:54 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect} 4
pass 7716547 2024-05-20 20:47:41 2024-05-21 09:46:19 2024-05-21 10:16:51 0:30:32 0:13:44 0:16:48 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7716323 2024-05-20 19:54:31 2024-05-21 09:18:34 2024-05-21 09:52:40 0:34:06 0:21:40 0:12:26 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 4
pass 7716289 2024-05-20 19:53:54 2024-05-21 08:50:30 2024-05-21 09:20:33 0:30:03 0:20:31 0:09:32 smithi main ubuntu 22.04 rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 7716258 2024-05-20 19:53:20 2024-05-21 08:15:23 2024-05-21 08:50:19 0:34:56 0:23:46 0:11:10 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 4
pass 7716247 2024-05-20 19:53:08 2024-05-21 07:52:41 2024-05-21 08:16:01 0:23:20 0:13:41 0:09:39 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7716207 2024-05-20 19:52:23 2024-05-21 07:09:10 2024-05-21 07:53:33 0:44:23 0:31:16 0:13:07 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} 4
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6cd0f8013e2dea00c3a29a0d8b10656b132d7c80 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7716166 2024-05-20 19:51:38 2024-05-21 06:28:02 2024-05-21 07:11:22 0:43:20 0:30:03 0:13:17 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 4
pass 7716142 2024-05-20 19:51:12 2024-05-21 05:50:46 2024-05-21 06:28:11 0:37:25 0:25:12 0:12:13 smithi main ubuntu 22.04 rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7716111 2024-05-20 19:50:38 2024-05-21 05:11:59 2024-05-21 05:52:02 0:40:03 0:26:04 0:13:59 smithi main ubuntu 22.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3