Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi089.front.sepia.ceph.com smithi True True 2024-05-14 15:55:13.471031 scheduled_cbodley@teuthology ubuntu 22.04 x86_64 /home/teuthworker/archive/cbodley-2024-05-14_15:39:36-rgw-wip-cbodley-testing-distro-default-smithi/7705936
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7705936 2024-05-14 15:39:48 2024-05-14 15:55:13 2024-05-14 16:06:49 0:13:17 smithi main ubuntu 22.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_bucket_quota ubuntu_latest} 2
pass 7705903 2024-05-14 13:37:13 2024-05-14 13:44:33 2024-05-14 14:11:01 0:26:28 0:12:33 0:13:55 smithi main centos 9.stream fs:functional:/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/sessionmap} 2
fail 7705881 2024-05-14 07:07:29 2024-05-14 14:50:54 2024-05-14 15:50:09 0:59:15 0:41:52 0:17:23 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-05-14T15:40:00.000157+0000 mon.smithi089 (mon.0) 627 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline" in cluster log

pass 7705864 2024-05-14 07:07:16 2024-05-14 14:11:06 2024-05-14 14:56:47 0:45:41 0:34:59 0:10:42 smithi main ubuntu 22.04 fs/snaps/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} 2
dead 7705439 2024-05-14 00:34:02 2024-05-14 01:39:04 2024-05-14 13:49:53 12:10:49 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

hit max job timeout

fail 7705384 2024-05-14 00:31:49 2024-05-14 00:52:33 2024-05-14 01:35:36 0:43:03 0:33:12 0:09:51 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"2024-05-14T01:22:25.837288+0000 mon.smithi089 (mon.0) 269 : cluster [WRN] Health check failed: Reduced data availability: 32 pgs peering (PG_AVAILABILITY)" in cluster log

fail 7705146 2024-05-13 21:32:58 2024-05-13 23:53:15 2024-05-14 00:40:47 0:47:32 0:36:37 0:10:55 smithi main centos 9.stream powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health} 4
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi089 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c3e55145f4f4b3a500bb66ee08c938a215bc231d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh'

pass 7705105 2024-05-13 21:32:18 2024-05-13 23:08:51 2024-05-13 23:53:22 0:44:31 0:34:21 0:10:10 smithi main ubuntu 22.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health} 4
pass 7705051 2024-05-13 21:10:56 2024-05-13 22:43:10 2024-05-13 23:09:15 0:26:05 0:15:09 0:10:56 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7704987 2024-05-13 21:09:54 2024-05-13 22:13:33 2024-05-13 22:43:55 0:30:22 0:18:08 0:12:14 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7704935 2024-05-13 21:09:04 2024-05-13 21:31:23 2024-05-13 21:57:25 0:26:02 0:14:27 0:11:35 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_adoption} 1
pass 7704705 2024-05-13 18:34:06 2024-05-13 18:40:58 2024-05-13 19:24:03 0:43:05 0:23:21 0:19:44 smithi main ubuntu 22.04 krbd:fsx/{ceph/ceph clusters/3-node conf features/no-deep-flatten ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 7704666 2024-05-13 07:43:52 2024-05-13 08:50:27 2024-05-13 09:35:28 0:45:01 0:34:43 0:10:18 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-05-13T09:25:42.621475+0000 mon.a (mon.0) 3551 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7704585 2024-05-13 07:42:02 2024-05-13 07:50:48 2024-05-13 08:50:39 0:59:51 0:48:30 0:11:21 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-05-13T08:29:02.347207+0000 mon.a (mon.0) 1058 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7704497 2024-05-13 00:24:51 2024-05-13 02:46:14 2024-05-13 04:28:48 1:42:34 1:21:53 0:20:41 smithi main centos 8.stream upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} 2
pass 7704472 2024-05-12 22:09:06 2024-05-12 22:15:37 2024-05-12 22:46:37 0:31:00 0:21:42 0:09:18 smithi main centos 9.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} conf/{disable-pool-app} objectstore/bluestore-comp-lz4 validator/memcheck workloads/fsx} 1
pass 7704456 2024-05-12 22:06:31 2024-05-13 15:21:09 2024-05-13 16:22:48 1:01:39 0:53:57 0:07:42 smithi main rhel 8.6 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 7704383 2024-05-12 22:05:17 2024-05-13 14:48:37 2024-05-13 15:21:03 0:32:26 0:22:39 0:09:47 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7704302 2024-05-12 22:03:55 2024-05-13 14:12:21 2024-05-13 14:51:19 0:38:58 0:26:04 0:12:54 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_20.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7704237 2024-05-12 22:02:48 2024-05-13 13:40:41 2024-05-13 14:12:30 0:31:49 0:24:03 0:07:46 smithi main rhel 8.6 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1