Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi120.front.sepia.ceph.com smithi True True 2024-06-02 21:27:52.483929 scheduled_sjust@teuthology centos 9 x86_64 /home/teuthworker/archive/sjust-2024-06-02_21:20:28-rados-wip-sjust-balanced-read-testing-2024-06-02-distro-default-smithi/7738549
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7738549 2024-06-02 21:21:19 2024-06-02 21:27:52 2024-06-02 21:38:43 0:11:47 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 4
dead 7738267 2024-06-02 21:02:10 2024-06-02 21:19:08 2024-06-02 21:21:42 0:02:34 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi135

fail 7737608 2024-06-02 17:31:06 2024-06-02 17:51:28 2024-06-02 21:20:35 3:29:07 3:17:54 0:11:13 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 4
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi177 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=152c981df46be22d613dcdb815661a8256f3d4d9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7737582 2024-06-02 17:30:39 2024-06-02 17:32:46 2024-06-02 17:51:56 0:19:10 0:10:43 0:08:27 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi120 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:152c981df46be22d613dcdb815661a8256f3d4d9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42076cc6-2108-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4'

pass 7737578 2024-06-02 15:37:18 2024-06-02 16:03:26 2024-06-02 16:42:35 0:39:09 0:27:06 0:12:03 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/snaps-few-objects-localized} 2
fail 7737521 2024-06-02 14:36:33 2024-06-02 14:43:04 2024-06-02 15:06:24 0:23:20 0:13:10 0:10:10 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_python} 2
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi120 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=47b6737aa6511a896ba9589bbbce1fd61cd38862 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh -m \'not (wait or tier or ec or bench or stats)\''

pass 7737483 2024-06-02 05:24:40 2024-06-02 07:29:55 2024-06-02 07:56:12 0:26:17 0:16:05 0:10:12 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_fsstress}} 3
pass 7737443 2024-06-02 05:18:14 2024-06-02 06:55:01 2024-06-02 07:31:10 0:36:09 0:25:33 0:10:36 smithi main ubuntu 20.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/rados_workunit_loadgen_mix}} 3
pass 7737401 2024-06-02 05:17:29 2024-06-02 06:20:53 2024-06-02 06:55:06 0:34:13 0:21:24 0:12:49 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/centos_latest tasks/{0-install test/rgw_ec_s3tests}} 3
pass 7737376 2024-06-02 05:17:03 2024-06-02 06:00:37 2024-06-02 06:23:25 0:22:48 0:13:41 0:09:07 smithi main centos 9.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/centos_latest tasks/{0-install test/rbd_workunit_suites_iozone}} 3
dead 7737368 2024-06-02 05:16:55 2024-06-02 05:54:53 2024-06-02 05:56:17 0:01:24 smithi main ubuntu 20.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/rados_cls_all}} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi183

pass 7737332 2024-06-02 05:08:47 2024-06-02 05:29:30 2024-06-02 05:55:09 0:25:39 0:15:45 0:09:54 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_pjd}} 3
dead 7737317 2024-06-02 05:01:56 2024-06-02 05:17:27 2024-06-02 05:20:21 0:02:54 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_ec_snaps}} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi145

dead 7736688 2024-06-01 03:09:24 2024-06-01 13:57:27 2024-06-02 02:07:49 12:10:22 smithi main ubuntu 22.04 upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

hit max job timeout

fail 7736671 2024-05-31 22:56:34 2024-05-31 23:17:27 2024-05-31 23:34:35 0:17:08 0:07:28 0:09:40 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi120 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:525193e83129ee686c7ba5058a7c1dd21e4aac53 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3793c3e-1fa5-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/nvme4n1'

fail 7736599 2024-05-31 22:41:32 2024-06-02 10:45:14 2024-06-02 14:43:14 3:58:00 3:48:41 0:09:19 smithi main centos 9.stream rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} 2
Failure Reason:

rgw multisite test failures

pass 7736525 2024-05-31 21:41:03 2024-06-01 03:20:40 2024-06-01 03:48:11 0:27:31 0:18:36 0:08:55 smithi main ubuntu 22.04 rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop supported-random-distro$/{ubuntu_latest}} 2
fail 7736458 2024-05-31 21:11:32 2024-06-01 02:47:45 2024-06-01 03:20:41 0:32:56 0:22:03 0:10:53 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-06-01T03:17:09.782363+0000 mon.smithi120 (mon.0) 954 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

fail 7736376 2024-05-31 21:10:10 2024-06-01 01:44:46 2024-06-01 02:49:04 1:04:18 0:52:23 0:11:55 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-06-01T02:11:51.313151+0000 mon.a (mon.0) 986 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7736333 2024-05-31 21:09:28 2024-06-01 01:16:17 2024-06-01 01:46:03 0:29:46 0:19:38 0:10:08 smithi main ubuntu 22.04 orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2