Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi151.front.sepia.ceph.com smithi True True 2023-10-04 00:09:26.033638 scheduled_rraja@teuthology ubuntu 20.04 x86_64 /home/teuthworker/archive/rraja-2023-10-04_00:09:14-rbd:cli-wip-ajarr-63009-only-reacquire-kickstart-distro-default-smithi/7410061
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7410061 2023-10-04 00:09:25 2023-10-04 00:09:25 2023-10-04 02:37:03 2:29:36 smithi main ubuntu 20.04 rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_20.04} workloads/rbd_support_module_recovery} 1
fail 7410029 2023-10-03 20:26:20 2023-10-03 22:37:10 2023-10-03 23:04:24 0:27:14 0:19:42 0:07:32 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

"/var/log/ceph/887259e2-623f-11ee-8db5-212e2dc638e7/ceph-mon.c.log:2023-10-03T22:57:33.213+0000 7fe2aaac6700 7 mon.c@2(peon).log v166 update_from_paxos applying incremental log 166 2023-10-03T22:57:32.201321+0000 mon.a (mon.0) 605 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN)" in cluster log

pass 7409992 2023-10-03 20:25:51 2023-10-03 22:07:12 2023-10-03 22:37:20 0:30:08 0:21:44 0:08:24 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7409815 2023-10-03 19:52:48 2023-10-03 22:07:29 7399 smithi main ubuntu 22.04 rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} 1
pass 7409691 2023-10-03 17:10:42 2023-10-03 17:11:34 2023-10-03 19:27:21 2:15:47 2:02:57 0:12:50 smithi main ubuntu 22.04 rbd:cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} 1
fail 7409680 2023-10-03 16:09:23 2023-10-03 16:10:11 2023-10-03 16:50:23 0:40:12 0:26:41 0:13:31 smithi main ubuntu 20.04 rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

local variable 'crush_name' referenced before assignment

pass 7409665 2023-10-03 11:21:44 2023-10-03 12:15:52 2023-10-03 12:57:26 0:41:34 0:33:56 0:07:38 smithi main rhel 8.6 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 7409578 2023-10-03 11:21:40 2023-10-03 11:22:46 2023-10-03 12:15:51 0:53:05 0:43:38 0:09:27 smithi main rhel 8.6 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 7409535 2023-10-03 09:01:31 2023-10-03 09:02:21 2023-10-03 10:57:00 1:54:39 1:40:29 0:14:10 smithi main ubuntu 22.04 rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} 2
pass 7409518 2023-10-03 07:52:39 2023-10-03 07:53:26 2023-10-03 08:23:29 0:30:03 0:20:29 0:09:34 smithi main centos 8.stream fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} 2
pass 7409508 2023-10-03 03:55:22 2023-10-03 04:32:11 1509 smithi main ubuntu 22.04 rgw:tempest/{0-install clusters/fixed-1 frontend/beast ignore-pg-availability overrides s3tests-branch tasks/tempest ubuntu_latest} 1
dead 7409352 2023-10-03 02:48:51 2023-10-03 03:34:54 2023-10-03 03:43:58 0:09:04 smithi main rhel 8.6 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
fail 7409309 2023-10-03 02:48:19 2023-10-03 03:12:13 2023-10-03 03:34:53 0:22:40 0:11:15 0:11:25 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 5
Failure Reason:

Command crashed: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring'

fail 7409254 2023-10-03 02:47:39 2023-10-03 02:48:29 2023-10-03 03:13:07 0:24:38 0:15:19 0:09:19 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/pjd}} 3
Failure Reason:

Command failed on smithi139 with status 5: 'sudo systemctl stop ceph-965c0de6-619a-11ee-8db5-212e2dc638e7@mon.a'

pass 7409085 2023-10-02 20:53:00 2023-10-03 00:18:45 2023-10-03 01:59:39 1:40:54 1:29:43 0:11:11 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 7409047 2023-10-02 20:52:28 2023-10-02 23:58:20 2023-10-03 00:20:13 0:21:53 0:12:17 0:09:36 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7408983 2023-10-02 20:51:35 2023-10-02 23:15:36 2023-10-02 23:58:23 0:42:47 0:32:01 0:10:46 smithi main ubuntu 22.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
pass 7408936 2023-10-02 20:50:57 2023-10-02 22:50:21 2023-10-02 23:16:21 0:26:00 0:16:52 0:09:08 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7408899 2023-10-02 19:23:46 2023-10-02 22:24:28 2023-10-02 22:50:16 0:25:48 0:11:49 0:13:59 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7408840 2023-10-02 19:23:05 2023-10-02 21:52:11 2023-10-02 22:27:56 0:35:45 0:26:27 0:09:18 smithi main rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2