Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi172.front.sepia.ceph.com smithi True True 2024-04-22 23:09:28.368322 scheduled_adking@teuthology centos 9 x86_64 /home/teuthworker/archive/adking-2024-04-22_22:45:33-orch:cephadm-wip-adk-testing-2024-04-22-1618-distro-default-smithi/7669217
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7669217 2024-04-22 22:46:30 2024-04-22 23:09:18 2024-04-23 07:44:09 8:36:43 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
dead 7669203 2024-04-22 22:46:16 2024-04-22 23:08:03 2024-04-22 23:09:17 0:01:14 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi113

pass 7668931 2024-04-22 21:32:22 2024-04-22 22:37:17 2024-04-22 23:09:39 0:32:22 0:18:42 0:13:40 smithi main ubuntu 22.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} 4
fail 7668897 2024-04-22 21:11:24 2024-04-22 22:21:51 2024-04-22 22:35:14 0:13:23 0:04:38 0:08:45 smithi main centos 9.stream orch/cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} 2
Failure Reason:

Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:430e09df97c8fc7dc2b2ae424f68ed11366c540f pull'

fail 7668857 2024-04-22 21:10:43 2024-04-22 22:05:54 2024-04-22 22:18:21 0:12:27 0:03:55 0:08:32 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:430e09df97c8fc7dc2b2ae424f68ed11366c540f pull'

fail 7668826 2024-04-22 21:10:11 2024-04-22 21:50:21 2024-04-22 22:03:13 0:12:52 0:04:03 0:08:49 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

Command failed on smithi066 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:430e09df97c8fc7dc2b2ae424f68ed11366c540f pull'

fail 7668751 2024-04-22 21:08:54 2024-04-22 21:19:08 2024-04-22 21:42:09 0:23:01 0:16:03 0:06:58 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a5a1c14-00ef-11ef-bc93-c7b262605968 -e sha1=430e09df97c8fc7dc2b2ae424f68ed11366c540f -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7668623 2024-04-22 20:11:34 2024-04-22 20:48:01 2024-04-22 21:09:50 0:21:49 0:11:39 0:10:10 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-04-22T21:04:50.443867+0000 mon.a (mon.0) 445 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7668559 2024-04-22 20:10:34 2024-04-22 20:12:02 2024-04-22 20:50:32 0:38:30 0:30:50 0:07:40 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7668501 2024-04-22 19:31:49 2024-04-22 19:32:40 2024-04-22 20:10:20 0:37:40 0:24:43 0:12:57 smithi main ubuntu 22.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile s3tests-branch tasks/rgw_s3tests ubuntu_latest} 2
pass 7668447 2024-04-22 18:21:48 2024-04-22 18:22:07 2024-04-22 18:55:48 0:33:41 0:25:29 0:08:12 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
fail 7668335 2024-04-22 14:51:10 2024-04-22 14:52:15 2024-04-22 15:48:58 0:56:43 0:48:45 0:07:58 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-04-22T15:21:53.409400+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) ['daemon iscsi.foo.smithi145.ljpvqb on smithi145 is in unknown state'] (CEPHADM_FAILED_DAEMON)" in cluster log

fail 7668285 2024-04-22 12:37:41 2024-04-22 13:22:19 2024-04-22 14:07:32 0:45:13 0:39:08 0:06:05 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} 3
Failure Reason:

error during quiesce thrashing: Error quiescing root: -110 (ETIMEDOUT)

fail 7668256 2024-04-22 12:26:30 2024-04-22 12:43:52 2024-04-22 13:23:02 0:39:10 0:30:40 0:08:30 smithi main centos 9.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-22T12:56:59.934012+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7668184 2024-04-22 05:58:02 2024-04-22 06:19:54 469 smithi main centos 9.stream crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_read} 1
Failure Reason:

Command failed on smithi172 with status 1: '/home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml'

fail 7668140 2024-04-22 05:53:48 2024-04-22 06:20:41 2024-04-22 06:59:53 0:39:12 0:31:48 0:07:24 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} 3
Failure Reason:

error during quiesce thrashing: Error quiescing root: -9 (EBADF)

pass 7668064 2024-04-22 00:24:49 2024-04-22 03:51:08 2024-04-22 06:04:48 2:13:40 2:03:50 0:09:50 smithi main centos 8.stream upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
pass 7668033 2024-04-21 22:06:27 2024-04-22 09:40:24 2024-04-22 10:18:25 0:38:01 0:28:05 0:09:56 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} 2
pass 7667976 2024-04-21 22:05:28 2024-04-22 09:07:37 2024-04-22 09:40:57 0:33:20 0:27:19 0:06:01 smithi main rhel 8.6 rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 2
pass 7667938 2024-04-21 22:04:50 2024-04-22 08:41:15 2024-04-22 09:07:35 0:26:20 0:16:42 0:09:38 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2