Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi144.front.sepia.ceph.com smithi True False centos 9 x86_64 None
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 7668831 2024-04-22 21:10:16 2024-04-22 21:50:23 2024-04-23 09:59:02 12:08:39 smithi main centos 9.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

hit max job timeout

fail 7668791 2024-04-22 21:09:35 2024-04-22 21:34:46 2024-04-22 21:50:08 0:15:22 0:06:08 0:09:14 smithi main centos 9.stream orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
Failure Reason:

Command failed on smithi144 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:430e09df97c8fc7dc2b2ae424f68ed11366c540f pull'

fail 7668741 2024-04-22 21:08:44 2024-04-22 21:10:13 2024-04-22 21:32:25 0:22:12 0:09:40 0:12:32 smithi main ubuntu 22.04 orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:430e09df97c8fc7dc2b2ae424f68ed11366c540f pull'

pass 7668624 2024-04-22 20:11:35 2024-04-22 20:50:42 2024-04-22 21:12:02 0:21:20 0:14:01 0:07:19 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7668542 2024-04-22 19:32:20 2024-04-22 19:32:55 2024-04-22 20:50:54 1:17:59 0:51:21 0:26:38 smithi main ubuntu 22.04 rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} 2
fail 7668463 2024-04-22 18:22:05 2024-04-22 18:22:13 2024-04-22 19:42:53 1:20:40 1:11:55 0:08:45 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

['Data could not be sent to remote host "smithi139.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi139.front.sepia.ceph.com port 22: Connection refused', 'Data could not be sent to remote host "smithi139.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi139.front.sepia.ceph.com port 22: No route to host', 'Failed to lookup user adamlyon: "getpwnam(): name not found: \'adamlyon\'"', 'Failed to lookup user agombar: "getpwnam(): name not found: \'agombar\'"', 'Failed to lookup user alimasa: "getpwnam(): name not found: \'alimasa\'"', 'Failed to lookup user amk: "getpwnam(): name not found: \'amk\'"', 'Failed to lookup user avilez: "getpwnam(): name not found: \'avilez\'"', 'Failed to lookup user avivcaro-ev-vm: "getpwnam(): name not found: \'avivcaro-ev-vm\'"', 'Failed to lookup user baum: "getpwnam(): name not found: \'baum\'"', 'Failed to lookup user bcs-ceph: "getpwnam(): name not found: \'bcs-ceph\'"', 'Failed to lookup user bdavidov: "getpwnam(): name not found: \'bdavidov\'"', 'Failed to lookup user billscales: "getpwnam(): name not found: \'billscales\'"', 'Failed to lookup user chunmei: "getpwnam(): name not found: \'chunmei\'"', 'Failed to lookup user connorfa: "getpwnam(): name not found: \'connorfa\'"', 'Failed to lookup user devansh: "getpwnam(): name not found: \'devansh\'"', 'Failed to lookup user devanshsingh: "getpwnam(): name not found: \'devanshsingh\'"', 'Failed to lookup user gbregman: "getpwnam(): name not found: \'gbregman\'"', 'Failed to lookup user jamiepryde: "getpwnam(): name not found: \'jamiepryde\'"', 'Failed to lookup user jjperez: "getpwnam(): name not found: \'jjperez\'"', 'Failed to lookup user kalpesh-mac: "getpwnam(): name not found: \'kalpesh-mac\'"', 'Failed to lookup user lechernin: "getpwnam(): name not found: \'lechernin\'"', 'Failed to lookup user leonidus: "getpwnam(): name not found: \'leonidus\'"', 'Failed to lookup user levh: "getpwnam(): name not found: \'levh\'"', 'Failed to lookup user liangmingyuan: "getpwnam(): name not found: \'liangmingyuan\'"', 'Failed to lookup user linuxkidd: "getpwnam(): name not found: \'linuxkidd\'"', 'Failed to lookup user ljsanders: "getpwnam(): name not found: \'ljsanders\'"', 'Failed to lookup user luorixin: "getpwnam(): name not found: \'luorixin\'"', 'Failed to lookup user medhavi: "getpwnam(): name not found: \'medhavi\'"', 'Failed to lookup user mer: "getpwnam(): name not found: \'mer\'"', 'Failed to lookup user nicowang: "getpwnam(): name not found: \'nicowang\'"', 'Failed to lookup user pegonzal: "getpwnam(): name not found: \'pegonzal\'"', 'Failed to lookup user pkalever: "getpwnam(): name not found: \'pkalever\'"', 'Failed to lookup user poonc3: "getpwnam(): name not found: \'poonc3\'"', 'Failed to lookup user rakshithakamath: "getpwnam(): name not found: \'rakshithakamath\'"', 'Failed to lookup user roysahar: "getpwnam(): name not found: \'roysahar\'"', 'Failed to lookup user ssancheti: "getpwnam(): name not found: \'ssancheti\'"', 'Failed to lookup user ssharon: "getpwnam(): name not found: \'ssharon\'"', 'Failed to lookup user submishr: "getpwnam(): name not found: \'submishr\'"', 'Failed to lookup user suriarte: "getpwnam(): name not found: \'suriarte\'"', 'Failed to lookup user svelar: "getpwnam(): name not found: \'svelar\'"', 'Failed to lookup user tonay: "getpwnam(): name not found: \'tonay\'"', 'Failed to lookup user travisn: "getpwnam(): name not found: \'travisn\'"', 'Failed to lookup user vedansh: "getpwnam(): name not found: \'vedansh\'"', 'Failed to lookup user wmcroberts: "getpwnam(): name not found: \'wmcroberts\'"', 'Failed to lookup user yajgaonk: "getpwnam(): name not found: \'yajgaonk\'"', 'ubuntu@smithi139.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).']

pass 7668401 2024-04-22 14:52:18 2024-04-22 15:29:04 2024-04-22 16:06:07 0:37:03 0:30:18 0:06:45 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7668346 2024-04-22 14:51:22 2024-04-22 14:52:19 2024-04-22 15:28:57 0:36:38 0:26:05 0:10:33 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
fail 7668277 2024-04-22 12:37:38 2024-04-22 13:06:51 2024-04-22 13:44:08 0:37:17 0:30:57 0:06:20 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

fail 7668139 2024-04-22 05:53:48 2024-04-22 06:20:41 2024-04-22 06:59:39 0:38:58 0:32:04 0:06:54 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} 3
Failure Reason:

error during quiesce thrashing: Error quiescing root: -110 (ETIMEDOUT)

fail 7668124 2024-04-22 05:44:01 2024-04-22 05:47:17 2024-04-22 06:15:51 0:28:34 0:19:30 0:09:04 smithi main centos 9.stream rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} 4
Failure Reason:

Command failed (workunit test rbd/nvmeof_basic_tests.sh) on smithi144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c914a30d19452364bf716b4b782495fbed06fa9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_basic_tests.sh'

pass 7668022 2024-04-21 22:06:15 2024-04-22 09:33:58 2024-04-22 10:02:23 0:28:25 0:19:03 0:09:22 smithi main ubuntu 20.04 rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_20.04}} 1
pass 7667981 2024-04-21 22:05:34 2024-04-22 09:08:39 2024-04-22 09:34:28 0:25:49 0:18:02 0:07:47 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 7667946 2024-04-21 22:04:58 2024-04-22 08:45:49 2024-04-22 09:08:44 0:22:55 0:12:58 0:09:57 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7667907 2024-04-21 22:04:18 2024-04-22 08:24:03 2024-04-22 08:47:04 0:23:01 0:16:59 0:06:02 smithi main rhel 8.6 rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7667869 2024-04-21 22:03:39 2024-04-22 08:00:22 2024-04-22 08:24:01 0:23:39 0:14:58 0:08:41 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7667842 2024-04-21 22:03:13 2024-04-22 07:45:27 2024-04-22 08:00:32 0:15:05 0:09:07 0:05:58 smithi main centos 9.stream rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} 1
pass 7667801 2024-04-21 22:02:31 2024-04-22 07:45:19 1674 smithi main centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 7667761 2024-04-21 22:01:51 2024-04-22 05:05:50 2024-04-22 05:48:42 0:42:52 0:34:39 0:08:13 smithi main rhel 8.6 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7667746 2024-04-21 22:01:36 2024-04-22 04:32:40 2024-04-22 05:05:40 0:33:00 0:23:56 0:09:04 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} 3