Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi012.front.sepia.ceph.com smithi True True 2024-04-24 23:21:10.239610 scheduled_teuthology@teuthology centos 9 x86_64 /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672203
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7672203 2024-04-24 21:25:52 2024-04-24 23:21:10 2024-04-25 01:27:45 2:06:37 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7671759 2024-04-24 15:14:58 2024-04-24 19:31:47 2024-04-24 23:09:27 3:37:40 3:22:12 0:15:28 smithi main centos 8.stream krbd/singleton-msgr-failures/{bluestore-bitmap conf ms_mode$/{crc-rxbounce} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi194 with status 10: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludexf555xza -r -- '-g auto -g blockdev -x clone'"

pass 7671732 2024-04-24 15:14:29 2024-04-24 19:07:58 2024-04-24 19:34:02 0:26:04 0:14:23 0:11:41 smithi main centos 8.stream krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 7671705 2024-04-24 15:14:01 2024-04-24 18:28:23 2024-04-24 19:08:53 0:40:30 0:24:50 0:15:40 smithi main centos 8.stream krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 7671648 2024-04-24 14:13:02 2024-04-24 17:44:25 2024-04-24 18:28:19 0:43:54 0:35:03 0:08:51 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 7671521 2024-04-24 14:10:43 2024-04-24 14:27:04 2024-04-24 17:45:06 3:18:02 3:05:22 0:12:40 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} conf/{disable-pool-app} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} 3
pass 7671460 2024-04-24 13:00:45 2024-04-24 13:29:33 2024-04-24 14:28:58 0:59:25 0:49:48 0:09:37 smithi main ubuntu 22.04 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} 2
fail 7671254 2024-04-24 09:26:34 2024-04-24 09:51:07 2024-04-24 10:33:50 0:42:43 0:33:54 0:08:49 smithi main centos 9.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-24T10:07:35.177320+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7671047 2024-04-24 01:17:04 2024-04-24 10:39:17 2024-04-24 13:29:27 2:50:10 2:43:38 0:06:32 smithi main rhel 8.6 upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
pass 7670989 2024-04-24 01:10:44 2024-04-24 07:15:55 2024-04-24 09:51:48 2:35:53 2:29:46 0:06:07 smithi main rhel 8.6 upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
fail 7670090 2024-04-23 17:45:28 2024-04-23 17:48:26 2024-04-23 19:07:31 1:19:05 1:11:45 0:07:20 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} 3
Failure Reason:

error during quiesce thrashing: Error quiescing root: 110 (ETIMEDOUT)

dead 7670003 2024-04-23 15:04:58 2024-04-23 19:09:26 2024-04-24 07:18:27 12:09:01 smithi main centos 9.stream rgw/notifications/{beast bluestore-bitmap fixed-2 ignore-pg-availability overrides tasks/others/{0-install supported-distros/{centos_latest} test_others}} 2
Failure Reason:

hit max job timeout

pass 7669849 2024-04-23 14:19:52 2024-04-23 16:49:51 2024-04-23 17:48:19 0:58:28 0:48:12 0:10:16 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 4
pass 7669768 2024-04-23 14:18:26 2024-04-23 16:09:05 2024-04-23 16:47:45 0:38:40 0:26:36 0:12:04 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 7669720 2024-04-23 14:17:35 2024-04-23 15:48:03 2024-04-23 16:11:16 0:23:13 0:12:56 0:10:17 smithi main ubuntu 22.04 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
fail 7669698 2024-04-23 14:17:12 2024-04-23 15:32:22 2024-04-23 15:45:50 0:13:28 0:05:20 0:08:08 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Command failed on smithi012 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669674 2024-04-23 14:16:47 2024-04-23 15:16:51 2024-04-23 15:27:30 0:10:39 0:05:07 0:05:32 smithi main centos 9.stream rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed on smithi012 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669640 2024-04-23 14:16:11 2024-04-23 15:01:56 2024-04-23 15:15:32 0:13:36 0:05:12 0:08:24 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 4
Failure Reason:

Command failed on smithi037 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669615 2024-04-23 14:15:45 2024-04-23 14:30:15 2024-04-23 14:45:58 0:15:43 0:04:54 0:10:49 smithi main centos 9.stream rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=2-crush} 4
Failure Reason:

Command failed on smithi191 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

pass 7669589 2024-04-23 14:05:11 2024-04-23 14:05:43 2024-04-23 14:34:43 0:29:00 0:15:12 0:13:48 smithi main ubuntu 22.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2