Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi135.front.sepia.ceph.com smithi True True 2024-04-27 09:03:35.284151 scheduled_teuthology@teuthology ubuntu 22.04 x86_64 /home/teuthworker/archive/teuthology-2024-04-26_20:40:14-rgw-main-distro-default-smithi/7675361
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7675725 2024-04-26 22:41:17 2024-04-27 04:48:36 2024-04-27 06:08:01 1:19:25 1:09:40 0:09:45 smithi main centos 8.stream rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} 2
pass 7675656 2024-04-26 21:40:56 2024-04-27 03:01:27 2024-04-27 04:48:43 1:47:16 1:31:39 0:15:37 smithi main ubuntu 22.04 rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} 2
pass 7675562 2024-04-26 21:10:51 2024-04-27 02:08:14 2024-04-27 03:06:48 0:58:34 0:51:21 0:07:13 smithi main centos 9.stream orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7675506 2024-04-26 21:09:55 2024-04-27 01:33:59 2024-04-27 02:09:42 0:35:43 0:26:03 0:09:40 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7675445 2024-04-26 21:08:55 2024-04-27 00:47:30 2024-04-27 01:30:04 0:42:34 0:33:46 0:08:48 smithi main centos 9.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-04-27T01:10:35.997918+0000 mon.smithi104 (mon.0) 859 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

running 7675361 2024-04-26 20:42:17 2024-04-27 09:01:54 2024-04-27 10:57:30 1:56:42 smithi main ubuntu 22.04 rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} 2
fail 7675261 2024-04-26 19:34:35 2024-04-26 22:13:03 2024-04-27 00:10:54 1:57:51 1:45:45 0:12:06 smithi main ubuntu 22.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

Command failed on smithi135 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf'

pass 7675239 2024-04-26 19:34:08 2024-04-26 21:47:10 2024-04-26 22:14:59 0:27:49 0:20:13 0:07:36 smithi main centos 9.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} 2
pass 7675221 2024-04-26 19:33:46 2024-04-26 21:19:49 2024-04-26 21:47:48 0:27:59 0:17:24 0:10:35 smithi main ubuntu 22.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} 2
pass 7675198 2024-04-26 19:33:17 2024-04-26 20:54:16 2024-04-26 21:19:56 0:25:40 0:14:03 0:11:37 smithi main ubuntu 22.04 fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} 2
fail 7675149 2024-04-26 19:32:15 2024-04-26 19:51:56 2024-04-26 20:43:00 0:51:04 0:40:30 0:10:34 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

fail 7675093 2024-04-26 18:22:57 2024-04-27 00:32:02 2024-04-27 00:46:24 0:14:22 0:05:26 0:08:56 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} 4
Failure Reason:

Command failed on smithi139 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7675063 2024-04-26 18:22:26 2024-04-27 00:14:17 2024-04-27 00:27:03 0:12:46 0:05:14 0:07:32 smithi main centos 9.stream rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 2
Failure Reason:

Command failed on smithi135 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7674993 2024-04-26 18:21:10 2024-04-26 19:05:34 2024-04-26 19:40:58 0:35:24 0:24:13 0:11:11 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-04-26T19:39:19.753563+0000 mon.a (mon.0) 732 : cluster [WRN] Health check failed: 1 stray host(s) with 1 daemon(s) not managed by cephadm (CEPHADM_STRAY_HOST)" in cluster log

fail 7674964 2024-04-26 18:20:39 2024-04-26 18:50:00 2024-04-26 19:01:42 0:11:42 0:05:05 0:06:37 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

Command failed on smithi151 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7674940 2024-04-26 18:20:13 2024-04-26 18:36:16 2024-04-26 18:49:34 0:13:18 0:04:57 0:08:21 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed on smithi060 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7674861 2024-04-26 15:08:44 2024-04-26 16:14:15 2024-04-26 16:35:57 0:21:42 0:14:27 0:07:15 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-04-26T16:31:59.940815+0000 mon.smithi039 (mon.0) 862 : cluster [WRN] Health check failed: Failed to place 1 daemon(s) (CEPHADM_DAEMON_PLACE_FAIL)" in cluster log

fail 7674808 2024-04-26 15:07:25 2024-04-26 15:35:29 2024-04-26 15:59:01 0:23:32 0:14:56 0:08:36 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-04-26T15:53:23.785914+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log

pass 7674223 2024-04-25 22:34:59 2024-04-26 12:59:33 2024-04-26 13:41:06 0:41:33 0:29:28 0:12:05 smithi main ubuntu 22.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health} 4
pass 7674212 2024-04-25 22:34:48 2024-04-26 12:05:13 2024-04-26 13:00:19 0:55:06 0:40:55 0:14:11 smithi main ubuntu 20.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_20.04 tasks/cfuse_workunit_misc thrashosds-health} 4