Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi121.front.sepia.ceph.com smithi True True 2024-07-27 08:01:16.900868 scheduled_teuthology@teuthology centos 9.stream x86_64 /home/teuthworker/archive/teuthology-2024-07-26_21:08:20-orch-squid-distro-default-smithi/7820236
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7821084 2024-07-26 23:51:00 2024-07-27 04:27:36 2024-07-27 05:45:22 1:17:46 1:08:00 0:09:46 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7821034 2024-07-26 23:50:05 2024-07-27 03:39:26 2024-07-27 04:28:23 0:48:57 0:39:15 0:09:42 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} 3
fail 7821007 2024-07-26 23:49:35 2024-07-27 03:13:40 2024-07-27 03:39:26 0:25:46 0:12:33 0:13:13 smithi main centos 9.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

An attempt to upgrade from a higher version to a lower one will always fail. Hint: check tags in the target git branch.

fail 7820981 2024-07-26 23:49:07 2024-07-27 02:51:45 2024-07-27 03:16:25 0:24:40 0:13:41 0:10:59 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/exports} 2
Failure Reason:

Test failure: test_mds_failover (tasks.cephfs.test_exports.TestBalMask)

pass 7820937 2024-07-26 23:48:19 2024-07-27 02:08:08 2024-07-27 02:53:29 0:45:21 0:34:58 0:10:23 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} 3
pass 7820890 2024-07-26 23:47:28 2024-07-27 01:17:17 2024-07-27 02:08:28 0:51:11 0:33:44 0:17:27 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} 3
pass 7820831 2024-07-26 23:46:23 2024-07-27 00:42:22 2024-07-27 01:22:59 0:40:37 0:28:32 0:12:05 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snapshots} 2
fail 7820642 2024-07-26 21:34:45 2024-07-27 00:17:57 2024-07-27 00:43:17 0:25:20 0:15:22 0:09:58 smithi main centos 9.stream rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

"2024-07-27T00:38:55.903365+0000 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7820582 2024-07-26 21:33:35 2024-07-26 23:45:12 2024-07-27 00:18:17 0:33:05 0:21:51 0:11:14 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 4
pass 7820522 2024-07-26 21:32:25 2024-07-26 23:13:44 2024-07-26 23:45:10 0:31:26 0:19:48 0:11:38 smithi main centos 9.stream rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=2-crush} 4
pass 7820467 2024-07-26 21:31:17 2024-07-26 22:41:17 2024-07-26 23:13:45 0:32:28 0:21:57 0:10:31 smithi main ubuntu 22.04 rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap_host thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=2-crush} 4
pass 7820405 2024-07-26 21:30:04 2024-07-26 22:04:38 2024-07-26 22:41:34 0:36:56 0:25:54 0:11:02 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/default d-balancer/upmap-read mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default_host thrashosds-health workloads/cache-pool-snaps-readproxy} 4
running 7820236 2024-07-26 21:10:56 2024-07-27 07:59:26 2024-07-27 08:28:22 0:30:42 smithi main centos 9.stream orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli_mon} 5
pass 7820194 2024-07-26 21:09:50 2024-07-27 07:37:42 2024-07-27 07:59:38 0:21:56 0:12:05 0:09:51 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7819751 2024-07-26 16:25:36 2024-07-27 07:10:00 2024-07-27 07:38:47 0:28:47 0:14:43 0:14:04 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zstd} rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} 4
fail 7819679 2024-07-26 16:08:37 2024-07-26 16:25:36 2024-07-26 17:23:33 0:57:57 0:44:17 0:13:40 smithi main centos 9.stream fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} 2
Failure Reason:

Test failure: test_subvolume_snapshot_clone_fail_with_remove (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

pass 7819650 2024-07-26 16:05:35 2024-07-26 21:24:35 2024-07-26 22:05:33 0:40:58 0:30:52 0:10:06 smithi main centos 9.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{bucket-check cls mp_reupload reshard s3tests-java s3tests versioning} validater/lockdep} 2
pass 7819613 2024-07-26 16:05:05 2024-07-27 05:45:21 2024-07-27 06:27:34 0:42:13 0:31:06 0:11:07 smithi main centos 9.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{bucket-check cls mp_reupload reshard s3tests-java s3tests versioning} validater/lockdep} 2
pass 7819521 2024-07-26 13:28:24 2024-07-26 21:03:05 2024-07-26 21:24:51 0:21:46 0:10:58 0:10:48 smithi main centos 9.stream rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
pass 7819460 2024-07-26 13:27:20 2024-07-26 20:25:36 2024-07-26 21:03:59 0:38:23 0:28:03 0:10:20 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2