Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi156.front.sepia.ceph.com smithi True True 2024-04-16 14:39:59.162890 scheduled_matan@teuthology centos 9 x86_64 /home/teuthworker/archive/matan-2024-04-16_14:35:17-crimson-rados-main-distro-crimson-smithi/7658385
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7658385 2024-04-16 14:35:42 2024-04-16 14:39:59 2024-04-16 18:01:45 3:22:28 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 7658364 2024-04-16 13:33:46 2024-04-16 13:42:58 2024-04-16 14:40:39 0:57:41 0:46:27 0:11:14 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quiesce} 2
pass 7658234 2024-04-16 12:53:30 2024-04-16 13:22:06 2024-04-16 13:43:11 0:21:05 0:11:53 0:09:12 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7658131 2024-04-16 12:37:46 2024-04-16 12:38:41 2024-04-16 13:12:23 0:33:42 0:24:03 0:09:39 smithi main centos 9.stream fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} 2
Failure Reason:

valgrind error: UninitCondition MDLog::trim() MDLog::log_trim_upkeep()

fail 7658092 2024-04-16 11:23:39 2024-04-16 11:24:23 2024-04-16 11:52:46 0:28:23 0:15:27 0:12:56 smithi main ubuntu 22.04 fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} 2
Failure Reason:

Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters)

fail 7657971 2024-04-16 07:22:31 2024-04-16 07:23:11 2024-04-16 07:51:02 0:27:51 0:16:20 0:11:31 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 0 --op setattr 25 --op rmattr 25 --op copy_from 0 --op write_excl 50 --pool unique_pool_0'

pass 7657924 2024-04-16 05:42:24 2024-04-16 05:43:22 2024-04-16 06:41:31 0:58:09 0:49:00 0:09:09 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/quiesce} 2
pass 7657885 2024-04-16 05:01:32 2024-04-16 05:01:43 2024-04-16 05:42:29 0:40:46 0:26:53 0:13:53 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_cache_snaps}} 3
fail 7657865 2024-04-16 00:31:16 2024-04-16 00:33:45 2024-04-16 03:47:48 3:14:03 3:03:26 0:10:37 smithi main centos 9.stream upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} 2
Failure Reason:

"2024-04-16T01:20:00.000142+0000 mon.a (mon.0) 864 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log

pass 7657718 2024-04-15 22:09:23 2024-04-16 00:04:01 2024-04-16 00:34:20 0:30:19 0:19:23 0:10:56 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7657641 2024-04-15 21:32:43 2024-04-15 23:03:09 2024-04-16 00:03:51 1:00:42 0:48:41 0:12:01 smithi main centos 9.stream powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health} 4
fail 7657604 2024-04-15 21:11:33 2024-04-15 22:32:18 2024-04-15 22:50:03 0:17:45 0:04:55 0:12:50 smithi main centos 9.stream orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

fail 7657581 2024-04-15 21:11:09 2024-04-15 22:16:44 2024-04-15 22:33:09 0:16:25 0:04:31 0:11:54 smithi main centos 9.stream orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

fail 7657512 2024-04-15 21:09:59 2024-04-15 21:45:53 2024-04-15 22:05:08 0:19:15 0:07:27 0:11:48 smithi main ubuntu 22.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

fail 7657464 2024-04-15 21:09:10 2024-04-15 21:22:52 2024-04-15 21:38:38 0:15:46 0:04:44 0:11:02 smithi main centos 9.stream orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi111 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull'

pass 7657344 2024-04-15 20:11:32 2024-04-15 20:59:17 2024-04-15 21:23:07 0:23:50 0:13:35 0:10:15 smithi main centos 9.stream orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_rgw_multisite} 3
fail 7657263 2024-04-15 20:10:17 2024-04-15 20:11:17 2024-04-15 20:47:33 0:36:16 0:26:06 0:10:10 smithi main centos 9.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-04-15T20:29:24.220858+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7657229 2024-04-15 17:33:26 2024-04-15 18:05:28 2024-04-15 18:29:26 0:23:58 0:14:19 0:09:39 smithi main ubuntu 22.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated s3tests-branch tasks/rgw_multipart_upload ubuntu_latest} 2
fail 7657068 2024-04-15 07:30:24 2024-04-15 07:33:26 2024-04-15 08:19:08 0:45:42 0:35:17 0:10:25 smithi main centos 9.stream rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} 4
Failure Reason:

"2024-04-15T07:54:14.260351+0000 mon.a (mon.0) 221 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log

fail 7657018 2024-04-15 04:43:42 2024-04-15 04:45:04 2024-04-15 07:31:05 2:46:01 2:35:54 0:10:07 smithi main centos 9.stream upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} 2
Failure Reason:

"2024-04-15T05:03:46.490354+0000 mon.a (mon.0) 171 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log