Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi134.front.sepia.ceph.com smithi True True 2024-04-24 00:18:31.331416 scheduled_teuthology@teuthology ubuntu 22.04 x86_64 /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670535
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 7670535 2024-04-23 21:19:36 2024-04-24 00:17:21 2024-04-24 01:30:11 1:13:25 smithi main ubuntu 22.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 7670468 2024-04-23 21:18:30 2024-04-23 23:12:36 2024-04-24 00:18:27 1:05:51 0:58:08 0:07:43 smithi main centos 9.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{centos_latest} 5-data-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup conf/{disable-pool-app}} 3
pass 7670201 2024-04-23 20:19:11 2024-04-23 20:58:52 2024-04-23 23:12:52 2:14:00 2:03:23 0:10:37 smithi main ubuntu 22.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} conf/{disable-pool-app} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
fail 7670150 2024-04-23 20:18:20 2024-04-23 20:19:23 2024-04-23 20:52:37 0:33:14 0:23:05 0:10:09 smithi main centos 9.stream rbd/nvmeof/{base/install centos_latest cluster/{fixed-4 openstack} conf/{disable-pool-app} workloads/nvmeof_initiator} 4
Failure Reason:

Command failed (workunit test rbd/nvmeof_setup_subsystem.sh) on smithi134 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/rbd/nvmeof_setup_subsystem.sh'

pass 7670111 2024-04-23 17:45:35 2024-04-23 18:01:17 2024-04-23 18:38:38 0:37:21 0:31:24 0:05:57 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} 3
pass 7669990 2024-04-23 15:04:48 2024-04-23 19:01:00 2024-04-23 19:24:13 0:23:13 0:16:31 0:06:42 smithi main centos 9.stream rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 ignore-pg-availability overrides s3a-hadoop supported-random-distro$/{centos_latest}} 2
pass 7669957 2024-04-23 15:04:22 2024-04-23 18:38:43 2024-04-23 19:00:22 0:21:39 0:13:00 0:08:39 smithi main ubuntu 22.04 rgw/service-token/{clusters/fixed-1 frontend/beast ignore-pg-availability overrides tasks/service-token ubuntu_latest} 1
pass 7669900 2024-04-23 14:20:46 2024-04-23 17:22:00 2024-04-23 18:01:19 0:39:19 0:27:04 0:12:15 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 4
fail 7669872 2024-04-23 14:20:16 2024-04-23 17:05:22 2024-04-23 17:18:33 0:13:11 0:05:24 0:07:47 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 4
Failure Reason:

Command failed on smithi194 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669845 2024-04-23 14:19:48 2024-04-23 16:49:49 2024-04-23 17:00:43 0:10:54 0:04:51 0:06:03 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/progress} 2
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669818 2024-04-23 14:19:19 2024-04-23 16:35:16 2024-04-23 16:47:41 0:12:25 0:04:48 0:07:37 smithi main centos 9.stream rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669767 2024-04-23 14:18:25 2024-04-23 16:08:44 2024-04-23 16:22:29 0:13:45 0:04:57 0:08:48 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Command failed on smithi203 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

pass 7669718 2024-04-23 14:17:33 2024-04-23 15:48:02 2024-04-23 16:06:56 0:18:54 0:12:24 0:06:30 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7669690 2024-04-23 14:17:04 2024-04-23 15:32:09 2024-04-23 15:44:54 0:12:45 0:05:21 0:07:24 smithi main centos 9.stream rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install ceph-mgr-dashboard'

fail 7669583 2024-04-23 14:05:03 2024-04-23 14:05:41 2024-04-23 15:30:30 1:24:49 1:09:56 0:14:53 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

pass 7669525 2024-04-23 09:50:14 2024-04-23 09:51:16 2024-04-23 10:49:08 0:57:52 0:47:57 0:09:55 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} 3
pass 7669487 2024-04-23 05:01:35 2024-04-23 05:01:35 2024-04-23 05:30:33 0:28:58 0:16:35 0:12:23 smithi main ubuntu 22.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_cli_import_export}} 3
fail 7669274 2024-04-23 01:20:38 2024-04-23 01:22:32 2024-04-23 01:36:09 0:13:37 0:04:21 0:09:16 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} 2
Failure Reason:

['Data could not be sent to remote host "smithi059.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi059.front.sepia.ceph.com port 22: No route to host', 'Data could not be sent to remote host "smithi134.front.sepia.ceph.com". Make sure this host can be reached over ssh: ssh: connect to host smithi134.front.sepia.ceph.com port 22: No route to host']

dead 7669273 2024-04-23 01:20:38 2024-04-23 01:22:32 2024-04-23 01:32:09 0:09:37 0:02:14 0:07:23 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} 2
Failure Reason:

['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.', "useradd: user 'kalpesh-mac' already exists"]

fail 7669190 2024-04-22 22:46:02 2024-04-22 22:57:26 2024-04-23 00:14:15 1:16:49 1:06:55 0:09:54 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds