Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi074.front.sepia.ceph.com smithi False True 2023-08-21 21:49:16.152130 dmick@vossi03 x86_64 BIOS shows SMART error on drive, image won't boot
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 7364608 2023-08-10 10:18:00 2023-08-10 10:20:47 2023-08-10 11:21:00 1:00:13 smithi main centos 8.stream rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} 2
Failure Reason:

Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds

dead 7338013 2023-07-14 16:52:02 2023-07-14 17:53:13 2023-07-14 19:10:14 1:17:01 smithi main rhel 8.6 fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} 3
Failure Reason:

Error reimaging machines: reached maximum tries (241) after waiting for 3600 seconds

dead 7126467 2022-12-25 05:21:59 2022-12-25 05:21:59 2022-12-25 05:37:12 0:15:13 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

dead 7126395 2022-12-24 14:24:36 2022-12-24 14:25:06 2022-12-24 15:10:54 0:45:48 smithi main ubuntu 18.04 upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} 4
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7126328 2022-12-23 14:23:28 2022-12-23 15:08:39 smithi main ubuntu 18.04 upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} 5
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7126246 2022-12-23 07:39:21 2022-12-23 07:39:38 2022-12-23 08:24:59 0:45:21 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} 2
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7126130 2022-12-23 05:22:13 2022-12-23 06:24:12 2022-12-23 07:09:38 0:45:26 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_unmap} 3
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7126031 2022-12-23 05:19:20 2022-12-23 05:36:56 2022-12-23 06:23:57 0:47:01 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7125948 2022-12-23 03:24:19 2022-12-23 04:51:40 2022-12-23 05:38:20 0:46:40 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7125859 2022-12-23 03:22:40 2022-12-23 04:06:53 2022-12-23 04:52:36 0:45:43 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7125779 2022-12-23 03:21:08 2022-12-23 03:21:36 2022-12-23 04:06:57 0:45:21 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

dead 7125754 2022-12-23 01:50:10 2022-12-23 02:11:08 2022-12-23 02:26:38 0:15:30 smithi master ubuntu 18.04 upgrade-clients:client-upgrade-nautilus-octopus/nautilus-client-x/rbd/{0-cluster/{openstack start} 1-install/nautilus-client-x 2-features/layering 3-workload/rbd_notification_tests supported/ubuntu_18.04} 2
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

dead 7125705 2022-12-22 21:25:33 2022-12-23 00:54:06 2022-12-23 01:26:04 0:31:58 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

dead 7125635 2022-12-22 21:22:47 2022-12-23 00:07:50 2022-12-23 00:55:14 0:47:24 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} 2
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

fail 7125589 2022-12-22 21:20:45 2022-12-23 00:09:56 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} 2
Failure Reason:

Command failed on smithi074 with status 2: 'sudo dpkg -i /tmp/linux-image.deb'

pass 7125520 2022-12-22 21:18:45 2022-12-22 22:55:42 2022-12-22 23:40:05 0:44:23 0:17:27 0:26:56 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} 1
fail 7125422 2022-12-22 21:15:44 2022-12-22 22:05:11 2022-12-22 22:55:45 0:50:34 0:36:50 0:13:44 smithi main centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2022-12-22T22:37:37.345981+0000 mon.a (mon.0) 512 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

fail 7125354 2022-12-22 21:13:26 2022-12-22 21:22:53 2022-12-22 22:07:01 0:44:08 0:26:41 0:17:27 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi007 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh'

dead 7125215 2022-12-22 18:03:49 2022-12-23 01:25:52 2022-12-23 02:11:24 0:45:32 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: reached maximum tries (180) after waiting for 2700 seconds

pass 7125178 2022-12-22 18:03:22 2022-12-22 21:01:22 2022-12-22 21:22:49 0:21:27 0:09:13 0:12:14 smithi main rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2