Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi060.front.sepia.ceph.com smithi True True 2023-01-08 12:00:29.133915 jenkins-build@teuthology centos 8 x86_64 Locked to capture FOG image for Jenkins build 711
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7131519 2023-01-04 17:40:18 2023-01-04 20:43:59 10097 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

"2023-01-04T18:51:54.523225+0000 mds.b (mds.0) 1 : cluster [WRN] client.4864 isn't responding to mclientcaps(revoke), ino 0x1000000f577 pending pAsLsXsFsc issued pAsLsXsFscb, sent 304.995700 seconds ago" in cluster log

pass 7131496 2023-01-04 16:37:14 2023-01-04 16:37:14 2023-01-04 17:24:48 0:47:34 0:34:34 0:13:00 smithi main rhel 8.4 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_api_tests}} 3
dead 7131468 2023-01-04 15:28:50 2023-01-04 15:29:19 2023-01-04 15:49:40 0:20:21 0:05:37 0:14:44 smithi main rhel 8.4 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rgw_ec_s3tests}} 3
Failure Reason:

{'smithi165.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

dead 7131424 2023-01-03 16:49:31 2023-01-03 23:52:17 2023-01-04 00:08:57 0:16:40 0:05:18 0:11:22 smithi main rhel 8.4 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_cache_snaps}} 3
Failure Reason:

{'smithi077.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

dead 7131285 2023-01-02 16:43:33 2023-01-02 18:04:17 2023-01-03 09:16:49 15:12:32 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} 3
pass 7131244 2023-01-02 16:42:57 2023-01-02 17:28:20 2023-01-02 18:02:24 0:34:04 0:22:37 0:11:27 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
dead 7131233 2023-01-02 16:42:45 2023-01-02 17:17:16 2023-01-02 17:30:29 0:13:13 0:05:17 0:07:56 smithi main rhel 8.4 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} 2
Failure Reason:

{'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

pass 7131207 2023-01-02 16:42:18 2023-01-02 16:56:16 2023-01-02 17:19:16 0:23:00 0:17:20 0:05:40 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} 2
fail 7131186 2023-01-02 16:41:56 2023-01-02 16:41:56 2023-01-02 16:55:38 0:13:42 0:05:23 0:08:19 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

{'smithi080.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

fail 7131069 2023-01-02 16:16:32 2023-01-02 16:39:42 2023-01-02 16:51:34 0:11:52 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
Failure Reason:

Stale jobs detected, aborting.

fail 7131034 2023-01-02 16:16:20 2023-01-02 16:16:58 2023-01-02 16:40:03 0:23:05 0:07:03 0:16:02 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116

fail 7131009 2023-01-02 13:14:41 2023-01-02 14:25:23 2023-01-02 14:57:08 0:31:45 0:19:36 0:12:09 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi060 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5830d21a-8aac-11ed-90c7-001a4aab830c -e sha1=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'"

fail 7130936 2023-01-02 13:13:35 2023-01-02 13:43:16 2023-01-02 14:25:54 0:42:38 0:32:50 0:09:48 smithi main rhel 8.6 fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} 2
Failure Reason:

Command failed on smithi060 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback'

fail 7130889 2023-01-02 13:12:53 2023-01-02 13:13:38 2023-01-02 13:43:07 0:29:29 0:21:55 0:07:34 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} 2
Failure Reason:

Test failure: test_mds_max_snaps_per_dir_default_limit (tasks.cephfs.test_snapshots.TestSnapshots), test_mds_max_snaps_per_dir_default_limit (tasks.cephfs.test_snapshots.TestSnapshots)

pass 7130831 2023-01-02 12:18:42 2023-01-02 12:19:19 2023-01-02 13:10:48 0:51:29 0:28:37 0:22:52 smithi main ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
fail 7130806 2023-01-02 09:59:22 2023-01-02 10:32:43 2023-01-02 10:52:38 0:19:55 0:08:26 0:11:29 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116

fail 7130772 2023-01-02 09:58:49 2023-01-02 09:58:49 2023-01-02 10:32:51 0:34:02 0:08:39 0:25:23 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116

dead 7130746 2023-01-02 09:54:18 2023-01-02 09:54:18 2023-01-02 10:10:38 0:16:20 0:05:18 0:11:02 smithi main rhel 8.4 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_workunit_suites_iozone}} 3
Failure Reason:

{'smithi142.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi085.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

dead 7130700 2023-01-01 20:07:07 2023-01-01 22:16:38 2023-01-01 22:30:19 0:13:41 0:06:34 0:07:07 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
Failure Reason:

{'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}}

fail 7130657 2023-01-01 20:06:17 2023-01-01 21:52:24 2023-01-01 22:17:48 0:25:24 0:15:56 0:09:28 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} 3
Failure Reason:

Command failed on smithi060 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'