Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7371839 2023-08-17 17:05:20 2023-08-17 17:06:00 2023-08-17 17:41:09 0:35:09 0:25:56 0:09:13 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7371840 2023-08-17 17:05:21 2023-08-17 17:06:00 2023-08-17 17:41:41 0:35:41 0:23:56 0:11:45 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 7371841 2023-08-17 17:05:22 2023-08-17 17:06:01 2023-08-17 17:52:14 0:46:13 0:31:17 0:14:56 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
pass 7371842 2023-08-17 17:05:22 2023-08-17 17:06:01 2023-08-17 20:23:37 3:17:36 3:03:51 0:13:45 smithi main ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} 4
fail 7371843 2023-08-17 17:05:23 2023-08-17 17:06:02 2023-08-17 17:46:24 0:40:22 0:30:22 0:10:00 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23c07d8f91d3210fa9df54a2a13a9637958c6088 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7371844 2023-08-17 17:05:24 2023-08-17 17:06:02 2023-08-17 17:37:32 0:31:30 0:19:36 0:11:54 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
pass 7371845 2023-08-17 17:05:25 2023-08-17 17:06:02 2023-08-17 17:35:01 0:28:59 0:21:21 0:07:38 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7371846 2023-08-17 17:05:25 2023-08-17 17:06:03 2023-08-17 17:38:28 0:32:25 0:21:37 0:10:48 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 7371847 2023-08-17 17:05:26 2023-08-17 17:06:03 2023-08-17 17:42:11 0:36:08 0:21:22 0:14:46 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 7371848 2023-08-17 17:05:27 2023-08-17 17:06:03 2023-08-17 17:45:08 0:39:05 0:27:31 0:11:34 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

fail 7371849 2023-08-17 17:05:28 2023-08-17 17:06:04 2023-08-17 17:40:29 0:34:25 0:23:42 0:10:43 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2023-08-17T17:36:59.293670+0000 mon.a (mon.0) 473 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7371850 2023-08-17 17:05:29 2023-08-17 17:06:04 2023-08-17 17:31:27 0:25:23 0:12:15 0:13:08 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088

pass 7371851 2023-08-17 17:05:29 2023-08-17 17:06:04 2023-08-17 17:37:39 0:31:35 0:20:31 0:11:04 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
fail 7371852 2023-08-17 17:05:30 2023-08-17 17:41:30 1251 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi071 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:23c07d8f91d3210fa9df54a2a13a9637958c6088 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ef7750e-3d23-11ee-9b39-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''

pass 7371853 2023-08-17 17:05:31 2023-08-17 17:06:05 2023-08-17 17:57:57 0:51:52 0:37:15 0:14:37 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7371854 2023-08-17 17:05:32 2023-08-17 17:06:05 2023-08-17 17:34:37 0:28:32 0:17:13 0:11:19 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7371855 2023-08-17 17:05:33 2023-08-17 17:06:06 2023-08-17 17:38:26 0:32:20 0:21:59 0:10:21 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
dead 7371856 2023-08-17 17:05:34 2023-08-17 17:06:06 2023-08-17 17:07:14 0:01:08 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi137

dead 7371857 2023-08-17 17:05:34 2023-08-17 17:06:06 2023-08-17 17:07:13 0:01:07 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi137

fail 7371858 2023-08-17 17:05:35 2023-08-17 17:06:07 2023-08-17 17:44:45 0:38:38 0:26:50 0:11:48 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7371859 2023-08-17 17:05:36 2023-08-17 17:06:07 2023-08-17 17:36:34 0:30:27 0:21:17 0:09:10 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7371860 2023-08-17 17:05:37 2023-08-17 17:06:08 2023-08-17 17:45:26 0:39:18 0:26:34 0:12:44 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7371861 2023-08-17 17:05:38 2023-08-17 17:06:08 2023-08-17 17:52:54 0:46:46 0:32:03 0:14:43 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
fail 7371862 2023-08-17 17:05:38 2023-08-17 17:06:09 2023-08-17 18:22:27 1:16:18 1:06:49 0:09:29 smithi main centos 8.stream rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} 2
Failure Reason:

"2023-08-17T17:36:39.966954+0000 mon.a (mon.0) 878 : cluster [WRN] Health check failed: 2 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY)" in cluster log

pass 7371863 2023-08-17 17:05:39 2023-08-17 17:06:09 2023-08-17 20:22:00 3:15:51 3:01:49 0:14:02 smithi main ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} 4
dead 7371864 2023-08-17 17:05:40 2023-08-17 17:06:09 2023-08-17 18:23:20 1:17:11 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Error reimaging machines: Timeout opening channel.

fail 7371865 2023-08-17 17:05:41 2023-08-17 17:06:10 2023-08-17 17:47:51 0:41:41 0:27:35 0:14:06 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23c07d8f91d3210fa9df54a2a13a9637958c6088 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7371866 2023-08-17 17:05:42 2023-08-17 17:06:10 2023-08-17 17:36:42 0:30:32 0:20:48 0:09:44 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
fail 7371867 2023-08-17 17:05:42 2023-08-17 17:06:10 2023-08-17 17:46:08 0:39:58 0:27:14 0:12:44 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7371868 2023-08-17 17:05:43 2023-08-17 17:06:11 2023-08-17 17:38:12 0:32:01 0:17:37 0:14:24 smithi main rhel 8.4 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 7371869 2023-08-17 17:05:44 2023-08-17 17:06:11 2023-08-17 17:29:49 0:23:38 0:12:28 0:11:10 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088

pass 7371870 2023-08-17 17:05:45 2023-08-17 17:06:11 2023-08-17 17:31:57 0:25:46 0:13:26 0:12:20 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 7371871 2023-08-17 17:05:45 2023-08-17 17:06:12 2023-08-17 17:43:04 0:36:52 0:24:08 0:12:44 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2023-08-17T17:39:31.918886+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7371872 2023-08-17 17:05:46 2023-08-17 17:06:12 2023-08-17 17:25:33 0:19:21 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Failed to reconnect to smithi032

pass 7371873 2023-08-17 17:05:47 2023-08-17 17:06:12 2023-08-17 23:21:32 6:15:20 5:20:01 0:55:19 smithi main rhel 8.4 rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} 1
pass 7371874 2023-08-17 17:05:48 2023-08-17 17:06:13 2023-08-17 17:34:23 0:28:10 0:17:43 0:10:27 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7371875 2023-08-17 17:05:49 2023-08-17 17:06:13 2023-08-17 17:59:15 0:53:02 0:38:30 0:14:32 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} 2
fail 7371876 2023-08-17 17:05:49 2023-08-17 17:06:13 2023-08-17 17:43:09 0:36:56 0:24:00 0:12:56 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
Failure Reason:

"2023-08-17T17:38:11.580861+0000 mon.a (mon.0) 471 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7371877 2023-08-17 17:05:50 2023-08-17 17:06:14 2023-08-17 17:43:38 0:37:24 0:23:58 0:13:26 smithi main centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} 2
pass 7371878 2023-08-17 17:05:51 2023-08-17 17:06:14 2023-08-17 17:54:39 0:48:25 0:34:52 0:13:33 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7371879 2023-08-17 17:05:52 2023-08-17 17:06:14 2023-08-17 17:44:52 0:38:38 0:26:07 0:12:31 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 7371880 2023-08-17 17:05:52 2023-08-17 17:06:15 2023-08-17 17:41:56 0:35:41 0:23:46 0:11:55 smithi main centos 8.stream rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 7371881 2023-08-17 17:05:53 2023-08-17 17:06:15 2023-08-17 18:07:02 1:00:47 0:49:50 0:10:57 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} 3
fail 7371882 2023-08-17 17:05:54 2023-08-17 17:06:15 2023-08-17 17:47:04 0:40:49 0:27:16 0:13:33 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7371883 2023-08-17 17:05:55 2023-08-17 17:06:16 2023-08-17 17:55:49 0:49:33 0:37:29 0:12:04 smithi main rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3