Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7443302 2023-11-01 18:40:36 2023-11-01 20:34:08 2023-11-01 21:22:03 0:47:55 0:20:04 0:27:51 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
dead 7443303 2023-11-01 18:40:37 2023-11-01 20:52:21 2023-11-02 09:05:03 12:12:42 smithi main ubuntu 20.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

hit max job timeout

pass 7443304 2023-11-01 18:40:37 2023-11-01 20:52:31 2023-11-01 21:45:30 0:52:59 0:32:05 0:20:54 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7443305 2023-11-01 18:40:38 2023-11-01 21:03:23 2023-11-01 22:02:55 0:59:32 0:22:47 0:36:45 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} 2
fail 7443306 2023-11-01 18:40:39 2023-11-01 21:17:35 2023-11-01 22:11:13 0:53:38 0:30:36 0:23:02 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7443307 2023-11-01 18:40:40 2023-11-01 21:22:06 2023-11-01 22:07:55 0:45:49 0:37:05 0:08:44 smithi main rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
fail 7443308 2023-11-01 18:40:40 2023-11-01 21:22:07 2023-11-01 22:14:59 0:52:52 0:19:21 0:33:31 smithi main rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
Failure Reason:

"2023-11-01T22:10:50.657266+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7443309 2023-11-01 18:40:41 2023-11-02 09:42:59 2023-11-02 11:29:48 1:46:49 1:36:15 0:10:34 smithi main centos 8.stream rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} 2
Failure Reason:

"2023-11-02T10:59:27.501632+0000 mon.a (mon.0) 3394 : cluster [WRN] Health check failed: 2 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY)" in cluster log

pass 7443310 2023-11-01 18:40:42 2023-11-02 09:43:59 2023-11-02 10:50:02 1:06:03 0:54:28 0:11:35 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
pass 7443311 2023-11-01 18:40:43 2023-11-02 09:45:00 2023-11-02 10:37:34 0:52:34 0:38:51 0:13:43 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7443312 2023-11-01 18:40:43 2023-11-02 09:50:11 2023-11-02 10:56:52 1:06:41 0:51:53 0:14:48 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
fail 7443313 2023-11-01 18:40:44 2023-11-02 09:54:32 2023-11-02 10:49:42 0:55:10 0:44:39 0:10:31 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

fail 7443314 2023-11-01 18:40:45 2023-11-02 09:54:32 2023-11-02 10:21:50 0:27:18 0:16:41 0:10:37 smithi main rhel 8.4 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f2ece71a1e784ed2e115679dd66f690a9706b8a8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

fail 7443315 2023-11-01 18:40:46 2023-11-02 09:56:43 2023-11-02 10:56:24 0:59:41 0:46:29 0:13:12 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2023-11-02T10:53:33.387760+0000 mon.a (mon.0) 473 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7443316 2023-11-01 18:40:46 2023-11-02 10:01:14 2023-11-02 11:40:58 1:39:44 1:30:44 0:09:00 smithi main centos 8.stream rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 7443317 2023-11-01 18:40:47 2023-11-02 10:01:44 2023-11-02 11:06:08 1:04:24 0:53:48 0:10:36 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
fail 7443318 2023-11-01 18:40:48 2023-11-02 10:02:25 2023-11-02 10:24:12 0:21:47 0:08:01 0:13:46 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2ece71a1e784ed2e115679dd66f690a9706b8a8

pass 7443319 2023-11-01 18:40:48 2023-11-02 10:05:46 2023-11-02 11:05:17 0:59:31 0:50:35 0:08:56 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 7443320 2023-11-01 18:40:49 2023-11-02 10:06:06 2023-11-02 10:56:07 0:50:01 0:21:39 0:28:22 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
Failure Reason:

Command failed on smithi114 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c6d86b6-796c-11ee-8db9-212e2dc638e7 -e sha1=f2ece71a1e784ed2e115679dd66f690a9706b8a8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

pass 7443321 2023-11-01 18:40:50 2023-11-02 10:26:52 2023-11-02 11:16:38 0:49:46 0:19:38 0:30:08 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7443322 2023-11-01 18:40:51 2023-11-02 10:46:35 2023-11-02 11:17:13 0:30:38 0:18:19 0:12:19 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi107 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f2ece71a1e784ed2e115679dd66f690a9706b8a8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86cff29c-796f-11ee-8db9-212e2dc638e7 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''

pass 7443323 2023-11-01 18:40:51 2023-11-02 10:49:45 2023-11-02 12:59:13 2:09:28 0:44:39 1:24:49 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7443324 2023-11-01 18:40:52 2023-11-02 10:50:06 2023-11-02 11:25:26 0:35:20 0:20:01 0:15:19 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
fail 7443325 2023-11-01 18:40:53 2023-11-02 10:56:17 2023-11-02 13:17:35 2:21:18 1:05:04 1:16:14 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7443326 2023-11-01 18:40:53 2023-11-02 10:56:17 2023-11-02 14:13:01 3:16:44 3:05:31 0:11:13 smithi main ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} 4
pass 7443327 2023-11-01 18:40:54 2023-11-02 10:56:58 2023-11-02 13:34:28 2:37:30 1:07:28 1:30:02 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
pass 7443328 2023-11-01 18:40:55 2023-11-02 11:05:19 2023-11-02 13:01:35 1:56:16 1:01:21 0:54:55 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7443329 2023-11-01 18:40:56 2023-11-02 11:06:09 2023-11-02 12:08:07 1:01:58 0:51:08 0:10:50 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
fail 7443330 2023-11-01 18:40:56 2023-11-02 11:06:10 2023-11-02 13:42:09 2:35:59 1:05:30 1:30:29 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7443331 2023-11-01 18:40:57 2023-11-02 11:17:35 2023-11-02 11:58:47 0:41:12 0:24:36 0:16:36 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
fail 7443332 2023-11-01 18:40:58 2023-11-02 11:29:56 2023-11-02 12:01:03 0:31:07 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} 3
Failure Reason:

Failed to reconnect to smithi107

pass 7443333 2023-11-01 18:40:59 2023-11-02 11:41:09 2023-11-02 12:32:14 0:51:05 0:30:16 0:20:49 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 7443334 2023-11-01 18:41:00 2023-11-02 11:51:30 2023-11-02 13:32:02 1:40:32 0:27:25 1:13:07 smithi main centos 8.stream rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 7443335 2023-11-01 18:41:00 2023-11-02 11:58:52 2023-11-02 12:25:01 0:26:09 0:16:35 0:09:34 smithi main rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
fail 7443336 2023-11-01 18:41:01 2023-11-02 11:59:22 2023-11-02 12:18:43 0:19:21 0:07:50 0:11:31 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f2ece71a1e784ed2e115679dd66f690a9706b8a8

pass 7443337 2023-11-01 18:41:02 2023-11-02 12:01:56 2023-11-02 13:43:11 1:41:15 0:33:08 1:08:07 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 7443338 2023-11-01 18:41:03 2023-11-02 12:01:57 2023-11-02 13:37:08 1:35:11 0:23:17 1:11:54 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2023-11-02T13:33:28.358972+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7443339 2023-11-01 18:41:03 2023-11-02 12:01:57 2023-11-02 12:35:32 0:33:35 0:19:14 0:14:21 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7443340 2023-11-01 18:41:04 2023-11-02 12:08:08 2023-11-02 13:26:47 1:18:39 0:52:52 0:25:47 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} 3
fail 7443341 2023-11-01 18:41:05 2023-11-02 15:26:43 2023-11-02 15:48:31 0:21:48 0:11:20 0:10:28 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Command failed on smithi016 with status 1: 'git clone https://git.ceph.com/ceph-ci.git testrepo && cd testrepo && git show f2ece71a1e784ed2e115679dd66f690a9706b8a8:src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm'

pass 7443342 2023-11-01 18:41:06 2023-11-02 15:26:43 2023-11-02 16:12:02 0:45:19 0:34:23 0:10:56 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7443343 2023-11-01 18:41:06 2023-11-02 15:26:43 2023-11-02 15:58:12 0:31:29 0:21:53 0:09:36 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2