Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7554007 2024-02-09 15:14:51 2024-02-09 19:48:33 2024-02-09 21:25:06 1:36:33 1:26:52 0:09:41 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} 3
fail 7554008 2024-02-09 15:14:52 2024-02-09 19:48:33 2024-02-09 20:28:01 0:39:28 0:29:04 0:10:24 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi134 with status 5: 'sudo systemctl stop ceph-1966c030-c787-11ee-95b8-87774f69a715@mon.smithi134'

fail 7554009 2024-02-09 15:14:53 2024-02-09 19:48:34 2024-02-09 20:08:47 0:20:13 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
Failure Reason:

Failed to reconnect to smithi196

fail 7554010 2024-02-09 15:14:54 2024-02-09 19:48:34 2024-02-09 20:09:04 0:20:30 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Failed to reconnect to smithi135

fail 7554011 2024-02-09 15:14:55 2024-02-09 19:48:34 2024-02-09 20:27:20 0:38:46 0:27:39 0:11:07 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi113 with status 5: 'sudo systemctl stop ceph-2b637102-c787-11ee-95b8-87774f69a715@mon.smithi113'

fail 7554012 2024-02-09 15:14:56 2024-02-09 19:48:57 2024-02-09 20:45:56 0:56:59 0:45:46 0:11:13 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554013 2024-02-09 15:14:57 2024-02-09 19:48:57 2024-02-09 20:27:06 0:38:09 0:27:01 0:11:08 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi170 with status 5: 'sudo systemctl stop ceph-f71f63ce-c786-11ee-95b8-87774f69a715@mon.smithi170'

fail 7554014 2024-02-09 15:14:58 2024-02-09 19:48:58 2024-02-09 20:23:30 0:34:32 0:23:12 0:11:20 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi102 with status 5: 'sudo systemctl stop ceph-842451a4-c786-11ee-95b8-87774f69a715@mon.smithi102'

fail 7554015 2024-02-09 15:14:58 2024-02-09 19:48:58 2024-02-09 20:15:15 0:26:17 0:19:03 0:07:14 smithi main rhel 8.6 rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} 3
Failure Reason:

'package_manager_version'

fail 7554016 2024-02-09 15:14:59 2024-02-09 19:48:58 2024-02-09 20:43:14 0:54:16 0:43:03 0:11:13 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554017 2024-02-09 15:15:00 2024-02-09 19:48:59 2024-02-09 20:38:38 0:49:39 0:43:14 0:06:25 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554018 2024-02-09 15:15:01 2024-02-09 19:48:59 2024-02-09 20:18:55 0:29:56 0:19:03 0:10:53 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7554019 2024-02-09 15:15:02 2024-02-09 19:48:59 2024-02-09 20:27:36 0:38:37 0:27:14 0:11:23 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi136 with status 5: 'sudo systemctl stop ceph-11758c58-c787-11ee-95b8-87774f69a715@mon.smithi136'

pass 7554020 2024-02-09 15:15:03 2024-02-09 19:49:10 2024-02-09 20:25:12 0:36:02 0:16:03 0:19:59 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7554021 2024-02-09 15:15:04 2024-02-09 20:02:59 2024-02-09 20:22:36 0:19:37 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
Failure Reason:

Failed to reconnect to smithi003

fail 7554022 2024-02-09 15:15:05 2024-02-09 20:03:09 2024-02-09 20:39:56 0:36:47 0:26:44 0:10:03 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi059 with status 5: 'sudo systemctl stop ceph-c96082e0-c788-11ee-95b8-87774f69a715@mon.smithi059'

fail 7554023 2024-02-09 15:15:06 2024-02-09 20:03:10 2024-02-09 20:34:01 0:30:51 0:19:43 0:11:08 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7554024 2024-02-09 15:15:06 2024-02-09 20:03:10 2024-02-09 21:00:58 0:57:48 0:44:18 0:13:30 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554025 2024-02-09 15:15:07 2024-02-09 20:03:10 2024-02-09 20:37:22 0:34:12 0:22:59 0:11:13 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi178 with status 5: 'sudo systemctl stop ceph-7a68df16-c788-11ee-95b8-87774f69a715@mon.smithi178'

fail 7554026 2024-02-09 15:15:08 2024-02-09 20:03:11 2024-02-09 20:31:02 0:27:51 0:18:26 0:09:25 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2024-02-09T20:28:11.685009+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7554027 2024-02-09 15:15:09 2024-02-09 20:03:11 2024-02-09 20:42:09 0:38:58 0:29:06 0:09:52 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi100 with status 5: 'sudo systemctl stop ceph-10e36452-c789-11ee-95b8-87774f69a715@mon.smithi100'

fail 7554028 2024-02-09 15:15:10 2024-02-09 20:03:11 2024-02-09 20:39:26 0:36:15 0:26:09 0:10:06 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi190 with status 5: 'sudo systemctl stop ceph-e6931cba-c788-11ee-95b8-87774f69a715@mon.smithi190'

fail 7554029 2024-02-09 15:15:11 2024-02-09 20:03:12 2024-02-09 20:22:58 0:19:46 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Failed to reconnect to smithi046

fail 7554030 2024-02-09 15:15:12 2024-02-09 20:03:12 2024-02-09 20:30:53 0:27:41 0:18:17 0:09:24 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi181 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7554031 2024-02-09 15:15:12 2024-02-09 20:03:12 2024-02-09 20:39:26 0:36:14 0:26:35 0:09:39 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi175 with status 5: 'sudo systemctl stop ceph-e5aab844-c788-11ee-95b8-87774f69a715@mon.smithi175'

fail 7554032 2024-02-09 15:15:13 2024-02-09 20:03:13 2024-02-09 20:56:55 0:53:42 0:43:06 0:10:36 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554033 2024-02-09 15:15:14 2024-02-09 20:03:13 2024-02-09 20:51:07 0:47:54 0:40:06 0:07:48 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554034 2024-02-09 15:15:15 2024-02-09 20:03:13 2024-02-09 20:39:14 0:36:01 0:26:04 0:09:57 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi171 with status 5: 'sudo systemctl stop ceph-d39a5416-c788-11ee-95b8-87774f69a715@mon.smithi171'

fail 7554035 2024-02-09 15:15:16 2024-02-09 20:03:14 2024-02-09 20:37:15 0:34:01 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
Failure Reason:

Failed to reconnect to smithi016

fail 7554036 2024-02-09 15:15:17 2024-02-09 20:17:51 2024-02-09 21:01:59 0:44:08 0:36:48 0:07:20 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554037 2024-02-09 15:15:18 2024-02-09 20:17:51 2024-02-09 20:39:16 0:21:25 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Failed to reconnect to smithi104

fail 7554038 2024-02-09 15:15:18 2024-02-09 20:17:51 2024-02-09 20:55:03 0:37:12 0:26:09 0:11:03 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi167 with status 5: 'sudo systemctl stop ceph-1265ec30-c78b-11ee-95b8-87774f69a715@mon.smithi167'

fail 7554039 2024-02-09 15:15:19 2024-02-09 20:17:52 2024-02-09 20:56:48 0:38:56 0:26:46 0:12:10 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi077 with status 5: 'sudo systemctl stop ceph-14f0017a-c78b-11ee-95b8-87774f69a715@mon.smithi077'

fail 7554040 2024-02-09 15:15:20 2024-02-09 20:17:52 2024-02-09 20:52:33 0:34:41 0:23:07 0:11:34 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi114 with status 5: 'sudo systemctl stop ceph-90b8844a-c78a-11ee-95b8-87774f69a715@mon.smithi114'

fail 7554041 2024-02-09 15:15:21 2024-02-09 20:17:52 2024-02-09 20:44:29 0:26:37 0:14:02 0:12:35 smithi main centos 8.stream rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} 3
Failure Reason:

'package_manager_version'

fail 7554042 2024-02-09 15:15:22 2024-02-09 20:17:53 2024-02-09 20:49:49 0:31:56 0:20:01 0:11:55 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7554043 2024-02-09 15:15:23 2024-02-09 20:17:53 2024-02-09 21:06:38 0:48:45 0:40:18 0:08:27 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554044 2024-02-09 15:15:24 2024-02-09 20:17:53 2024-02-09 20:46:43 0:28:50 0:18:06 0:10:44 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi152 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7554045 2024-02-09 15:15:25 2024-02-09 20:17:54 2024-02-09 21:03:02 0:45:08 0:33:22 0:11:46 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} 3
fail 7554046 2024-02-09 15:15:25 2024-02-09 20:17:54 2024-02-09 20:54:00 0:36:06 0:25:54 0:10:12 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi107 with status 5: 'sudo systemctl stop ceph-ee8f2b50-c78a-11ee-95b8-87774f69a715@mon.smithi107'

fail 7554047 2024-02-09 15:15:26 2024-02-09 20:17:54 2024-02-09 20:56:09 0:38:15 0:26:01 0:12:14 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi195 with status 5: 'sudo systemctl stop ceph-40cdf22a-c78b-11ee-95b8-87774f69a715@mon.smithi195'

fail 7554048 2024-02-09 15:15:27 2024-02-09 20:17:55 2024-02-09 21:07:51 0:49:56 0:36:52 0:13:04 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
Failure Reason:

Command failed on smithi057 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6d04046-c78a-11ee-95b8-87774f69a715 -e sha1=5db25abe00e218b6920215c0bef70af7e47c7152 -- bash -c \'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk \'"\'"\'{print $2}\'"\'"\')\''

fail 7554049 2024-02-09 15:15:28 2024-02-09 20:17:55 2024-02-09 20:58:19 0:40:24 0:24:14 0:16:10 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi137 with status 5: 'sudo systemctl stop ceph-5197ce78-c78b-11ee-95b8-87774f69a715@mon.smithi137'

fail 7554050 2024-02-09 15:15:29 2024-02-09 20:25:16 2024-02-09 21:13:15 0:47:59 0:37:48 0:10:11 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi161 with status 5: 'sudo systemctl stop ceph-992243b6-c78d-11ee-95b8-87774f69a715@mon.smithi161'

fail 7554051 2024-02-09 15:15:30 2024-02-09 20:25:47 2024-02-09 21:07:06 0:41:19 0:35:34 0:05:45 smithi main rhel 8.6 rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554052 2024-02-09 15:15:30 2024-02-09 20:25:47 2024-02-09 21:13:54 0:48:07 0:32:01 0:16:06 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi053 with status 5: 'sudo systemctl stop ceph-9f52091a-c78d-11ee-95b8-87774f69a715@mon.smithi053'

fail 7554053 2024-02-09 15:15:31 2024-02-09 20:33:19 2024-02-09 21:06:29 0:33:10 0:22:55 0:10:15 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2024-02-09T21:02:07.761145+0000 mon.a (mon.0) 477 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7554054 2024-02-09 15:15:32 2024-02-09 20:33:19 2024-02-09 21:24:35 0:51:16 0:41:34 0:09:42 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554055 2024-02-09 15:15:33 2024-02-09 20:33:19 2024-02-09 21:00:57 0:27:38 0:17:47 0:09:51 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5db25abe00e218b6920215c0bef70af7e47c7152 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7554056 2024-02-09 15:15:34 2024-02-09 20:33:20 2024-02-09 21:25:52 0:52:32 0:41:01 0:11:31 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

fail 7554057 2024-02-09 15:15:35 2024-02-09 20:33:20 2024-02-09 21:10:31 0:37:11 0:26:27 0:10:44 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi151 with status 5: 'sudo systemctl stop ceph-01649e66-c78d-11ee-95b8-87774f69a715@mon.smithi151'

fail 7554058 2024-02-09 15:15:36 2024-02-09 20:33:21 2024-02-09 21:26:28 0:53:07 0:43:21 0:09:46 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds