Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7910781 2024-09-18 09:14:15 2024-09-18 09:15:38 2024-09-18 10:42:00 1:26:22 1:15:36 0:10:46 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 7910782 2024-09-18 09:14:16 2024-09-18 09:16:18 2024-09-18 09:54:22 0:38:04 0:27:35 0:10:29 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7910783 2024-09-18 09:14:17 2024-09-18 09:16:49 2024-09-18 09:33:43 0:16:54 0:08:14 0:08:40 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_adoption} 1
pass 7910784 2024-09-18 09:14:19 2024-09-18 09:16:59 2024-09-18 09:55:21 0:38:22 0:28:47 0:09:35 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910785 2024-09-18 09:14:20 2024-09-18 09:17:20 2024-09-18 09:43:13 0:25:53 0:17:00 0:08:53 smithi main ubuntu 20.04 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 2
pass 7910786 2024-09-18 09:14:21 2024-09-18 09:17:20 2024-09-18 09:50:31 0:33:11 0:24:24 0:08:47 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7910787 2024-09-18 09:14:23 2024-09-18 09:17:30 2024-09-18 09:47:33 0:30:03 0:20:11 0:09:52 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7910788 2024-09-18 09:14:24 2024-09-18 09:17:41 2024-09-18 09:38:40 0:20:59 0:11:13 0:09:46 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/redirect} 2
pass 7910789 2024-09-18 09:14:26 2024-09-18 09:17:51 2024-09-18 09:41:41 0:23:50 0:13:02 0:10:48 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7910790 2024-09-18 09:14:27 2024-09-18 09:17:51 2024-09-18 10:02:39 0:44:48 0:33:49 0:10:59 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 7910791 2024-09-18 09:14:28 2024-09-18 09:18:32 2024-09-18 09:44:42 0:26:10 0:16:13 0:09:57 smithi main ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910792 2024-09-18 09:14:30 2024-09-18 09:18:52 2024-09-18 09:49:53 0:31:01 0:21:14 0:09:47 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910793 2024-09-18 09:14:31 2024-09-18 09:18:53 2024-09-18 09:41:21 0:22:28 0:11:57 0:10:31 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910794 2024-09-18 09:14:32 2024-09-18 09:18:53 2024-09-18 09:46:28 0:27:35 0:15:57 0:11:38 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_ca_signed_key} 2
pass 7910795 2024-09-18 09:14:34 2024-09-18 09:20:23 2024-09-18 10:02:44 0:42:21 0:32:36 0:09:45 smithi main ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910796 2024-09-18 09:14:35 2024-09-18 09:20:54 2024-09-18 09:45:16 0:24:22 0:13:07 0:11:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 7910797 2024-09-18 09:14:36 2024-09-18 09:22:25 2024-09-18 09:52:39 0:30:14 0:19:25 0:10:49 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 7910798 2024-09-18 09:14:37 2024-09-18 09:22:25 2024-09-18 09:57:08 0:34:43 0:23:13 0:11:30 smithi main centos 9.stream rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_recovery} 3
fail 7910799 2024-09-18 09:14:39 2024-09-18 09:23:26 2024-09-18 09:40:17 0:16:51 0:06:50 0:10:01 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi133 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7910800 2024-09-18 09:14:40 2024-09-18 09:23:26 2024-09-18 09:40:14 0:16:48 0:07:22 0:09:26 smithi main centos 9.stream rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7910801 2024-09-18 09:14:41 2024-09-18 09:23:26 2024-09-18 10:40:58 1:17:32 1:08:15 0:09:17 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} 2
pass 7910802 2024-09-18 09:14:43 2024-09-18 09:23:57 2024-09-18 09:42:45 0:18:48 0:08:00 0:10:48 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/{1-install 2-ceph 3-mgrmodules 4-units/cli}} 2
pass 7910803 2024-09-18 09:14:44 2024-09-18 09:25:47 2024-09-18 09:45:47 0:20:00 0:10:07 0:09:53 smithi main ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 7910804 2024-09-18 09:14:45 2024-09-18 09:25:48 2024-09-18 09:49:49 0:24:01 0:13:50 0:10:11 smithi main ubuntu 20.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 7910805 2024-09-18 09:14:47 2024-09-18 09:25:59 2024-09-18 09:53:45 0:27:46 0:18:22 0:09:24 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910806 2024-09-18 09:14:48 2024-09-18 09:25:59 2024-09-18 09:48:44 0:22:45 0:13:41 0:09:04 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/c2c} 1
fail 7910807 2024-09-18 09:14:49 2024-09-18 09:26:00 2024-09-18 09:39:42 0:13:42 0:03:52 0:09:50 smithi main centos 9.stream rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

fail 7910808 2024-09-18 09:14:50 2024-09-18 09:26:30 2024-09-18 09:57:31 0:31:01 0:22:12 0:08:49 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7910809 2024-09-18 09:14:52 2024-09-18 09:26:31 2024-09-18 09:51:35 0:25:04 0:15:19 0:09:45 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
fail 7910810 2024-09-18 09:14:53 2024-09-18 09:26:31 2024-09-18 09:40:50 0:14:19 0:03:48 0:10:31 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Command failed on smithi070 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910811 2024-09-18 09:14:54 2024-09-18 09:28:02 2024-09-18 10:06:52 0:38:50 0:27:41 0:11:09 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 7910812 2024-09-18 09:14:56 2024-09-18 09:33:44 2024-09-18 10:11:45 0:38:01 0:22:25 0:15:36 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 7910813 2024-09-18 09:14:57 2024-09-18 09:38:55 2024-09-18 10:02:16 0:23:21 0:11:45 0:11:36 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7910814 2024-09-18 09:14:58 2024-09-18 09:39:56 2024-09-18 10:12:31 0:32:35 0:20:54 0:11:41 smithi main centos 9.stream rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
pass 7910815 2024-09-18 09:15:00 2024-09-18 09:39:56 2024-09-18 10:02:21 0:22:25 0:11:02 0:11:23 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
fail 7910816 2024-09-18 09:15:01 2024-09-18 09:40:37 2024-09-18 09:53:38 0:13:01 0:03:46 0:09:15 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi133 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910817 2024-09-18 09:15:03 2024-09-18 09:40:37 2024-09-18 10:03:12 0:22:35 0:11:23 0:11:12 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7910818 2024-09-18 09:15:04 2024-09-18 09:41:08 2024-09-18 10:04:02 0:22:54 0:12:13 0:10:41 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 7910819 2024-09-18 09:15:05 2024-09-18 09:41:38 2024-09-18 10:07:04 0:25:26 0:14:40 0:10:46 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 7910820 2024-09-18 09:15:07 2024-09-18 09:42:59 2024-09-18 10:17:29 0:34:30 0:24:53 0:09:37 smithi main ubuntu 20.04 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
pass 7910821 2024-09-18 09:15:08 2024-09-18 09:43:29 2024-09-18 10:02:23 0:18:54 0:10:15 0:08:39 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} 1
pass 7910822 2024-09-18 09:15:09 2024-09-18 09:43:29 2024-09-18 10:18:30 0:35:01 0:24:46 0:10:15 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7910823 2024-09-18 09:15:11 2024-09-18 09:44:30 2024-09-18 10:14:25 0:29:55 0:20:46 0:09:09 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7910824 2024-09-18 09:15:12 2024-09-18 09:44:30 2024-09-18 10:05:15 0:20:45 0:11:53 0:08:52 smithi main centos 9.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7910825 2024-09-18 09:15:13 2024-09-18 09:44:31 2024-09-18 10:12:09 0:27:38 0:17:52 0:09:46 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 7910826 2024-09-18 09:15:15 2024-09-18 09:44:31 2024-09-18 10:10:41 0:26:10 0:15:29 0:10:41 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
fail 7910827 2024-09-18 09:15:16 2024-09-18 09:44:52 2024-09-18 09:57:49 0:12:57 0:04:36 0:08:21 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi177 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7910828 2024-09-18 09:15:17 2024-09-18 09:44:52 2024-09-18 10:20:36 0:35:44 0:23:29 0:12:15 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910829 2024-09-18 09:15:18 2024-09-18 09:46:42 2024-09-18 10:07:42 0:21:00 0:11:03 0:09:57 smithi main centos 9.stream rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
pass 7910830 2024-09-18 09:15:20 2024-09-18 09:46:43 2024-09-18 10:09:38 0:22:55 0:11:28 0:11:27 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/{1-install 2-ceph 3-mgrmodules 4-units/crash}} 2
pass 7910831 2024-09-18 09:15:21 2024-09-18 09:47:53 2024-09-18 10:08:55 0:21:02 0:09:55 0:11:07 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910832 2024-09-18 09:15:22 2024-09-18 09:48:54 2024-09-18 10:18:43 0:29:49 0:19:47 0:10:02 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 7910833 2024-09-18 09:15:24 2024-09-18 09:48:54 2024-09-18 10:19:43 0:30:49 0:17:47 0:13:02 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_timeout} 1
pass 7910834 2024-09-18 09:15:25 2024-09-18 09:48:54 2024-09-18 10:10:57 0:22:03 0:12:42 0:09:21 smithi main ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
pass 7910835 2024-09-18 09:15:26 2024-09-18 09:48:55 2024-09-18 10:06:58 0:18:03 0:06:52 0:11:11 smithi main centos 9.stream rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} 2
pass 7910836 2024-09-18 09:15:28 2024-09-18 09:50:05 2024-09-18 10:13:15 0:23:10 0:13:15 0:09:55 smithi main centos 9.stream rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} 1
pass 7910837 2024-09-18 09:15:29 2024-09-18 09:50:16 2024-09-18 10:22:41 0:32:25 0:21:55 0:10:30 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} 1
pass 7910838 2024-09-18 09:15:30 2024-09-18 09:50:36 2024-09-18 10:12:41 0:22:05 0:11:37 0:10:28 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
fail 7910839 2024-09-18 09:15:32 2024-09-18 09:50:46 2024-09-18 10:03:52 0:13:06 0:03:54 0:09:12 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi084 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910840 2024-09-18 09:15:33 2024-09-18 09:50:47 2024-09-18 10:31:42 0:40:55 0:29:53 0:11:02 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
pass 7910841 2024-09-18 09:15:34 2024-09-18 09:51:27 2024-09-18 10:08:26 0:16:59 0:06:42 0:10:17 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7910842 2024-09-18 09:15:36 2024-09-18 09:51:38 2024-09-18 10:23:52 0:32:14 0:21:24 0:10:50 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 7910843 2024-09-18 09:15:37 2024-09-18 09:51:48 2024-09-18 10:48:22 0:56:34 0:44:53 0:11:41 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
fail 7910844 2024-09-18 09:15:38 2024-09-18 09:52:08 2024-09-18 11:06:07 1:13:59 1:04:26 0:09:33 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

saw valgrind issues

pass 7910845 2024-09-18 09:15:40 2024-09-18 09:52:59 2024-09-18 10:19:32 0:26:33 0:12:27 0:14:06 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7910846 2024-09-18 09:15:41 2024-09-18 09:53:49 2024-09-18 10:14:51 0:21:02 0:11:58 0:09:04 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7910847 2024-09-18 09:15:42 2024-09-18 09:54:00 2024-09-18 10:15:06 0:21:06 0:09:23 0:11:43 smithi main ubuntu 20.04 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 7910848 2024-09-18 09:15:44 2024-09-18 09:54:40 2024-09-18 10:33:47 0:39:07 0:28:10 0:10:57 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7910849 2024-09-18 09:15:45 2024-09-18 09:55:41 2024-09-18 10:35:09 0:39:28 0:25:56 0:13:32 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7910850 2024-09-18 09:15:46 2024-09-18 09:57:21 2024-09-18 10:17:11 0:19:50 0:09:51 0:09:59 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910851 2024-09-18 09:15:47 2024-09-18 09:57:22 2024-09-18 10:28:07 0:30:45 0:18:24 0:12:21 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
fail 7910852 2024-09-18 09:15:49 2024-09-18 09:58:02 2024-09-18 10:15:21 0:17:19 0:03:50 0:13:29 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi079 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910853 2024-09-18 09:15:50 2024-09-18 10:02:33 2024-09-18 10:21:46 0:19:13 0:09:02 0:10:11 smithi main centos 9.stream rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} 1
pass 7910854 2024-09-18 09:15:51 2024-09-18 10:02:34 2024-09-18 10:21:41 0:19:07 0:10:04 0:09:03 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/{1-install 2-ceph 3-mgrmodules 4-units/devicehealth}} 2
pass 7910855 2024-09-18 09:15:53 2024-09-18 10:02:44 2024-09-18 10:40:43 0:37:59 0:25:44 0:12:15 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 7910856 2024-09-18 09:15:54 2024-09-18 10:02:54 2024-09-18 10:30:59 0:28:05 0:18:05 0:10:00 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7910857 2024-09-18 09:15:56 2024-09-18 10:02:55 2024-09-18 10:36:15 0:33:20 0:22:47 0:10:33 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 7910858 2024-09-18 09:15:57 2024-09-18 10:03:25 2024-09-18 10:23:25 0:20:00 0:09:04 0:10:56 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910859 2024-09-18 09:15:58 2024-09-18 10:03:26 2024-09-18 10:25:27 0:22:01 0:12:49 0:09:12 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 7910860 2024-09-18 09:16:00 2024-09-18 10:03:26 2024-09-18 10:35:07 0:31:41 0:21:47 0:09:54 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910861 2024-09-18 09:16:01 2024-09-18 10:04:06 2024-09-18 10:21:47 0:17:41 0:07:58 0:09:43 smithi main centos 9.stream rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 1
pass 7910862 2024-09-18 09:16:03 2024-09-18 10:04:17 2024-09-18 10:30:02 0:25:45 0:14:10 0:11:35 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_host_drain} 3
pass 7910863 2024-09-18 09:16:04 2024-09-18 10:07:08 2024-09-18 10:27:11 0:20:03 0:09:13 0:10:50 smithi main ubuntu 20.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 7910864 2024-09-18 09:16:06 2024-09-18 10:07:08 2024-09-18 10:40:17 0:33:09 0:24:40 0:08:29 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 7910865 2024-09-18 09:16:07 2024-09-18 10:07:18 2024-09-18 10:24:56 0:17:38 0:06:52 0:10:46 smithi main centos 9.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 2
pass 7910866 2024-09-18 09:16:08 2024-09-18 10:07:59 2024-09-18 10:25:25 0:17:26 0:07:52 0:09:34 smithi main centos 9.stream rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7910867 2024-09-18 09:16:10 2024-09-18 10:08:39 2024-09-18 10:39:55 0:31:16 0:20:30 0:10:46 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
fail 7910868 2024-09-18 09:16:11 2024-09-18 10:10:00 2024-09-18 10:30:44 0:20:44 0:11:54 0:08:50 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

Command failed (workunit test cephadm/test_iscsi_pids_limit.sh) on smithi043 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_pids_limit.sh'

pass 7910869 2024-09-18 09:16:13 2024-09-18 10:10:00 2024-09-18 11:46:43 1:36:43 1:26:42 0:10:01 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 7910870 2024-09-18 09:16:14 2024-09-18 10:10:50 2024-09-18 10:38:20 0:27:30 0:17:17 0:10:13 smithi main ubuntu 20.04 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910871 2024-09-18 09:16:15 2024-09-18 10:10:51 2024-09-18 10:36:50 0:25:59 0:15:08 0:10:51 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 7910872 2024-09-18 09:16:17 2024-09-18 10:12:01 2024-09-18 10:58:59 0:46:58 0:36:05 0:10:53 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 7910873 2024-09-18 09:16:18 2024-09-18 10:12:22 2024-09-18 10:38:17 0:25:55 0:13:38 0:12:17 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7910874 2024-09-18 09:16:20 2024-09-18 10:12:42 2024-09-18 10:33:48 0:21:06 0:10:27 0:10:39 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7910875 2024-09-18 09:16:21 2024-09-18 10:14:43 2024-09-18 10:28:01 0:13:18 0:03:47 0:09:31 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi133 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910876 2024-09-18 09:16:22 2024-09-18 10:15:03 2024-09-18 10:32:56 0:17:53 0:07:13 0:10:40 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_striper} 2
pass 7910877 2024-09-18 09:16:24 2024-09-18 10:15:24 2024-09-18 10:54:35 0:39:11 0:29:42 0:09:29 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7910878 2024-09-18 09:16:25 2024-09-18 10:15:34 2024-09-18 10:35:12 0:19:38 0:10:37 0:09:01 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910879 2024-09-18 09:16:26 2024-09-18 10:15:35 2024-09-18 10:41:45 0:26:10 0:13:55 0:12:15 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/{1-install 2-ceph 3-mgrmodules 4-units/failover}} 2
pass 7910880 2024-09-18 09:16:28 2024-09-18 10:17:45 2024-09-18 12:27:54 2:10:09 1:59:43 0:10:26 smithi main centos 9.stream rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 2
pass 7910881 2024-09-18 09:16:29 2024-09-18 10:18:46 2024-09-18 10:39:41 0:20:55 0:09:56 0:10:59 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7910882 2024-09-18 09:16:31 2024-09-18 10:18:56 2024-09-18 10:40:59 0:22:03 0:11:41 0:10:22 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli} 1
pass 7910883 2024-09-18 09:16:32 2024-09-18 10:53:22 1247 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7910884 2024-09-18 09:16:33 2024-09-18 10:19:47 2024-09-18 10:41:31 0:21:44 0:12:41 0:09:03 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
fail 7910885 2024-09-18 09:16:35 2024-09-18 10:19:47 2024-09-18 10:44:02 0:24:15 0:12:41 0:11:34 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7910886 2024-09-18 09:16:36 2024-09-18 10:20:48 2024-09-18 10:37:55 0:17:07 0:07:59 0:09:08 smithi main centos 9.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7910887 2024-09-18 09:16:38 2024-09-18 10:20:58 2024-09-18 12:41:17 2:20:19 2:08:19 0:12:00 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 7910888 2024-09-18 09:16:39 2024-09-18 10:21:59 2024-09-18 11:16:26 0:54:27 0:44:40 0:09:47 smithi main ubuntu 20.04 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 7910889 2024-09-18 09:16:40 2024-09-18 10:22:09 2024-09-18 12:18:17 1:56:08 1:43:11 0:12:57 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 7910890 2024-09-18 09:16:42 2024-09-18 10:24:10 2024-09-18 11:01:25 0:37:15 0:24:38 0:12:37 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7910891 2024-09-18 09:16:43 2024-09-18 10:25:10 2024-09-18 10:52:39 0:27:29 0:17:01 0:10:28 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 7910892 2024-09-18 09:16:44 2024-09-18 10:25:41 2024-09-18 10:59:15 0:33:34 0:23:36 0:09:58 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910893 2024-09-18 09:16:46 2024-09-18 10:26:11 2024-09-18 13:12:03 2:45:52 2:34:51 0:11:01 smithi main ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} 1
pass 7910894 2024-09-18 09:16:47 2024-09-18 10:28:12 2024-09-18 10:56:00 0:27:48 0:19:03 0:08:45 smithi main ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 7910895 2024-09-18 09:16:48 2024-09-18 10:28:12 2024-09-18 11:00:32 0:32:20 0:20:27 0:11:53 smithi main ubuntu 20.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
fail 7910896 2024-09-18 09:16:50 2024-09-18 10:28:23 2024-09-18 10:47:11 0:18:48 0:07:28 0:11:20 smithi main centos 9.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

pass 7910897 2024-09-18 09:16:51 2024-09-18 10:30:13 2024-09-18 10:53:45 0:23:32 0:12:44 0:10:48 smithi main centos 9.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_recovery} 3
pass 7910898 2024-09-18 09:16:52 2024-09-18 10:30:54 2024-09-18 10:55:14 0:24:20 0:13:25 0:10:55 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 7910899 2024-09-18 09:16:54 2024-09-18 10:31:14 2024-09-18 11:07:11 0:35:57 0:23:00 0:12:57 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7910900 2024-09-18 09:16:55 2024-09-18 10:34:05 2024-09-18 11:16:24 0:42:19 0:30:45 0:11:34 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} 2
pass 7910901 2024-09-18 09:16:56 2024-09-18 10:34:05 2024-09-18 10:53:09 0:19:04 0:10:02 0:09:02 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} tasks/{1-install 2-ceph 3-mgrmodules 4-units/insights}} 2
pass 7910902 2024-09-18 09:16:58 2024-09-18 10:34:06 2024-09-18 10:57:15 0:23:09 0:13:55 0:09:14 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mgr} 1
pass 7910903 2024-09-18 09:16:59 2024-09-18 10:34:06 2024-09-18 11:05:26 0:31:20 0:19:58 0:11:22 smithi main ubuntu 20.04 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
pass 7910904 2024-09-18 09:17:00 2024-09-18 10:35:17 2024-09-18 10:55:51 0:20:34 0:11:05 0:09:29 smithi main centos 9.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
fail 7910905 2024-09-18 09:17:01 2024-09-18 10:35:27 2024-09-18 11:11:11 0:35:44 0:25:30 0:10:14 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

saw valgrind issues

pass 7910906 2024-09-18 09:17:03 2024-09-18 10:35:27 2024-09-18 10:55:18 0:19:51 0:10:29 0:09:22 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 7910907 2024-09-18 09:17:04 2024-09-18 10:35:28 2024-09-18 10:59:20 0:23:52 0:13:41 0:10:11 smithi main centos 9.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} 2
fail 7910908 2024-09-18 09:17:05 2024-09-18 10:36:28 2024-09-18 10:49:16 0:12:48 0:03:49 0:08:59 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi070 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910909 2024-09-18 09:17:07 2024-09-18 10:36:29 2024-09-18 11:01:00 0:24:31 0:10:36 0:13:55 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7910910 2024-09-18 09:17:08 2024-09-18 10:38:39 2024-09-18 11:18:46 0:40:07 0:29:21 0:10:46 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 7910911 2024-09-18 09:17:09 2024-09-18 10:40:00 2024-09-18 11:00:15 0:20:15 0:09:01 0:11:14 smithi main ubuntu 20.04 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910912 2024-09-18 09:17:11 2024-09-18 10:40:00 2024-09-18 11:15:31 0:35:31 0:25:31 0:10:00 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7910913 2024-09-18 09:17:12 2024-09-18 10:40:31 2024-09-18 11:09:06 0:28:35 0:18:42 0:09:53 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7910914 2024-09-18 09:17:13 2024-09-18 10:41:01 2024-09-18 11:09:26 0:28:25 0:18:16 0:10:09 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 7910915 2024-09-18 09:17:15 2024-09-18 10:41:12 2024-09-18 11:06:12 0:25:00 0:15:53 0:09:07 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

saw valgrind issues

pass 7910916 2024-09-18 09:17:16 2024-09-18 10:41:12 2024-09-18 11:21:39 0:40:27 0:30:02 0:10:25 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7910917 2024-09-18 09:17:17 2024-09-18 10:41:42 2024-09-18 11:12:08 0:30:26 0:20:21 0:10:05 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 7910918 2024-09-18 09:17:19 2024-09-18 10:42:03 2024-09-18 11:08:54 0:26:51 0:14:26 0:12:25 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
dead 7910919 2024-09-18 09:17:20 2024-09-18 10:44:14 2024-09-18 10:54:48 0:10:34 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
Failure Reason:

SSH connection to smithi179 was lost: 'sudo yum install -y kernel'

pass 7910920 2024-09-18 09:17:21 2024-09-18 10:47:04 2024-09-18 11:04:03 0:16:59 0:07:02 0:09:57 smithi main centos 9.stream rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
pass 7910921 2024-09-18 09:17:23 2024-09-18 10:47:05 2024-09-18 11:14:25 0:27:20 0:18:06 0:09:14 smithi main centos 9.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}} 2
pass 7910922 2024-09-18 09:17:24 2024-09-18 10:47:25 2024-09-18 13:32:22 2:44:57 2:34:21 0:10:36 smithi main centos 9.stream rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_latest}} 1
pass 7910923 2024-09-18 09:17:25 2024-09-18 10:49:26 2024-09-18 11:22:45 0:33:19 0:17:30 0:15:49 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7910924 2024-09-18 09:17:27 2024-09-18 10:52:57 2024-09-18 11:23:32 0:30:35 0:19:19 0:11:16 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 7910925 2024-09-18 09:17:28 2024-09-18 10:53:27 2024-09-18 11:35:16 0:41:49 0:29:20 0:12:29 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910926 2024-09-18 09:17:29 2024-09-18 10:53:38 2024-09-18 11:22:58 0:29:20 0:18:26 0:10:54 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} 2
pass 7910927 2024-09-18 09:17:31 2024-09-18 10:53:58 2024-09-18 11:28:54 0:34:56 0:24:42 0:10:14 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/{1-install 2-ceph 3-mgrmodules 4-units/module_selftest}} 2
pass 7910928 2024-09-18 09:17:32 2024-09-18 10:54:48 2024-09-18 11:27:06 0:32:18 0:21:27 0:10:51 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 7910929 2024-09-18 09:17:33 2024-09-18 10:54:59 2024-09-18 11:27:39 0:32:40 0:19:51 0:12:49 smithi main ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910930 2024-09-18 09:17:34 2024-09-18 10:55:09 2024-09-18 11:14:14 0:19:05 0:08:16 0:10:49 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_adoption} 1
fail 7910931 2024-09-18 09:17:36 2024-09-18 10:55:30 2024-09-18 11:37:35 0:42:05 0:32:39 0:09:26 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Exiting scrub checking -- not all pgs scrubbed.

pass 7910932 2024-09-18 09:17:37 2024-09-18 10:55:30 2024-09-18 11:14:06 0:18:36 0:08:59 0:09:37 smithi main ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 7910933 2024-09-18 09:17:38 2024-09-18 10:56:10 2024-09-18 11:28:20 0:32:10 0:19:34 0:12:36 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
fail 7910934 2024-09-18 09:17:40 2024-09-18 10:59:11 2024-09-18 11:47:38 0:48:27 0:36:52 0:11:35 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi196 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'"

pass 7910935 2024-09-18 09:17:41 2024-09-18 10:59:32 2024-09-18 12:13:13 1:13:41 1:02:47 0:10:54 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} 1
pass 7910936 2024-09-18 09:17:42 2024-09-18 10:59:32 2024-09-18 11:19:45 0:20:13 0:10:32 0:09:41 smithi main ubuntu 20.04 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
fail 7910937 2024-09-18 09:17:44 2024-09-18 10:59:32 2024-09-18 11:15:42 0:16:10 0:03:52 0:12:18 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi006 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910938 2024-09-18 09:17:45 2024-09-18 11:00:43 2024-09-18 11:34:12 0:33:29 0:23:25 0:10:04 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 7910939 2024-09-18 09:17:46 2024-09-18 11:01:13 2024-09-18 11:27:10 0:25:57 0:12:20 0:13:37 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7910940 2024-09-18 09:17:48 2024-09-18 11:01:44 2024-09-18 11:26:29 0:24:45 0:11:21 0:13:24 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} 2
pass 7910941 2024-09-18 09:17:49 2024-09-18 11:04:24 2024-09-18 11:25:22 0:20:58 0:09:35 0:11:23 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910942 2024-09-18 09:17:50 2024-09-18 11:28:43 846 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache} 2
fail 7910943 2024-09-18 09:17:51 2024-09-18 11:05:45 2024-09-18 11:19:34 0:13:49 0:03:50 0:09:59 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi067 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910944 2024-09-18 09:17:53 2024-09-18 11:06:26 2024-09-18 11:29:27 0:23:01 0:11:30 0:11:31 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7910945 2024-09-18 09:17:54 2024-09-18 11:07:26 2024-09-18 11:27:12 0:19:46 0:09:51 0:09:55 smithi main ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910946 2024-09-18 09:17:55 2024-09-18 11:07:27 2024-09-18 11:26:30 0:19:03 0:10:20 0:08:43 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7910947 2024-09-18 09:17:57 2024-09-18 11:07:27 2024-09-18 11:44:26 0:36:59 0:27:17 0:09:42 smithi main centos 9.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7910948 2024-09-18 09:17:58 2024-09-18 11:07:27 2024-09-18 11:27:43 0:20:16 0:09:57 0:10:19 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 7910949 2024-09-18 09:18:00 2024-09-18 11:09:08 2024-09-18 11:42:08 0:33:00 0:23:22 0:09:38 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 7910950 2024-09-18 09:18:01 2024-09-18 11:09:18 2024-09-18 11:33:14 0:23:56 0:13:48 0:10:08 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7910951 2024-09-18 09:18:02 2024-09-18 11:09:19 2024-09-18 11:30:01 0:20:42 0:09:54 0:10:48 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} tasks/{1-install 2-ceph 3-mgrmodules 4-units/per_module_finisher_stats}} 2
pass 7910952 2024-09-18 09:18:04 2024-09-18 11:09:49 2024-09-18 11:46:08 0:36:19 0:22:11 0:14:08 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7910953 2024-09-18 09:18:05 2024-09-18 11:11:20 2024-09-18 11:30:19 0:18:59 0:08:31 0:10:28 smithi main ubuntu 20.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 7910954 2024-09-18 09:18:06 2024-09-18 11:12:20 2024-09-18 11:29:12 0:16:52 0:08:25 0:08:27 smithi main centos 9.stream rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
pass 7910955 2024-09-18 09:18:08 2024-09-18 11:12:21 2024-09-18 11:55:53 0:43:32 0:32:50 0:10:42 smithi main ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 7910956 2024-09-18 09:18:09 2024-09-18 11:14:21 2024-09-18 11:34:11 0:19:50 0:08:25 0:11:25 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi133 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7910957 2024-09-18 09:18:10 2024-09-18 11:14:22 2024-09-18 11:50:30 0:36:08 0:25:33 0:10:35 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910958 2024-09-18 09:18:12 2024-09-18 11:14:32 2024-09-18 11:37:40 0:23:08 0:12:44 0:10:24 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 7910959 2024-09-18 09:18:13 2024-09-18 11:14:42 2024-09-18 11:37:56 0:23:14 0:11:44 0:11:30 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910960 2024-09-18 09:18:14 2024-09-18 11:15:43 2024-09-18 11:45:54 0:30:11 0:20:22 0:09:49 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7910961 2024-09-18 09:18:16 2024-09-18 11:15:53 2024-09-18 11:37:53 0:22:00 0:11:11 0:10:49 smithi main ubuntu 20.04 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 7910962 2024-09-18 09:18:17 2024-09-18 11:15:54 2024-09-18 11:30:16 0:14:22 0:03:52 0:10:30 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Command failed on smithi044 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910963 2024-09-18 09:18:18 2024-09-18 11:16:44 2024-09-18 11:34:33 0:17:49 0:08:19 0:09:30 smithi main ubuntu 20.04 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 7910964 2024-09-18 09:18:19 2024-09-18 11:16:44 2024-09-18 11:54:34 0:37:50 0:26:06 0:11:44 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
fail 7910965 2024-09-18 09:18:21 2024-09-18 11:18:05 2024-09-18 11:32:54 0:14:49 0:04:41 0:10:08 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7910966 2024-09-18 09:18:22 2024-09-18 11:18:15 2024-09-18 12:36:54 1:18:39 1:08:46 0:09:53 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} 2
pass 7910967 2024-09-18 09:18:23 2024-09-18 11:19:46 2024-09-18 11:48:07 0:28:21 0:17:52 0:10:29 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910968 2024-09-18 09:18:25 2024-09-18 11:20:06 2024-09-18 11:52:42 0:32:36 0:21:39 0:10:57 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} 1
fail 7910969 2024-09-18 09:18:26 2024-09-18 11:21:57 2024-09-18 11:40:56 0:18:59 0:07:40 0:11:19 smithi main ubuntu 20.04 rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Command failed on smithi002 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull'

pass 7910970 2024-09-18 09:18:27 2024-09-18 11:23:07 2024-09-18 11:45:56 0:22:49 0:14:38 0:08:11 smithi main centos 9.stream rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
fail 7910971 2024-09-18 09:18:29 2024-09-18 11:23:08 2024-09-18 14:52:51 3:29:43 3:19:06 0:10:37 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi063 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh'

pass 7910972 2024-09-18 09:18:30 2024-09-18 11:23:48 2024-09-18 11:48:21 0:24:33 0:10:44 0:13:49 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7910973 2024-09-18 09:18:31 2024-09-18 11:26:49 2024-09-18 12:04:55 0:38:06 0:28:47 0:09:19 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 7910974 2024-09-18 09:18:33 2024-09-18 11:26:49 2024-09-18 11:47:05 0:20:16 0:10:51 0:09:25 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 7910975 2024-09-18 09:18:34 2024-09-18 11:27:20 2024-09-18 11:40:30 0:13:10 0:03:52 0:09:18 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi162 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7910976 2024-09-18 09:18:36 2024-09-18 11:27:20 2024-09-18 12:08:36 0:41:16 0:31:50 0:09:26 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 7910977 2024-09-18 09:18:37 2024-09-18 11:27:31 2024-09-18 11:51:32 0:24:01 0:13:02 0:10:59 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 7910978 2024-09-18 09:18:38 2024-09-18 11:28:01 2024-09-18 12:03:36 0:35:35 0:22:08 0:13:27 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/{1-install 2-ceph 3-mgrmodules 4-units/progress}} 2
pass 7910979 2024-09-18 09:18:40 2024-09-18 11:28:02 2024-09-18 11:48:27 0:20:25 0:10:20 0:10:05 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910980 2024-09-18 09:18:41 2024-09-18 11:28:32 2024-09-18 12:01:47 0:33:15 0:22:54 0:10:21 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7910981 2024-09-18 09:18:42 2024-09-18 11:28:32 2024-09-18 12:15:34 0:47:02 0:37:08 0:09:54 smithi main centos 9.stream rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 1
pass 7910982 2024-09-18 09:18:44 2024-09-18 11:28:43 2024-09-18 11:49:33 0:20:50 0:10:34 0:10:16 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7910983 2024-09-18 09:18:45 2024-09-18 11:28:53 2024-09-18 12:29:22 1:00:29 0:50:47 0:09:42 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 7910984 2024-09-18 09:18:46 2024-09-18 11:29:14 2024-09-18 11:52:16 0:23:02 0:11:47 0:11:15 smithi main centos 9.stream rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} 1
pass 7910985 2024-09-18 09:18:48 2024-09-18 11:29:24 2024-09-18 12:18:32 0:49:08 0:37:40 0:11:28 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7910986 2024-09-18 09:18:49 2024-09-18 11:30:14 2024-09-18 12:00:07 0:29:53 0:19:21 0:10:32 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 7910987 2024-09-18 09:18:50 2024-09-18 11:30:35 2024-09-18 11:49:42 0:19:07 0:09:08 0:09:59 smithi main centos 9.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7910988 2024-09-18 09:18:51 2024-09-18 11:30:35 2024-09-18 11:55:54 0:25:19 0:13:04 0:12:15 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm_timeout} 1
pass 7910989 2024-09-18 09:18:53 2024-09-18 11:33:06 2024-09-18 11:50:30 0:17:24 0:06:49 0:10:35 smithi main centos 9.stream rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} 1
pass 7910990 2024-09-18 09:18:54 2024-09-18 11:33:36 2024-09-18 12:05:22 0:31:46 0:22:09 0:09:37 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7910991 2024-09-18 09:18:55 2024-09-18 11:34:27 2024-09-18 13:09:53 1:35:26 1:25:16 0:10:10 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 7910992 2024-09-18 09:18:57 2024-09-18 11:34:47 2024-09-18 12:07:14 0:32:27 0:19:38 0:12:49 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7910993 2024-09-18 09:18:58 2024-09-18 11:35:28 2024-09-18 12:16:01 0:40:33 0:29:51 0:10:42 smithi main ubuntu 20.04 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910994 2024-09-18 09:18:59 2024-09-18 11:35:38 2024-09-18 11:57:52 0:22:14 0:09:48 0:12:26 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7910995 2024-09-18 09:19:01 2024-09-18 11:37:49 2024-09-18 12:01:58 0:24:09 0:14:02 0:10:07 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 7910996 2024-09-18 09:19:02 2024-09-18 11:37:59 2024-09-18 11:59:49 0:21:50 0:11:29 0:10:21 smithi main centos 9.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery} 2
pass 7910997 2024-09-18 09:19:03 2024-09-18 11:38:09 2024-09-18 12:09:05 0:30:56 0:18:17 0:12:39 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_extra_daemon_features} 2
pass 7910998 2024-09-18 09:19:05 2024-09-18 11:40:50 2024-09-18 12:03:59 0:23:09 0:14:21 0:08:48 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/repair_test} 2
pass 7910999 2024-09-18 09:19:06 2024-09-18 11:41:11 2024-09-18 12:06:25 0:25:14 0:13:09 0:12:05 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} 2
pass 7911000 2024-09-18 09:19:07 2024-09-18 11:42:21 2024-09-18 12:03:39 0:21:18 0:09:02 0:12:16 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/{1-install 2-ceph 3-mgrmodules 4-units/prometheus}} 2
fail 7911001 2024-09-18 09:19:09 2024-09-18 11:44:42 2024-09-18 12:17:56 0:33:14 0:22:38 0:10:36 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} 1
Failure Reason:

Command failed (workunit test mon/mon-cluster-log.sh) on smithi104 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-cluster-log.sh'

pass 7911002 2024-09-18 09:19:10 2024-09-18 11:46:12 2024-09-18 12:11:04 0:24:52 0:12:21 0:12:31 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7911003 2024-09-18 09:19:11 2024-09-18 11:46:23 2024-09-18 12:06:23 0:20:00 0:10:06 0:09:54 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 7911004 2024-09-18 09:19:13 2024-09-18 11:47:23 2024-09-18 12:27:35 0:40:12 0:29:44 0:10:28 smithi main ubuntu 20.04 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911005 2024-09-18 09:19:14 2024-09-18 11:47:54 2024-09-18 12:55:45 1:07:51 0:57:17 0:10:34 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 7911006 2024-09-18 09:19:16 2024-09-18 11:47:54 2024-09-18 12:05:27 0:17:33 0:06:41 0:10:52 smithi main centos 9.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7911007 2024-09-18 09:19:17 2024-09-18 11:48:24 2024-09-18 12:12:05 0:23:41 0:14:08 0:09:33 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_host_drain} 3
fail 7911008 2024-09-18 09:19:18 2024-09-18 11:48:35 2024-09-18 12:03:48 0:15:13 0:05:01 0:10:12 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
Failure Reason:

Command failed on smithi161 with status 1: 'sudo yum -y install cephfs-java'

pass 7911009 2024-09-18 09:19:20 2024-09-18 11:48:45 2024-09-18 12:19:07 0:30:22 0:19:01 0:11:21 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 7911010 2024-09-18 09:19:21 2024-09-18 11:49:16 2024-09-18 12:09:50 0:20:34 0:10:14 0:10:20 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 7911011 2024-09-18 09:19:22 2024-09-18 11:50:46 2024-09-18 12:04:25 0:13:39 0:04:04 0:09:35 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi022 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911012 2024-09-18 09:19:24 2024-09-18 11:51:47 2024-09-18 12:09:30 0:17:43 0:07:14 0:10:29 smithi main centos 9.stream rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} 1
pass 7911013 2024-09-18 09:19:25 2024-09-18 11:52:27 2024-09-18 12:25:46 0:33:19 0:23:27 0:09:52 smithi main centos 9.stream rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}} 1
pass 7911014 2024-09-18 09:19:26 2024-09-18 11:52:57 2024-09-18 12:14:12 0:21:15 0:09:44 0:11:31 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 7911015 2024-09-18 09:19:28 2024-09-18 11:54:48 2024-09-18 12:12:56 0:18:08 0:06:13 0:11:55 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

No module named 'tasks'

pass 7911016 2024-09-18 09:19:29 2024-09-18 11:56:09 2024-09-18 12:34:39 0:38:30 0:26:12 0:12:18 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7911017 2024-09-18 09:19:30 2024-09-18 11:58:09 2024-09-18 12:21:04 0:22:55 0:11:18 0:11:37 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 7911018 2024-09-18 09:19:32 2024-09-18 11:59:40 2024-09-18 12:23:44 0:24:04 0:13:47 0:10:17 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 7911019 2024-09-18 09:19:33 2024-09-18 11:59:40 2024-09-18 12:19:14 0:19:34 0:10:30 0:09:04 smithi main centos 9.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}} 1
pass 7911020 2024-09-18 09:19:34 2024-09-18 12:00:11 2024-09-18 12:19:06 0:18:55 0:06:51 0:12:04 smithi main centos 9.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
fail 7911021 2024-09-18 09:19:35 2024-09-18 12:02:01 2024-09-18 12:27:03 0:25:02 0:16:08 0:08:54 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
Failure Reason:

"1726662256.5813572 mon.a (mon.0) 144 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7911022 2024-09-18 09:19:37 2024-09-18 12:02:02 2024-09-18 12:36:38 0:34:36 0:23:54 0:10:42 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 7911023 2024-09-18 09:19:38 2024-09-18 12:02:22 2024-09-18 12:17:26 0:15:04 0:01:46 0:13:18 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

['ubuntu@smithi179.front.sepia.ceph.com: Permission denied (publickey).']

pass 7911024 2024-09-18 09:19:39 2024-09-18 12:03:53 2024-09-18 12:23:57 0:20:04 0:09:56 0:10:08 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/{1-install 2-ceph 3-mgrmodules 4-units/workunits}} 2
pass 7911025 2024-09-18 09:19:41 2024-09-18 12:03:53 2024-09-18 12:26:04 0:22:11 0:11:52 0:10:19 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 7911026 2024-09-18 09:19:42 2024-09-18 12:04:03 2024-09-18 12:28:02 0:23:59 0:13:49 0:10:10 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 7911027 2024-09-18 09:19:44 2024-09-18 12:04:14 2024-09-18 12:44:17 0:40:03 0:27:29 0:12:34 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
pass 7911028 2024-09-18 09:19:45 2024-09-18 12:04:44 2024-09-18 12:24:04 0:19:20 0:10:26 0:08:54 smithi main centos 9.stream rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
fail 7911029 2024-09-18 09:19:46 2024-09-18 12:05:04 2024-09-18 12:18:27 0:13:23 0:03:53 0:09:30 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Command failed on smithi003 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911030 2024-09-18 09:19:48 2024-09-18 12:05:35 2024-09-18 12:23:34 0:17:59 0:07:15 0:10:44 smithi main centos 9.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} 3
pass 7911031 2024-09-18 09:19:49 2024-09-18 12:06:36 2024-09-18 12:23:33 0:16:57 0:07:22 0:09:35 smithi main centos 9.stream rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7911032 2024-09-18 09:19:50 2024-09-18 12:06:36 2024-09-18 14:56:44 2:50:08 2:39:31 0:10:37 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} 1
pass 7911033 2024-09-18 09:19:52 2024-09-18 12:06:36 2024-09-18 12:30:07 0:23:31 0:10:24 0:13:07 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7911034 2024-09-18 09:19:53 2024-09-18 12:08:47 2024-09-18 12:50:54 0:42:07 0:32:28 0:09:39 smithi main ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911035 2024-09-18 09:19:54 2024-09-18 12:08:57 2024-09-18 12:41:44 0:32:47 0:20:49 0:11:58 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
fail 7911036 2024-09-18 09:19:55 2024-09-18 12:09:28 2024-09-18 13:32:00 1:22:32 1:10:29 0:12:03 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

saw valgrind issues

pass 7911037 2024-09-18 09:19:57 2024-09-18 12:10:08 2024-09-18 12:37:48 0:27:40 0:19:02 0:08:38 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli} 1
pass 7911038 2024-09-18 09:19:58 2024-09-18 12:10:09 2024-09-18 12:47:08 0:36:59 0:27:54 0:09:05 smithi main centos 9.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_mon_workunits} 2
pass 7911039 2024-09-18 09:20:00 2024-09-18 12:10:09 2024-09-18 12:30:49 0:20:40 0:10:37 0:10:03 smithi main centos 9.stream rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
pass 7911040 2024-09-18 09:20:01 2024-09-18 12:10:09 2024-09-18 12:31:41 0:21:32 0:10:45 0:10:47 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911041 2024-09-18 09:20:02 2024-09-18 12:10:10 2024-09-18 12:32:14 0:22:04 0:12:26 0:09:38 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7911042 2024-09-18 09:20:03 2024-09-18 12:10:10 2024-09-18 12:46:39 0:36:29 0:23:06 0:13:23 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_orch_cli_mon} 5
fail 7911043 2024-09-18 09:20:05 2024-09-18 12:13:11 2024-09-18 15:16:19 3:03:08 2:34:20 0:28:48 smithi main ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed on smithi157 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-bluestore 20" ceph_test_objectstore --gtest_filter=*/2:-*SyntheticMatrixC* --gtest_catch_exceptions=0\''

pass 7911044 2024-09-18 09:20:06 2024-09-18 12:13:31 2024-09-18 12:55:36 0:42:05 0:28:23 0:13:42 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7911045 2024-09-18 09:20:08 2024-09-18 12:37:11 2024-09-18 13:10:16 0:33:05 0:21:10 0:11:55 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 7911046 2024-09-18 09:20:09 2024-09-18 12:38:02 2024-09-18 13:00:12 0:22:10 0:09:27 0:12:43 smithi main centos 9.stream rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
pass 7911047 2024-09-18 09:20:10 2024-09-18 13:19:29 2024-09-18 13:49:29 0:30:00 0:19:12 0:10:48 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7911048 2024-09-18 09:20:12 2024-09-18 13:19:40 2024-09-18 14:00:32 0:40:52 0:29:03 0:11:49 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
fail 7911049 2024-09-18 09:20:13 2024-09-18 13:20:40 2024-09-18 13:44:14 0:23:34 0:13:07 0:10:27 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7911050 2024-09-18 09:20:14 2024-09-18 13:21:11 2024-09-18 13:45:03 0:23:52 0:11:10 0:12:42 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{ubuntu_latest} mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/{1-install 2-ceph 3-mgrmodules 4-units/cli}} 2
pass 7911051 2024-09-18 09:20:16 2024-09-18 13:21:21 2024-09-18 13:43:11 0:21:50 0:09:42 0:12:08 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911052 2024-09-18 09:20:17 2024-09-18 13:21:21 2024-09-18 13:49:07 0:27:46 0:14:24 0:13:22 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
pass 7911053 2024-09-18 09:20:18 2024-09-18 13:21:32 2024-09-18 13:53:39 0:32:07 0:22:44 0:09:23 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} 2
pass 7911054 2024-09-18 09:20:20 2024-09-18 13:21:42 2024-09-18 14:13:57 0:52:15 0:39:18 0:12:57 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 7911055 2024-09-18 09:20:21 2024-09-18 13:24:33 2024-09-18 13:48:53 0:24:20 0:14:56 0:09:24 smithi main ubuntu 20.04 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911056 2024-09-18 09:20:22 2024-09-18 13:25:13 2024-09-18 13:46:38 0:21:25 0:11:58 0:09:27 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_rgw_multisite} 3
pass 7911057 2024-09-18 09:20:24 2024-09-18 13:25:34 2024-09-18 14:02:25 0:36:51 0:25:16 0:11:35 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7911058 2024-09-18 09:20:25 2024-09-18 13:27:24 2024-09-18 13:51:17 0:23:53 0:10:34 0:13:19 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911059 2024-09-18 09:20:26 2024-09-18 13:29:05 2024-09-18 14:06:36 0:37:31 0:25:56 0:11:35 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
fail 7911060 2024-09-18 09:20:27 2024-09-18 13:30:55 2024-09-18 13:44:15 0:13:20 0:03:45 0:09:35 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi187 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911061 2024-09-18 09:20:29 2024-09-18 13:31:16 2024-09-18 13:54:03 0:22:47 0:12:18 0:10:29 smithi main ubuntu 20.04 rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911062 2024-09-18 09:20:30 2024-09-18 13:32:16 2024-09-18 13:50:58 0:18:42 0:07:09 0:11:33 smithi main centos 9.stream rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} 3
pass 7911063 2024-09-18 09:20:31 2024-09-18 13:33:07 2024-09-18 13:54:51 0:21:44 0:12:25 0:09:19 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7911064 2024-09-18 09:20:33 2024-09-18 13:33:07 2024-09-18 13:57:48 0:24:41 0:10:32 0:14:09 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7911065 2024-09-18 09:20:34 2024-09-18 13:36:48 2024-09-18 16:20:00 2:43:12 2:31:56 0:11:16 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} 1
pass 7911066 2024-09-18 09:20:35 2024-09-18 13:39:09 2024-09-18 14:00:17 0:21:08 0:11:27 0:09:41 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
pass 7911067 2024-09-18 09:20:37 2024-09-18 13:39:09 2024-09-18 14:05:22 0:26:13 0:15:33 0:10:40 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
pass 7911068 2024-09-18 09:20:38 2024-09-18 13:40:09 2024-09-18 14:03:23 0:23:14 0:10:47 0:12:27 smithi main centos 9.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_latest}} 1
pass 7911069 2024-09-18 09:20:39 2024-09-18 13:42:00 2024-09-18 14:16:29 0:34:29 0:23:38 0:10:51 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 7911070 2024-09-18 09:20:41 2024-09-18 13:43:31 2024-09-18 14:20:46 0:37:15 0:27:41 0:09:34 smithi main centos 9.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/snaps-few-objects} 2
pass 7911071 2024-09-18 09:20:42 2024-09-18 13:43:41 2024-09-18 14:09:27 0:25:46 0:14:53 0:10:53 smithi main centos 9.stream rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} 1
pass 7911072 2024-09-18 09:20:43 2024-09-18 13:43:41 2024-09-18 17:00:56 3:17:15 2:40:26 0:36:49 smithi main centos 9.stream rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_latest}} 1
pass 7911073 2024-09-18 09:20:45 2024-09-18 13:43:42 2024-09-18 14:16:38 0:32:56 0:21:21 0:11:35 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_set_mon_crush_locations} 3
pass 7911074 2024-09-18 09:20:46 2024-09-18 13:44:32 2024-09-18 14:42:51 0:58:19 0:46:09 0:12:10 smithi main ubuntu 20.04 rados/thrash-old-clients/{0-distro$/{ubuntu_20.04} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
pass 7911075 2024-09-18 09:20:47 2024-09-18 13:45:13 2024-09-18 14:05:23 0:20:10 0:08:38 0:11:32 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/{1-install 2-ceph 3-mgrmodules 4-units/crash}} 2
pass 7911076 2024-09-18 09:20:49 2024-09-18 13:46:23 2024-09-18 14:09:08 0:22:45 0:10:44 0:12:01 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7911077 2024-09-18 09:20:50 2024-09-18 13:46:54 2024-09-18 14:22:45 0:35:51 0:25:17 0:10:34 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} 2
pass 7911078 2024-09-18 09:20:51 2024-09-18 13:47:44 2024-09-18 14:22:40 0:34:56 0:23:26 0:11:30 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 7911079 2024-09-18 09:20:53 2024-09-18 13:48:35 2024-09-18 14:11:35 0:23:00 0:13:09 0:09:51 smithi main centos 9.stream rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
pass 7911080 2024-09-18 09:20:54 2024-09-18 13:48:35 2024-09-18 14:39:12 0:50:37 0:40:07 0:10:30 smithi main ubuntu 20.04 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
fail 7911081 2024-09-18 09:20:55 2024-09-18 13:49:15 2024-09-18 14:05:51 0:16:36 0:03:54 0:12:42 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Command failed on smithi049 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911082 2024-09-18 09:20:57 2024-09-18 13:49:26 2024-09-18 14:22:45 0:33:19 0:23:25 0:09:54 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7911083 2024-09-18 09:20:58 2024-09-18 13:49:46 2024-09-18 14:10:35 0:20:49 0:10:09 0:10:40 smithi main ubuntu 20.04 rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} 1
pass 7911084 2024-09-18 09:20:59 2024-09-18 13:50:27 2024-09-18 14:13:55 0:23:28 0:12:34 0:10:54 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7911085 2024-09-18 09:21:00 2024-09-18 13:50:47 2024-09-18 14:21:57 0:31:10 0:18:54 0:12:16 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 2
pass 7911086 2024-09-18 09:21:02 2024-09-18 13:51:08 2024-09-18 14:13:10 0:22:02 0:13:02 0:09:00 smithi main ubuntu 20.04 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911087 2024-09-18 09:21:03 2024-09-18 13:51:18 2024-09-18 14:15:37 0:24:19 0:12:40 0:11:39 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7911088 2024-09-18 09:21:04 2024-09-18 13:51:29 2024-09-18 14:25:30 0:34:01 0:24:01 0:10:00 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7911089 2024-09-18 09:21:06 2024-09-18 13:52:49 2024-09-18 14:12:23 0:19:34 0:10:42 0:08:52 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_ca_signed_key} 2
pass 7911090 2024-09-18 09:21:07 2024-09-18 13:53:19 2024-09-18 14:21:55 0:28:36 0:18:17 0:10:19 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7911091 2024-09-18 09:21:08 2024-09-18 13:54:00 2024-09-18 14:15:00 0:21:00 0:11:04 0:09:56 smithi main ubuntu 20.04 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 7911092 2024-09-18 09:21:09 2024-09-18 13:55:00 2024-09-18 14:17:55 0:22:55 0:09:04 0:13:51 smithi main ubuntu 20.04 rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911093 2024-09-18 09:21:11 2024-09-18 13:58:01 2024-09-18 14:24:55 0:26:54 0:17:21 0:09:33 smithi main centos 9.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
fail 7911094 2024-09-18 09:21:12 2024-09-18 13:58:01 2024-09-18 14:10:46 0:12:45 0:03:58 0:08:47 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi044 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911095 2024-09-18 09:21:13 2024-09-18 13:58:02 2024-09-18 14:19:52 0:21:50 0:09:45 0:12:05 smithi main centos 9.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7911096 2024-09-18 09:21:15 2024-09-18 14:00:43 2024-09-18 14:42:49 0:42:06 0:31:31 0:10:35 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7911097 2024-09-18 09:21:16 2024-09-18 14:01:43 2024-09-18 14:22:14 0:20:31 0:09:42 0:10:49 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr distro/{centos_latest} mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/{1-install 2-ceph 3-mgrmodules 4-units/devicehealth}} 2
pass 7911098 2024-09-18 09:21:17 2024-09-18 14:02:44 2024-09-18 16:49:00 2:46:16 2:36:24 0:09:52 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
fail 7911099 2024-09-18 09:21:19 2024-09-18 14:02:44 2024-09-18 14:33:45 0:31:01 0:21:07 0:09:54 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

saw valgrind issues

fail 7911100 2024-09-18 09:21:20 2024-09-18 14:02:44 2024-09-18 14:28:13 0:25:29 0:14:48 0:10:41 smithi main centos 9.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} 2
Failure Reason:

"1726669200.0002239 mon.a (mon.0) 236 : cluster [WRN] overall HEALTH_WARN 1 pool(s) do not have an application enabled" in cluster log

pass 7911101 2024-09-18 09:21:21 2024-09-18 14:03:15 2024-09-18 14:28:34 0:25:19 0:14:58 0:10:21 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} 2
pass 7911102 2024-09-18 09:21:23 2024-09-18 14:04:35 2024-09-18 14:31:10 0:26:35 0:16:28 0:10:07 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 7911103 2024-09-18 09:21:24 2024-09-18 14:04:46 2024-09-18 14:41:42 0:36:56 0:27:09 0:09:47 smithi main centos 9.stream rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_latest}} 1
fail 7911104 2024-09-18 09:21:25 2024-09-18 14:04:46 2024-09-18 14:18:20 0:13:34 0:03:54 0:09:40 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi002 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

pass 7911105 2024-09-18 09:21:26 2024-09-18 14:05:36 2024-09-18 14:33:42 0:28:06 0:17:11 0:10:55 smithi main ubuntu 20.04 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 7911106 2024-09-18 09:21:28 2024-09-18 14:25:33 597 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7911107 2024-09-18 09:21:29 2024-09-18 14:06:07 2024-09-18 14:43:21 0:37:14 0:24:00 0:13:14 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 7911108 2024-09-18 09:21:30 2024-09-18 14:06:58 2024-09-18 14:24:37 0:17:39 0:07:01 0:10:38 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi116 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'