Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7356854 2023-07-29 14:03:54 2023-07-29 15:53:30 2023-07-29 16:24:17 0:30:47 0:22:27 0:08:20 smithi main centos 8.stream rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 7356855 2023-07-29 14:03:55 2023-07-29 15:53:31 2023-07-29 16:19:27 0:25:56 0:14:36 0:11:20 smithi main ubuntu 22.04 rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{ubuntu_latest}} 1
pass 7356856 2023-07-29 14:03:56 2023-07-29 15:53:41 2023-07-29 16:27:09 0:33:28 0:27:33 0:05:55 smithi main rhel 8.6 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 7356857 2023-07-29 14:03:56 2023-07-29 15:53:42 2023-07-29 18:21:59 2:28:17 2:17:54 0:10:23 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

"2023-07-29T17:20:07.472309+0000 mon.a (mon.0) 630 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7356858 2023-07-29 14:03:57 2023-07-29 15:54:22 2023-07-29 16:22:01 0:27:39 0:18:42 0:08:57 smithi main ubuntu 22.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7356859 2023-07-29 14:03:58 2023-07-29 15:54:22 2023-07-29 16:42:19 0:47:57 0:37:41 0:10:16 smithi main ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_20.04}} 1
pass 7356860 2023-07-29 14:03:59 2023-07-29 15:54:23 2023-07-29 16:25:00 0:30:37 0:19:00 0:11:37 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7356861 2023-07-29 14:04:00 2023-07-29 15:55:03 2023-07-29 16:36:20 0:41:17 0:31:45 0:09:32 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7356862 2023-07-29 14:04:01 2023-07-29 15:55:04 2023-07-29 16:43:55 0:48:51 0:39:29 0:09:22 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
pass 7356863 2023-07-29 14:04:02 2023-07-29 15:55:04 2023-07-29 16:35:15 0:40:11 0:30:12 0:09:59 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_20.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7356864 2023-07-29 14:04:03 2023-07-29 15:55:04 2023-07-29 16:46:32 0:51:28 0:27:02 0:24:26 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} 5
fail 7356865 2023-07-29 14:04:04 2023-07-29 16:00:56 2023-07-29 17:14:45 1:13:49 0:59:47 0:14:02 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

"2023-07-29T16:42:06.378207+0000 osd.2 (osd.2) 23 : cluster [WRN] osd.2 ep: 275 scrubber::ReplicaReservations pg[105.8]: timeout on replica reservations (since 2023-07-29 16:42:01)" in cluster log

fail 7356866 2023-07-29 14:04:05 2023-07-29 16:03:37 2023-07-29 16:45:27 0:41:50 0:28:31 0:13:19 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7356867 2023-07-29 14:04:06 2023-07-29 16:04:17 2023-07-29 18:40:32 2:36:15 2:24:28 0:11:47 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
fail 7356868 2023-07-29 14:04:07 2023-07-29 16:04:58 2023-07-29 16:41:54 0:36:56 0:27:12 0:09:44 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

saw valgrind issues

fail 7356869 2023-07-29 14:04:08 2023-07-29 16:04:58 2023-07-29 17:01:33 0:56:35 0:44:20 0:12:15 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

saw valgrind issues

fail 7356870 2023-07-29 14:04:09 2023-07-29 16:05:49 2023-07-29 18:28:10 2:22:21 2:12:02 0:10:19 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

"2023-07-29T16:43:14.377137+0000 mon.a (mon.0) 337 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 7356871 2023-07-29 14:04:10 2023-07-29 16:06:19 2023-07-29 16:35:18 0:28:59 0:17:47 0:11:12 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 7356872 2023-07-29 14:04:11 2023-07-29 16:06:20 2023-07-29 16:30:50 0:24:30 0:12:34 0:11:56 smithi main centos 8.stream rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
fail 7356873 2023-07-29 14:04:12 2023-07-29 16:08:00 2023-07-29 16:34:56 0:26:56 0:21:05 0:05:51 smithi main rhel 8.6 rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC msg=audit(1690648363.682:20755): avc: denied { ioctl } for pid=112670 comm="iptables" path="/var/lib/containers/storage/overlay/178f4b016453094aff489d327e78b0c7725e867bd9652e2d34592de1a988a580/merged" dev="overlay" ino=3408552 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1690648363.724:20756): avc: denied { ioctl } for pid=112674 comm="iptables" path="/var/lib/containers/storage/overlay/178f4b016453094aff489d327e78b0c7725e867bd9652e2d34592de1a988a580/merged" dev="overlay" ino=3408552 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7356874 2023-07-29 14:04:13 2023-07-29 16:08:01 2023-07-29 18:54:06 2:46:05 2:34:09 0:11:56 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} 1
fail 7356875 2023-07-29 14:04:14 2023-07-29 16:08:01 2023-07-29 16:52:30 0:44:29 0:31:50 0:12:39 smithi main centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

fail 7356876 2023-07-29 14:04:15 2023-07-29 16:09:12 2023-07-29 16:32:04 0:22:52 0:12:48 0:10:04 smithi main centos 9.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

fail 7356877 2023-07-29 14:04:16 2023-07-29 16:09:12 2023-07-29 22:47:22 6:38:10 6:25:38 0:12:32 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi072 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 7356878 2023-07-29 14:04:17 2023-07-29 16:10:03 2023-07-29 19:02:52 2:52:49 2:41:17 0:11:32 smithi main ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_20.04} workloads/osd} 1
pass 7356879 2023-07-29 14:04:18 2023-07-29 16:11:03 2023-07-29 16:58:44 0:47:41 0:34:37 0:13:04 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
pass 7356880 2023-07-29 14:04:19 2023-07-29 16:13:24 2023-07-29 16:44:54 0:31:30 0:20:34 0:10:56 smithi main centos 9.stream rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} 2
pass 7356881 2023-07-29 14:04:20 2023-07-29 16:14:04 2023-07-29 16:55:06 0:41:02 0:30:48 0:10:14 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_nfs} 1
pass 7356882 2023-07-29 14:04:21 2023-07-29 16:14:25 2023-07-29 16:49:20 0:34:55 0:29:20 0:05:35 smithi main rhel 8.6 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1