User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2024-03-14 15:48:00 | 2024-03-14 23:43:35 | 2024-03-15 15:32:50 | 15:49:15 | rados | wip-yuri2-testing-2024-03-13-0827 | smithi | 8fb72a1 | 231 | 54 | 9 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 7600545 | 2024-03-14 15:49:20 | 2024-03-14 23:43:32 | 2024-03-15 00:11:35 | 0:28:03 | 0:18:01 | 0:10:02 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} | 2 | |
pass | 7600546 | 2024-03-14 15:49:21 | 2024-03-14 23:43:33 | 2024-03-15 00:07:06 | 0:23:33 | 0:11:38 | 0:11:55 | smithi | main | centos | 9.stream | rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery} | 2 | |
pass | 7600547 | 2024-03-14 15:49:21 | 2024-03-14 23:43:33 | 2024-03-15 00:22:13 | 0:38:40 | 0:28:29 | 0:10:11 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 3 | |
pass | 7600548 | 2024-03-14 15:49:22 | 2024-03-14 23:43:34 | 2024-03-15 00:12:56 | 0:29:22 | 0:19:40 | 0:09:42 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600549 | 2024-03-14 15:49:23 | 2024-03-14 23:43:34 | 2024-03-15 00:09:05 | 0:25:31 | 0:15:43 | 0:09:48 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7600550 | 2024-03-14 15:49:23 | 2024-03-14 23:43:34 | 2024-03-15 00:05:03 | 0:21:29 | 0:11:49 | 0:09:40 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600551 | 2024-03-14 15:49:24 | 2024-03-14 23:43:35 | 2024-03-15 00:00:28 | 0:16:53 | 0:07:06 | 0:09:47 | smithi | main | centos | 9.stream | rados/objectstore/{backends/objectstore-memstore supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600552 | 2024-03-14 15:49:25 | 2024-03-14 23:43:35 | 2024-03-15 00:15:09 | 0:31:34 | 0:22:26 | 0:09:08 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} | 2 | |
fail | 7600553 | 2024-03-14 15:49:26 | 2024-03-14 23:43:35 | 2024-03-15 00:17:23 | 0:33:48 | 0:23:39 | 0:10:09 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} | 3 | |
Failure Reason:
"2024-03-15T00:04:54.715997+0000 mon.a (mon.0) 194 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7600554 | 2024-03-14 15:49:26 | 2024-03-14 23:43:56 | 2024-03-15 00:07:21 | 0:23:25 | 0:13:30 | 0:09:55 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-15T00:05:01.121378+0000 mon.smithi107 (mon.0) 781 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600555 | 2024-03-14 15:49:27 | 2024-03-14 23:44:16 | 2024-03-15 00:13:23 | 0:29:07 | 0:17:16 | 0:11:51 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 7600556 | 2024-03-14 15:49:28 | 2024-03-14 23:44:27 | 2024-03-15 00:14:17 | 0:29:50 | 0:12:19 | 0:17:31 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} | 2 | |
fail | 7600557 | 2024-03-14 15:49:29 | 2024-03-14 23:51:18 | 2024-03-15 00:30:08 | 0:38:50 | 0:27:25 | 0:11:25 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
Failure Reason:
"2024-03-15T00:15:37.602176+0000 osd.1 (osd.1) 17 : cluster [ERR] osd.1 pg[3.8s1]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600558 | 2024-03-14 15:49:29 | 2024-03-14 23:51:28 | 2024-03-15 00:16:05 | 0:24:37 | 0:14:52 | 0:09:45 | smithi | main | centos | 9.stream | rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600559 | 2024-03-14 15:49:30 | 2024-03-14 23:51:29 | 2024-03-15 00:26:43 | 0:35:14 | 0:12:47 | 0:22:27 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/libcephsqlite} | 2 | |
fail | 7600560 | 2024-03-14 15:49:31 | 2024-03-14 23:58:00 | 2024-03-15 01:53:45 | 1:55:45 | 1:45:28 | 0:10:17 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} | 2 | |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
pass | 7600561 | 2024-03-14 15:49:32 | 2024-03-14 23:58:00 | 2024-03-15 00:21:33 | 0:23:33 | 0:13:25 | 0:10:08 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} | 1 | |
pass | 7600562 | 2024-03-14 15:49:32 | 2024-03-14 23:58:01 | 2024-03-15 00:33:30 | 0:35:29 | 0:25:48 | 0:09:41 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
pass | 7600563 | 2024-03-14 15:49:33 | 2024-03-14 23:58:01 | 2024-03-15 00:30:40 | 0:32:39 | 0:22:49 | 0:09:50 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600564 | 2024-03-14 15:49:34 | 2024-03-14 23:58:01 | 2024-03-15 00:21:45 | 0:23:44 | 0:13:36 | 0:10:08 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
fail | 7600565 | 2024-03-14 15:49:35 | 2024-03-14 23:58:02 | 2024-03-15 01:43:02 | 1:45:00 | 1:35:49 | 0:09:11 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} | 1 | |
Failure Reason:
Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fb72a1057818c8e23ab8db51bece79404afc7d7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh' |
||||||||||||||
fail | 7600566 | 2024-03-14 15:49:35 | 2024-03-14 23:58:02 | 2024-03-15 00:19:37 | 0:21:35 | 0:11:04 | 0:10:31 | smithi | main | ubuntu | 22.04 | rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} | 2 | |
Failure Reason:
Command failed on smithi003 with status 5: 'sudo systemctl stop ceph-316de02e-e261-11ee-95c9-87774f69a715@mon.a' |
||||||||||||||
pass | 7600567 | 2024-03-14 15:49:36 | 2024-03-14 23:58:02 | 2024-03-15 00:21:27 | 0:23:25 | 0:11:30 | 0:11:55 | smithi | main | ubuntu | 22.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits} | 2 | |
pass | 7600568 | 2024-03-14 15:49:37 | 2024-03-14 23:58:03 | 2024-03-15 00:43:37 | 0:45:34 | 0:36:08 | 0:09:26 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600569 | 2024-03-14 15:49:38 | 2024-03-14 23:58:03 | 2024-03-15 00:50:54 | 0:52:51 | 0:42:29 | 0:10:22 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 | |
Failure Reason:
"2024-03-15T00:25:41.319064+0000 osd.3 (osd.3) 37 : cluster [ERR] osd.3 pg[1.es2]: reservation requested while still reserved" in cluster log |
||||||||||||||
fail | 7600570 | 2024-03-14 15:49:38 | 2024-03-14 23:58:04 | 2024-03-15 04:34:06 | 4:36:02 | 4:25:33 | 0:10:29 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi045 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fb72a1057818c8e23ab8db51bece79404afc7d7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
pass | 7600571 | 2024-03-14 15:49:39 | 2024-03-14 23:58:04 | 2024-03-15 00:18:52 | 0:20:48 | 0:10:25 | 0:10:23 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600572 | 2024-03-14 15:49:40 | 2024-03-14 23:58:04 | 2024-03-15 00:40:28 | 0:42:24 | 0:31:42 | 0:10:42 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} | 2 | |
pass | 7600573 | 2024-03-14 15:49:41 | 2024-03-14 23:58:05 | 2024-03-15 00:18:57 | 0:20:52 | 0:10:16 | 0:10:36 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600574 | 2024-03-14 15:49:41 | 2024-03-14 23:58:05 | 2024-03-15 00:49:44 | 0:51:39 | 0:41:33 | 0:10:06 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} | 2 | |
Failure Reason:
"2024-03-15T00:23:54.933181+0000 osd.3 (osd.3) 146 : cluster [ERR] osd.3 pg[7.1]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600575 | 2024-03-14 15:49:42 | 2024-03-14 23:58:05 | 2024-03-15 00:25:36 | 0:27:31 | 0:08:20 | 0:19:11 | smithi | main | centos | 9.stream | rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} | 3 | |
pass | 7600576 | 2024-03-14 15:49:43 | 2024-03-15 00:00:36 | 2024-03-15 00:44:57 | 0:44:21 | 0:25:51 | 0:18:30 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
fail | 7600577 | 2024-03-14 15:49:44 | 2024-03-15 00:09:08 | 2024-03-15 00:32:47 | 0:23:39 | 0:12:20 | 0:11:19 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} | 1 | |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi118 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fb72a1057818c8e23ab8db51bece79404afc7d7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
pass | 7600578 | 2024-03-14 15:49:44 | 2024-03-15 00:09:09 | 2024-03-15 00:32:20 | 0:23:11 | 0:10:51 | 0:12:20 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600579 | 2024-03-14 15:49:45 | 2024-03-15 00:11:39 | 2024-03-15 00:53:19 | 0:41:40 | 0:30:39 | 0:11:01 | smithi | main | centos | 9.stream | rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600580 | 2024-03-14 15:49:46 | 2024-03-15 00:11:40 | 2024-03-15 01:40:54 | 1:29:14 | 1:18:21 | 0:10:53 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} | 2 | |
pass | 7600581 | 2024-03-14 15:49:47 | 2024-03-15 00:13:20 | 2024-03-15 00:36:48 | 0:23:28 | 0:13:20 | 0:10:08 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} | 1 | |
pass | 7600582 | 2024-03-14 15:49:47 | 2024-03-15 00:13:21 | 2024-03-15 01:06:35 | 0:53:14 | 0:41:55 | 0:11:19 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} | 2 | |
pass | 7600583 | 2024-03-14 15:49:48 | 2024-03-15 00:13:21 | 2024-03-15 01:04:17 | 0:50:56 | 0:41:42 | 0:09:14 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 2 | |
pass | 7600584 | 2024-03-14 15:49:49 | 2024-03-15 00:13:21 | 2024-03-15 00:34:57 | 0:21:36 | 0:11:33 | 0:10:03 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600585 | 2024-03-14 15:49:50 | 2024-03-15 00:13:22 | 2024-03-15 00:52:14 | 0:38:52 | 0:30:34 | 0:08:18 | smithi | main | centos | 9.stream | rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600586 | 2024-03-14 15:49:50 | 2024-03-15 00:13:22 | 2024-03-15 00:38:59 | 0:25:37 | 0:15:49 | 0:09:48 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} | 2 | |
pass | 7600587 | 2024-03-14 15:49:51 | 2024-03-15 00:13:23 | 2024-03-15 00:49:10 | 0:35:47 | 0:25:16 | 0:10:31 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600588 | 2024-03-14 15:49:52 | 2024-03-15 00:13:23 | 2024-03-15 00:52:16 | 0:38:53 | 0:26:44 | 0:12:09 | smithi | main | centos | 9.stream | rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} | 1 | |
fail | 7600589 | 2024-03-14 15:49:53 | 2024-03-15 00:13:23 | 2024-03-15 01:00:12 | 0:46:49 | 0:35:06 | 0:11:43 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} | 3 | |
Failure Reason:
"2024-03-15T00:50:00.000162+0000 mon.a (mon.0) 1767 : cluster [WRN] Health detail: HEALTH_WARN nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 296/2160 objects degraded (13.704%), 5 pgs degraded" in cluster log |
||||||||||||||
fail | 7600590 | 2024-03-14 15:49:53 | 2024-03-15 00:15:14 | 2024-03-15 00:39:05 | 0:23:51 | 0:13:39 | 0:10:12 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |
Failure Reason:
"2024-03-15T00:36:05.256994+0000 mon.smithi012 (mon.0) 786 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600591 | 2024-03-14 15:49:54 | 2024-03-15 00:16:14 | 2024-03-15 01:44:00 | 1:27:46 | 1:13:45 | 0:14:01 | smithi | main | centos | 9.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} | 2 | |
pass | 7600592 | 2024-03-14 15:49:55 | 2024-03-15 00:18:55 | 2024-03-15 00:38:07 | 0:19:12 | 0:10:20 | 0:08:52 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_latest} tasks/crash} | 2 | |
pass | 7600593 | 2024-03-14 15:49:56 | 2024-03-15 00:19:26 | 2024-03-15 01:08:48 | 0:49:22 | 0:38:32 | 0:10:50 | smithi | main | centos | 9.stream | rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600594 | 2024-03-14 15:49:56 | 2024-03-15 00:19:26 | 2024-03-15 00:40:49 | 0:21:23 | 0:09:50 | 0:11:33 | smithi | main | centos | 9.stream | rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} | 1 | |
dead | 7600595 | 2024-03-14 15:49:57 | 2024-03-15 00:21:37 | 2024-03-15 12:31:28 | 12:09:51 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7600596 | 2024-03-14 15:49:58 | 2024-03-15 00:21:37 | 2024-03-15 00:48:10 | 0:26:33 | 0:15:34 | 0:10:59 | smithi | main | ubuntu | 22.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} | 1 | |
fail | 7600597 | 2024-03-14 15:49:59 | 2024-03-15 00:21:37 | 2024-03-15 02:29:37 | 2:08:00 | 1:57:37 | 0:10:23 | smithi | main | ubuntu | 22.04 | rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |
Failure Reason:
"2024-03-15T00:43:16.068699+0000 mon.a (mon.0) 176 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
pass | 7600598 | 2024-03-14 15:49:59 | 2024-03-15 00:21:48 | 2024-03-15 00:50:47 | 0:28:59 | 0:20:47 | 0:08:12 | smithi | main | centos | 9.stream | rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} | 1 | |
dead | 7600599 | 2024-03-14 15:50:00 | 2024-03-15 00:21:48 | 2024-03-15 00:41:10 | 0:19:22 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} | 2 | |||
Failure Reason:
Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds |
||||||||||||||
pass | 7600600 | 2024-03-14 15:50:01 | 2024-03-15 00:22:19 | 2024-03-15 00:47:38 | 0:25:19 | 0:14:50 | 0:10:29 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} | 2 | |
pass | 7600601 | 2024-03-14 15:50:02 | 2024-03-15 00:22:19 | 2024-03-15 00:49:49 | 0:27:30 | 0:13:49 | 0:13:41 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 7600602 | 2024-03-14 15:50:02 | 2024-03-15 00:25:40 | 2024-03-15 00:43:49 | 0:18:09 | 0:07:40 | 0:10:29 | smithi | main | centos | 9.stream | rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600603 | 2024-03-14 15:50:03 | 2024-03-15 00:26:50 | 2024-03-15 00:52:38 | 0:25:48 | 0:10:40 | 0:15:08 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 7600604 | 2024-03-14 15:50:04 | 2024-03-15 00:28:41 | 2024-03-15 00:50:44 | 0:22:03 | 0:12:10 | 0:09:53 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600605 | 2024-03-14 15:50:05 | 2024-03-15 00:28:41 | 2024-03-15 00:54:57 | 0:26:16 | 0:14:55 | 0:11:21 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-15T00:50:08.687169+0000 mon.a (mon.0) 647 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7600606 | 2024-03-14 15:50:05 | 2024-03-15 00:28:42 | 2024-03-15 00:52:23 | 0:23:41 | 0:13:47 | 0:09:54 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} | 1 | |
pass | 7600607 | 2024-03-14 15:50:06 | 2024-03-15 00:28:42 | 2024-03-15 01:14:12 | 0:45:30 | 0:35:12 | 0:10:18 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} | 2 | |
pass | 7600608 | 2024-03-14 15:50:07 | 2024-03-15 00:28:42 | 2024-03-15 00:49:35 | 0:20:53 | 0:11:29 | 0:09:24 | smithi | main | centos | 9.stream | rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600609 | 2024-03-14 15:50:08 | 2024-03-15 00:28:43 | 2024-03-15 01:00:40 | 0:31:57 | 0:21:34 | 0:10:23 | smithi | main | ubuntu | 22.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} | 2 | |
pass | 7600610 | 2024-03-14 15:50:08 | 2024-03-15 00:28:43 | 2024-03-15 00:54:29 | 0:25:46 | 0:16:17 | 0:09:29 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 7600611 | 2024-03-14 15:50:09 | 2024-03-15 00:28:43 | 2024-03-15 00:53:08 | 0:24:25 | 0:10:12 | 0:14:13 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} | 3 | |
pass | 7600612 | 2024-03-14 15:50:10 | 2024-03-15 00:33:35 | 2024-03-15 01:00:01 | 0:26:26 | 0:11:17 | 0:15:09 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 7600613 | 2024-03-14 15:50:11 | 2024-03-15 00:36:55 | 2024-03-15 00:59:51 | 0:22:56 | 0:11:29 | 0:11:27 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600614 | 2024-03-14 15:50:11 | 2024-03-15 00:38:16 | 2024-03-15 01:10:45 | 0:32:29 | 0:22:43 | 0:09:46 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} | 2 | |
pass | 7600615 | 2024-03-14 15:50:12 | 2024-03-15 00:39:06 | 2024-03-15 01:02:51 | 0:23:45 | 0:14:43 | 0:09:02 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600616 | 2024-03-14 15:50:13 | 2024-03-15 00:39:07 | 2024-03-15 01:12:23 | 0:33:16 | 0:21:34 | 0:11:42 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} | 2 | |
fail | 7600617 | 2024-03-14 15:50:14 | 2024-03-15 00:40:37 | 2024-03-15 01:04:01 | 0:23:24 | 0:11:44 | 0:11:40 | smithi | main | centos | 9.stream | rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} | 1 | |
Failure Reason:
"2024-03-15T00:58:03.924126+0000 mon.smithi149 (mon.0) 238 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600618 | 2024-03-14 15:50:14 | 2024-03-15 00:40:58 | 2024-03-15 01:03:06 | 0:22:08 | 0:11:15 | 0:10:53 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600619 | 2024-03-14 15:50:15 | 2024-03-15 00:41:28 | 2024-03-15 01:22:15 | 0:40:47 | 0:27:42 | 0:13:05 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} | 2 | |
pass | 7600620 | 2024-03-14 15:50:16 | 2024-03-15 00:43:39 | 2024-03-15 01:15:40 | 0:32:01 | 0:21:49 | 0:10:12 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-localized} | 2 | |
pass | 7600621 | 2024-03-14 15:50:17 | 2024-03-15 00:43:59 | 2024-03-15 01:07:25 | 0:23:26 | 0:13:00 | 0:10:26 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600622 | 2024-03-14 15:50:17 | 2024-03-15 00:44:00 | 2024-03-15 01:21:24 | 0:37:24 | 0:26:41 | 0:10:43 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600623 | 2024-03-14 15:50:18 | 2024-03-15 00:44:00 | 2024-03-15 01:10:25 | 0:26:25 | 0:15:18 | 0:11:07 | smithi | main | ubuntu | 22.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/failover} | 2 | |
pass | 7600624 | 2024-03-14 15:50:19 | 2024-03-15 00:44:00 | 2024-03-15 01:12:23 | 0:28:23 | 0:19:50 | 0:08:33 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush} | 1 | |
pass | 7600625 | 2024-03-14 15:50:20 | 2024-03-15 00:44:01 | 2024-03-15 01:07:28 | 0:23:27 | 0:13:42 | 0:09:45 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} | 1 | |
pass | 7600626 | 2024-03-14 15:50:20 | 2024-03-15 00:44:01 | 2024-03-15 01:07:34 | 0:23:33 | 0:09:33 | 0:14:00 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600627 | 2024-03-14 15:50:21 | 2024-03-15 00:47:42 | 2024-03-15 01:04:41 | 0:16:59 | 0:06:06 | 0:10:53 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} | 1 | |
pass | 7600628 | 2024-03-14 15:50:22 | 2024-03-15 00:47:42 | 2024-03-15 01:23:43 | 0:36:01 | 0:23:24 | 0:12:37 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} | 2 | |
fail | 7600629 | 2024-03-14 15:50:23 | 2024-03-15 00:49:13 | 2024-03-15 02:15:33 | 1:26:20 | 1:15:15 | 0:11:05 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} | 3 | |
Failure Reason:
"2024-03-15T01:11:31.198321+0000 mon.a (mon.0) 191 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7600630 | 2024-03-14 15:50:23 | 2024-03-15 00:49:53 | 2024-03-15 02:05:22 | 1:15:29 | 1:02:46 | 0:12:43 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} | 2 | |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
pass | 7600631 | 2024-03-14 15:50:24 | 2024-03-15 00:49:54 | 2024-03-15 01:16:18 | 0:26:24 | 0:14:07 | 0:12:17 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_python} | 2 | |
pass | 7600632 | 2024-03-14 15:50:25 | 2024-03-15 00:50:54 | 2024-03-15 01:14:50 | 0:23:56 | 0:13:06 | 0:10:50 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600633 | 2024-03-14 15:50:26 | 2024-03-15 00:50:55 | 2024-03-15 01:17:34 | 0:26:39 | 0:13:46 | 0:12:53 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 7600634 | 2024-03-14 15:50:26 | 2024-03-15 00:52:45 | 2024-03-15 01:11:35 | 0:18:50 | 0:07:55 | 0:10:55 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600635 | 2024-03-14 15:50:27 | 2024-03-15 00:52:46 | 2024-03-15 01:36:24 | 0:43:38 | 0:31:43 | 0:11:55 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} | 2 | |
pass | 7600636 | 2024-03-14 15:50:28 | 2024-03-15 00:53:16 | 2024-03-15 01:18:47 | 0:25:31 | 0:15:59 | 0:09:32 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600637 | 2024-03-14 15:50:29 | 2024-03-15 00:53:16 | 2024-03-15 01:13:30 | 0:20:14 | 0:09:47 | 0:10:27 | smithi | main | ubuntu | 22.04 | rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600638 | 2024-03-14 15:50:30 | 2024-03-15 00:53:27 | 2024-03-15 01:22:37 | 0:29:10 | 0:17:36 | 0:11:34 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} | 2 | |
fail | 7600639 | 2024-03-14 15:50:30 | 2024-03-15 00:54:37 | 2024-03-15 01:29:05 | 0:34:28 | 0:19:43 | 0:14:45 | smithi | main | ubuntu | 22.04 | rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-15T01:25:19.954443+0000 mon.smithi070 (mon.0) 766 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600640 | 2024-03-14 15:50:31 | 2024-03-15 00:59:28 | 2024-03-15 01:36:33 | 0:37:05 | 0:25:33 | 0:11:32 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} | 2 | |
pass | 7600641 | 2024-03-14 15:50:32 | 2024-03-15 00:59:29 | 2024-03-15 01:20:54 | 0:21:25 | 0:11:15 | 0:10:10 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600642 | 2024-03-14 15:50:32 | 2024-03-15 00:59:29 | 2024-03-15 01:36:24 | 0:36:55 | 0:24:48 | 0:12:07 | smithi | main | centos | 9.stream | rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_recovery} | 3 | |
pass | 7600643 | 2024-03-14 15:50:33 | 2024-03-15 00:59:29 | 2024-03-15 01:39:10 | 0:39:41 | 0:29:43 | 0:09:58 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 3 | |
pass | 7600644 | 2024-03-14 15:50:34 | 2024-03-15 00:59:30 | 2024-03-15 01:24:21 | 0:24:51 | 0:14:00 | 0:10:51 | smithi | main | centos | 9.stream | rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600645 | 2024-03-14 15:50:35 | 2024-03-15 00:59:30 | 2024-03-15 01:23:02 | 0:23:32 | 0:13:55 | 0:09:37 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} | 1 | |
pass | 7600646 | 2024-03-14 15:50:36 | 2024-03-15 00:59:31 | 2024-03-15 01:40:47 | 0:41:16 | 0:29:09 | 0:12:07 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 | |
pass | 7600647 | 2024-03-14 15:50:36 | 2024-03-15 01:00:41 | 2024-03-15 01:22:36 | 0:21:55 | 0:09:51 | 0:12:04 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600648 | 2024-03-14 15:50:37 | 2024-03-15 01:02:52 | 2024-03-15 01:28:07 | 0:25:15 | 0:13:45 | 0:11:30 | smithi | main | ubuntu | 22.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/insights} | 2 | |
pass | 7600649 | 2024-03-14 15:50:38 | 2024-03-15 01:04:22 | 2024-03-15 01:30:01 | 0:25:39 | 0:14:30 | 0:11:09 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} | 2 | |
pass | 7600650 | 2024-03-14 15:50:39 | 2024-03-15 01:04:43 | 2024-03-15 01:36:38 | 0:31:55 | 0:19:20 | 0:12:35 | smithi | main | ubuntu | 22.04 | rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} | 2 | |
pass | 7600651 | 2024-03-14 15:50:39 | 2024-03-15 01:06:43 | 2024-03-15 01:46:31 | 0:39:48 | 0:29:35 | 0:10:13 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} | 2 | |
pass | 7600652 | 2024-03-14 15:50:40 | 2024-03-15 01:07:34 | 2024-03-15 01:37:28 | 0:29:54 | 0:19:02 | 0:10:52 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600653 | 2024-03-14 15:50:41 | 2024-03-15 01:07:34 | 2024-03-15 01:44:24 | 0:36:50 | 0:22:18 | 0:14:32 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} | 2 | |
Failure Reason:
"2024-03-15T01:31:36.190671+0000 osd.0 (osd.0) 11 : cluster [ERR] osd.0 pg[3.fs2]: reservation requested while still reserved" in cluster log |
||||||||||||||
fail | 7600654 | 2024-03-14 15:50:42 | 2024-03-15 01:10:35 | 2024-03-15 01:33:35 | 0:23:00 | 0:13:45 | 0:09:15 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} | 2 | |
Failure Reason:
"2024-03-15T01:31:08.432000+0000 osd.4 (osd.4) 52 : cluster [ERR] osd.4 pg[3.f]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600655 | 2024-03-14 15:50:42 | 2024-03-15 01:10:45 | 2024-03-15 02:58:13 | 1:47:28 | 1:36:26 | 0:11:02 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} | 1 | |
pass | 7600656 | 2024-03-14 15:50:43 | 2024-03-15 01:10:46 | 2024-03-15 01:47:22 | 0:36:36 | 0:23:46 | 0:12:50 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600657 | 2024-03-14 15:50:44 | 2024-03-15 01:12:26 | 2024-03-15 01:32:11 | 0:19:45 | 0:10:23 | 0:09:22 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600658 | 2024-03-14 15:50:45 | 2024-03-15 01:12:27 | 2024-03-15 01:55:55 | 0:43:28 | 0:33:30 | 0:09:58 | smithi | main | ubuntu | 22.04 | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600659 | 2024-03-14 15:50:46 | 2024-03-15 01:12:27 | 2024-03-15 01:42:30 | 0:30:03 | 0:18:54 | 0:11:09 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7600660 | 2024-03-14 15:50:46 | 2024-03-15 01:14:18 | 2024-03-15 01:43:19 | 0:29:01 | 0:18:58 | 0:10:03 | smithi | main | centos | 9.stream | rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600661 | 2024-03-14 15:50:47 | 2024-03-15 01:14:18 | 2024-03-15 01:45:59 | 0:31:41 | 0:21:09 | 0:10:32 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} | 2 | |
pass | 7600662 | 2024-03-14 15:50:48 | 2024-03-15 01:14:58 | 2024-03-15 01:41:30 | 0:26:32 | 0:14:06 | 0:12:26 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
dead | 7600663 | 2024-03-14 15:50:49 | 2024-03-15 01:15:49 | 2024-03-15 13:25:12 | 12:09:23 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
fail | 7600664 | 2024-03-14 15:50:49 | 2024-03-15 01:16:19 | 2024-03-15 01:53:29 | 0:37:10 | 0:25:41 | 0:11:29 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} | 3 | |
Failure Reason:
"2024-03-15T01:39:35.806492+0000 mon.a (mon.0) 187 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
pass | 7600665 | 2024-03-14 15:50:50 | 2024-03-15 01:17:40 | 2024-03-15 01:38:39 | 0:20:59 | 0:11:44 | 0:09:15 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600666 | 2024-03-14 15:50:51 | 2024-03-15 01:17:40 | 2024-03-15 01:41:34 | 0:23:54 | 0:14:11 | 0:09:43 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} | 1 | |
pass | 7600667 | 2024-03-14 15:50:52 | 2024-03-15 01:17:41 | 2024-03-15 01:49:52 | 0:32:11 | 0:15:13 | 0:16:58 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} | 2 | |
pass | 7600668 | 2024-03-14 15:50:52 | 2024-03-15 01:21:02 | 2024-03-15 01:45:10 | 0:24:08 | 0:12:46 | 0:11:22 | smithi | main | centos | 9.stream | rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} | 1 | |
fail | 7600669 | 2024-03-14 15:50:53 | 2024-03-15 01:21:32 | 2024-03-15 01:59:53 | 0:38:21 | 0:28:09 | 0:10:12 | smithi | main | centos | 9.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e} | 2 | |
Failure Reason:
"2024-03-15T01:58:03.040980+0000 mon.a (mon.0) 1141 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600670 | 2024-03-14 15:50:54 | 2024-03-15 01:22:22 | 2024-03-15 01:44:27 | 0:22:05 | 0:12:41 | 0:09:24 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} | 2 | |
dead | 7600671 | 2024-03-14 15:50:55 | 2024-03-15 01:22:43 | 2024-03-15 01:24:06 | 0:01:23 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi005 |
||||||||||||||
pass | 7600672 | 2024-03-14 15:50:55 | 2024-03-15 01:22:43 | 2024-03-15 01:40:08 | 0:17:25 | 0:08:29 | 0:08:56 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600673 | 2024-03-14 15:50:56 | 2024-03-15 01:23:04 | 2024-03-15 01:43:32 | 0:20:28 | 0:08:28 | 0:12:00 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_striper} | 2 | |
pass | 7600674 | 2024-03-14 15:50:57 | 2024-03-15 01:23:44 | 2024-03-15 01:45:32 | 0:21:48 | 0:10:53 | 0:10:55 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600675 | 2024-03-14 15:50:58 | 2024-03-15 01:24:15 | 2024-03-15 01:44:12 | 0:19:57 | 0:09:46 | 0:10:11 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} | 2 | |
pass | 7600676 | 2024-03-14 15:50:58 | 2024-03-15 01:24:25 | 2024-03-15 02:05:05 | 0:40:40 | 0:25:12 | 0:15:28 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
fail | 7600677 | 2024-03-14 15:50:59 | 2024-03-15 01:30:06 | 2024-03-15 01:57:21 | 0:27:15 | 0:16:10 | 0:11:05 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} | 3 | |
Failure Reason:
"2024-03-15T01:50:51.060411+0000 mon.a (mon.0) 427 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7600678 | 2024-03-14 15:51:00 | 2024-03-15 01:30:16 | 2024-03-15 02:11:49 | 0:41:33 | 0:24:54 | 0:16:39 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/module_selftest} | 2 | |
pass | 7600679 | 2024-03-14 15:51:01 | 2024-03-15 01:36:28 | 2024-03-15 02:08:09 | 0:31:41 | 0:21:47 | 0:09:54 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
pass | 7600680 | 2024-03-14 15:51:01 | 2024-03-15 01:36:28 | 2024-03-15 01:57:19 | 0:20:51 | 0:11:50 | 0:09:01 | smithi | main | centos | 9.stream | rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} | 1 | |
fail | 7600681 | 2024-03-14 15:51:02 | 2024-03-15 01:36:28 | 2024-03-15 01:53:28 | 0:17:00 | 0:08:10 | 0:08:50 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
Failure Reason:
Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' |
||||||||||||||
pass | 7600682 | 2024-03-14 15:51:03 | 2024-03-15 01:36:29 | 2024-03-15 02:04:04 | 0:27:35 | 0:17:53 | 0:09:42 | smithi | main | ubuntu | 22.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} | 1 | |
pass | 7600683 | 2024-03-14 15:51:04 | 2024-03-15 01:36:39 | 2024-03-15 02:05:50 | 0:29:11 | 0:18:22 | 0:10:49 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 2 | |
pass | 7600684 | 2024-03-14 15:51:04 | 2024-03-15 01:36:39 | 2024-03-15 03:13:36 | 1:36:57 | 1:24:41 | 0:12:16 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} | 2 | |
fail | 7600685 | 2024-03-14 15:51:05 | 2024-03-15 01:37:30 | 2024-03-15 02:12:31 | 0:35:01 | 0:21:10 | 0:13:51 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} | 2 | |
Failure Reason:
"2024-03-15T02:01:24.347344+0000 osd.5 (osd.5) 15 : cluster [WRN] slow reservation response from 6 (74599ms)" in cluster log |
||||||||||||||
pass | 7600686 | 2024-03-14 15:51:06 | 2024-03-15 01:39:21 | 2024-03-15 02:00:56 | 0:21:35 | 0:12:08 | 0:09:27 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} | 1 | |
pass | 7600687 | 2024-03-14 15:51:07 | 2024-03-15 01:39:21 | 2024-03-15 02:11:21 | 0:32:00 | 0:22:19 | 0:09:41 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600688 | 2024-03-14 15:51:07 | 2024-03-15 01:40:11 | 2024-03-15 02:03:01 | 0:22:50 | 0:12:19 | 0:10:31 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
dead | 7600689 | 2024-03-14 15:51:08 | 2024-03-15 01:40:52 | 2024-03-15 13:49:23 | 12:08:31 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7600690 | 2024-03-14 15:51:09 | 2024-03-15 01:41:02 | 2024-03-15 02:06:06 | 0:25:04 | 0:16:00 | 0:09:04 | smithi | main | centos | 9.stream | rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600691 | 2024-03-14 15:51:09 | 2024-03-15 01:41:03 | 2024-03-15 02:15:57 | 0:34:54 | 0:22:52 | 0:12:02 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} | 2 | |
fail | 7600692 | 2024-03-14 15:51:10 | 2024-03-15 01:41:33 | 2024-03-15 02:08:33 | 0:27:00 | 0:17:30 | 0:09:30 | smithi | main | centos | 9.stream | rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} | 1 | |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
fail | 7600693 | 2024-03-14 15:51:11 | 2024-03-15 01:41:34 | 2024-03-15 02:24:53 | 0:43:19 | 0:32:21 | 0:10:58 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} | 2 | |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
fail | 7600694 | 2024-03-14 15:51:12 | 2024-03-15 01:41:44 | 2024-03-15 02:26:50 | 0:45:06 | 0:33:36 | 0:11:30 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 | |
Failure Reason:
"2024-03-15T02:16:15.675899+0000 osd.7 (osd.7) 98 : cluster [ERR] osd.7 pg[3.11s0]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600695 | 2024-03-14 15:51:12 | 2024-03-15 01:42:35 | 2024-03-15 02:08:40 | 0:26:05 | 0:14:16 | 0:11:49 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 7600696 | 2024-03-14 15:51:13 | 2024-03-15 01:44:05 | 2024-03-15 02:14:06 | 0:30:01 | 0:20:15 | 0:09:46 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600697 | 2024-03-14 15:51:14 | 2024-03-15 01:44:06 | 2024-03-15 02:28:13 | 0:44:07 | 0:33:37 | 0:10:30 | smithi | main | ubuntu | 22.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} | 2 | |
fail | 7600698 | 2024-03-14 15:51:15 | 2024-03-15 01:44:16 | 2024-03-15 02:24:18 | 0:40:02 | 0:29:50 | 0:10:12 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} | 2 | |
Failure Reason:
"2024-03-15T02:12:55.790016+0000 osd.1 (osd.1) 11 : cluster [ERR] osd.1 pg[3.0]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600699 | 2024-03-14 15:51:15 | 2024-03-15 01:44:36 | 2024-03-15 02:04:55 | 0:20:19 | 0:08:12 | 0:12:07 | smithi | main | centos | 9.stream | rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} | 1 | |
dead | 7600700 | 2024-03-14 15:51:16 | 2024-03-15 01:45:17 | 2024-03-15 01:46:31 | 0:01:14 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} | 1 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi149 |
||||||||||||||
fail | 7600701 | 2024-03-14 15:51:17 | 2024-03-15 01:45:27 | 2024-03-15 02:35:17 | 0:49:50 | 0:38:44 | 0:11:06 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} | 3 | |
Failure Reason:
"2024-03-15T02:10:17.177614+0000 mon.a (mon.0) 199 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
pass | 7600702 | 2024-03-14 15:51:18 | 2024-03-15 01:45:28 | 2024-03-15 02:16:52 | 0:31:24 | 0:21:37 | 0:09:47 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 2 | |
pass | 7600703 | 2024-03-14 15:51:18 | 2024-03-15 01:45:28 | 2024-03-15 02:38:24 | 0:52:56 | 0:40:33 | 0:12:23 | smithi | main | centos | 9.stream | rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} | 2 | |
pass | 7600704 | 2024-03-14 15:51:19 | 2024-03-15 01:45:28 | 2024-03-15 02:07:31 | 0:22:03 | 0:10:51 | 0:11:12 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} | 2 | |
pass | 7600705 | 2024-03-14 15:51:20 | 2024-03-15 01:46:39 | 2024-03-15 02:10:28 | 0:23:49 | 0:09:26 | 0:14:23 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/per_module_finisher_stats} | 2 | |
pass | 7600706 | 2024-03-14 15:51:21 | 2024-03-15 01:47:29 | 2024-03-15 02:19:10 | 0:31:41 | 0:22:38 | 0:09:03 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} | 1 | |
pass | 7600707 | 2024-03-14 15:51:21 | 2024-03-15 01:47:30 | 2024-03-15 02:19:26 | 0:31:56 | 0:19:38 | 0:12:18 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600708 | 2024-03-14 15:51:22 | 2024-03-15 01:50:00 | 2024-03-15 02:15:37 | 0:25:37 | 0:09:48 | 0:15:49 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} | 2 | |
pass | 7600709 | 2024-03-14 15:51:23 | 2024-03-15 01:56:02 | 2024-03-15 02:28:43 | 0:32:41 | 0:16:16 | 0:16:25 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 7600710 | 2024-03-14 15:51:24 | 2024-03-15 02:01:03 | 2024-03-15 02:24:55 | 0:23:52 | 0:13:21 | 0:10:31 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7600711 | 2024-03-14 15:51:24 | 2024-03-15 02:01:03 | 2024-03-15 02:29:55 | 0:28:52 | 0:17:59 | 0:10:53 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600712 | 2024-03-14 15:51:25 | 2024-03-15 02:01:04 | 2024-03-15 02:24:15 | 0:23:11 | 0:12:54 | 0:10:17 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} | 2 | |
pass | 7600713 | 2024-03-14 15:51:26 | 2024-03-15 02:01:04 | 2024-03-15 03:20:36 | 1:19:32 | 1:09:52 | 0:09:40 | smithi | main | ubuntu | 22.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} | 1 | |
pass | 7600714 | 2024-03-14 15:51:27 | 2024-03-15 02:01:04 | 2024-03-15 02:36:35 | 0:35:31 | 0:24:25 | 0:11:06 | smithi | main | centos | 9.stream | rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 7600715 | 2024-03-14 15:51:27 | 2024-03-15 02:01:05 | 2024-03-15 02:22:11 | 0:21:06 | 0:11:25 | 0:09:41 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} | 2 | |
pass | 7600716 | 2024-03-14 15:51:28 | 2024-03-15 02:01:05 | 2024-03-15 02:32:08 | 0:31:03 | 0:21:28 | 0:09:35 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} | 2 | |
pass | 7600717 | 2024-03-14 15:51:29 | 2024-03-15 02:01:05 | 2024-03-15 02:40:14 | 0:39:09 | 0:26:41 | 0:12:28 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600718 | 2024-03-14 15:51:30 | 2024-03-15 02:04:06 | 2024-03-15 02:26:26 | 0:22:20 | 0:08:26 | 0:13:54 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600719 | 2024-03-14 15:51:30 | 2024-03-15 02:04:57 | 2024-03-15 02:34:13 | 0:29:16 | 0:19:15 | 0:10:01 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} | 2 | |
pass | 7600720 | 2024-03-14 15:51:31 | 2024-03-15 02:05:07 | 2024-03-15 02:52:57 | 0:47:50 | 0:37:44 | 0:10:06 | smithi | main | ubuntu | 22.04 | rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600721 | 2024-03-14 15:51:32 | 2024-03-15 02:05:07 | 2024-03-15 02:31:49 | 0:26:42 | 0:15:03 | 0:11:39 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600722 | 2024-03-14 15:51:33 | 2024-03-15 02:05:58 | 2024-03-15 02:49:25 | 0:43:27 | 0:30:21 | 0:13:06 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
Failure Reason:
"2024-03-15T02:40:56.537595+0000 osd.2 (osd.2) 287 : cluster [ERR] osd.2 pg[1.0]: reservation requested while still reserved" in cluster log |
||||||||||||||
fail | 7600723 | 2024-03-14 15:51:33 | 2024-03-15 02:06:08 | 2024-03-15 02:44:00 | 0:37:52 | 0:24:55 | 0:12:57 | smithi | main | ubuntu | 22.04 | rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 | |
Failure Reason:
"2024-03-15T02:31:36.110526+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
pass | 7600724 | 2024-03-14 15:51:34 | 2024-03-15 02:08:19 | 2024-03-15 02:43:45 | 0:35:26 | 0:25:09 | 0:10:17 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} | 2 | |
pass | 7600725 | 2024-03-14 15:51:35 | 2024-03-15 02:08:49 | 2024-03-15 02:35:04 | 0:26:15 | 0:14:09 | 0:12:06 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 7600726 | 2024-03-14 15:51:36 | 2024-03-15 02:10:30 | 2024-03-15 02:48:11 | 0:37:41 | 0:27:11 | 0:10:30 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600727 | 2024-03-14 15:51:37 | 2024-03-15 02:10:30 | 2024-03-15 02:35:22 | 0:24:52 | 0:14:14 | 0:10:38 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} | 1 | |
pass | 7600728 | 2024-03-14 15:51:37 | 2024-03-15 02:11:31 | 2024-03-15 02:32:39 | 0:21:08 | 0:12:23 | 0:08:45 | smithi | main | centos | 9.stream | rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} | 1 | |
fail | 7600729 | 2024-03-14 15:51:38 | 2024-03-15 02:11:31 | 2024-03-15 02:53:25 | 0:41:54 | 0:32:13 | 0:09:41 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
"2024-03-15T02:51:10.900901+0000 osd.3 (osd.3) 176 : cluster [ERR] osd.3 pg[319.5s2]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600730 | 2024-03-14 15:51:39 | 2024-03-15 02:11:51 | 2024-03-15 02:55:37 | 0:43:46 | 0:30:31 | 0:13:15 | smithi | main | centos | 9.stream | rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600731 | 2024-03-14 15:51:40 | 2024-03-15 02:14:12 | 2024-03-15 02:46:34 | 0:32:22 | 0:20:33 | 0:11:49 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_latest} tasks/progress} | 2 | |
pass | 7600732 | 2024-03-14 15:51:40 | 2024-03-15 02:15:43 | 2024-03-15 02:35:02 | 0:19:19 | 0:09:06 | 0:10:13 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600733 | 2024-03-14 15:51:41 | 2024-03-15 02:16:03 | 2024-03-15 02:48:51 | 0:32:48 | 0:22:07 | 0:10:41 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} | 2 | |
pass | 7600734 | 2024-03-14 15:51:42 | 2024-03-15 02:16:24 | 2024-03-15 03:27:51 | 1:11:27 | 1:02:33 | 0:08:54 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} | 2 | |
pass | 7600735 | 2024-03-14 15:51:43 | 2024-03-15 02:16:24 | 2024-03-15 03:23:11 | 1:06:47 | 0:53:16 | 0:13:31 | smithi | main | centos | 9.stream | rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_osdmap_prune} | 2 | |
fail | 7600736 | 2024-03-14 15:51:43 | 2024-03-15 02:16:24 | 2024-03-15 02:45:58 | 0:29:34 | 0:19:22 | 0:10:12 | smithi | main | ubuntu | 22.04 | rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 | |
Failure Reason:
"2024-03-15T02:41:40.038016+0000 mon.smithi008 (mon.0) 754 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600737 | 2024-03-14 15:51:44 | 2024-03-15 02:16:25 | 2024-03-15 02:49:37 | 0:33:12 | 0:23:31 | 0:09:41 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} | 3 | |
pass | 7600738 | 2024-03-14 15:51:45 | 2024-03-15 02:16:25 | 2024-03-15 02:39:11 | 0:22:46 | 0:10:52 | 0:11:54 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 2 | |
pass | 7600739 | 2024-03-14 15:51:46 | 2024-03-15 02:19:36 | 2024-03-15 02:52:11 | 0:32:35 | 0:17:15 | 0:15:20 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} | 3 | |
pass | 7600740 | 2024-03-14 15:51:46 | 2024-03-15 02:24:17 | 2024-03-15 03:04:14 | 0:39:57 | 0:27:46 | 0:12:11 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 3 | |
pass | 7600741 | 2024-03-14 15:51:47 | 2024-03-15 02:24:57 | 2024-03-15 03:03:56 | 0:38:59 | 0:25:36 | 0:13:23 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} | 2 | |
pass | 7600742 | 2024-03-14 15:51:48 | 2024-03-15 02:28:18 | 2024-03-15 03:54:56 | 1:26:38 | 1:13:52 | 0:12:46 | smithi | main | centos | 9.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} | 2 | |
dead | 7600743 | 2024-03-14 15:51:49 | 2024-03-15 02:28:49 | 2024-03-15 14:38:54 | 12:10:05 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7600744 | 2024-03-14 15:51:50 | 2024-03-15 02:28:49 | 2024-03-15 03:04:13 | 0:35:24 | 0:24:13 | 0:11:11 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon-stretch} | 1 | |
dead | 7600745 | 2024-03-14 15:51:50 | 2024-03-15 02:28:49 | 2024-03-15 14:42:14 | 12:13:25 | smithi | main | centos | 9.stream | rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7600746 | 2024-03-14 15:51:51 | 2024-03-15 02:31:50 | 2024-03-15 04:09:27 | 1:37:37 | 1:26:21 | 0:11:16 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/radosbench} | 2 | |
pass | 7600747 | 2024-03-14 15:51:52 | 2024-03-15 02:31:51 | 2024-03-15 02:53:09 | 0:21:18 | 0:12:46 | 0:08:32 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600748 | 2024-03-14 15:51:53 | 2024-03-15 02:31:51 | 2024-03-15 02:53:25 | 0:21:34 | 0:12:37 | 0:08:57 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} | 1 | |
fail | 7600749 | 2024-03-14 15:51:53 | 2024-03-15 02:31:51 | 2024-03-15 02:58:46 | 0:26:55 | 0:17:07 | 0:09:48 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} | 3 | |
Failure Reason:
"2024-03-15T02:54:28.828840+0000 mon.a (mon.0) 189 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
pass | 7600750 | 2024-03-14 15:51:54 | 2024-03-15 02:31:52 | 2024-03-15 03:01:18 | 0:29:26 | 0:19:14 | 0:10:12 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/redirect} | 2 | |
pass | 7600751 | 2024-03-14 15:51:55 | 2024-03-15 02:32:12 | 2024-03-15 02:53:49 | 0:21:37 | 0:11:51 | 0:09:46 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600752 | 2024-03-14 15:51:56 | 2024-03-15 02:32:12 | 2024-03-15 03:09:29 | 0:37:17 | 0:25:28 | 0:11:49 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} | 2 | |
fail | 7600753 | 2024-03-14 15:51:56 | 2024-03-15 02:34:13 | 2024-03-15 03:10:00 | 0:35:47 | 0:26:42 | 0:09:05 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
Failure Reason:
"2024-03-15T03:00:32.181127+0000 osd.5 (osd.5) 25 : cluster [ERR] osd.5 pg[3.as2]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600754 | 2024-03-14 15:51:57 | 2024-03-15 02:35:04 | 2024-03-15 02:57:46 | 0:22:42 | 0:10:59 | 0:11:43 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600755 | 2024-03-14 15:51:58 | 2024-03-15 02:35:14 | 2024-03-15 02:56:28 | 0:21:14 | 0:10:42 | 0:10:32 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} | 2 | |
pass | 7600756 | 2024-03-14 15:51:59 | 2024-03-15 02:35:14 | 2024-03-15 02:56:50 | 0:21:36 | 0:11:29 | 0:10:07 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600757 | 2024-03-14 15:51:59 | 2024-03-15 02:35:15 | 2024-03-15 03:03:12 | 0:27:57 | 0:14:18 | 0:13:39 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
fail | 7600758 | 2024-03-14 15:52:00 | 2024-03-15 02:38:26 | 2024-03-15 04:38:15 | 1:59:49 | 1:48:00 | 0:11:49 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} | 2 | |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
pass | 7600759 | 2024-03-14 15:52:01 | 2024-03-15 02:39:16 | 2024-03-15 03:01:43 | 0:22:27 | 0:11:32 | 0:10:55 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_latest} tasks/prometheus} | 2 | |
pass | 7600760 | 2024-03-14 15:52:02 | 2024-03-15 02:40:16 | 2024-03-15 05:22:58 | 2:42:42 | 2:29:33 | 0:13:09 | smithi | main | centos | 9.stream | rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} | 2 | |
fail | 7600761 | 2024-03-14 15:52:02 | 2024-03-15 02:43:47 | 2024-03-15 03:22:14 | 0:38:27 | 0:24:54 | 0:13:33 | smithi | main | ubuntu | 22.04 | rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 | |
Failure Reason:
"2024-03-15T03:06:20.678797+0000 mon.a (mon.0) 182 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
pass | 7600762 | 2024-03-14 15:52:03 | 2024-03-15 02:46:38 | 2024-03-15 03:10:51 | 0:24:13 | 0:14:44 | 0:09:29 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 7600763 | 2024-03-14 15:52:04 | 2024-03-15 02:47:19 | 2024-03-15 05:46:44 | 2:59:25 | 2:33:05 | 0:26:20 | smithi | main | ubuntu | 22.04 | rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600764 | 2024-03-14 15:52:05 | 2024-03-15 02:47:19 | 2024-03-15 03:10:42 | 0:23:23 | 0:14:37 | 0:08:46 | smithi | main | ubuntu | 22.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} | 2 | |
pass | 7600765 | 2024-03-14 15:52:05 | 2024-03-15 02:47:19 | 2024-03-15 03:09:49 | 0:22:30 | 0:11:23 | 0:11:07 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600766 | 2024-03-14 15:52:06 | 2024-03-15 02:47:20 | 2024-03-15 03:10:23 | 0:23:03 | 0:14:42 | 0:08:21 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} | 1 | |
pass | 7600767 | 2024-03-14 15:52:07 | 2024-03-15 02:47:20 | 2024-03-15 03:14:16 | 0:26:56 | 0:18:12 | 0:08:44 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 7600768 | 2024-03-14 15:52:08 | 2024-03-15 02:47:20 | 2024-03-15 03:31:26 | 0:44:06 | 0:32:02 | 0:12:04 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 2 | |
pass | 7600769 | 2024-03-14 15:52:08 | 2024-03-15 02:49:01 | 2024-03-15 03:29:20 | 0:40:19 | 0:30:40 | 0:09:39 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} | 2 | |
pass | 7600770 | 2024-03-14 15:52:09 | 2024-03-15 02:49:41 | 2024-03-15 04:01:00 | 1:11:19 | 1:02:10 | 0:09:09 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/mon} | 1 | |
fail | 7600771 | 2024-03-14 15:52:10 | 2024-03-15 02:49:42 | 2024-03-15 03:19:17 | 0:29:35 | 0:19:41 | 0:09:54 | smithi | main | ubuntu | 22.04 | rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} | 1 | |
Failure Reason:
"2024-03-15T03:15:11.032874+0000 mon.smithi129 (mon.0) 492 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7600772 | 2024-03-14 15:52:11 | 2024-03-15 02:49:42 | 2024-03-15 03:09:17 | 0:19:35 | 0:07:20 | 0:12:15 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600773 | 2024-03-14 15:52:11 | 2024-03-15 02:52:13 | 2024-03-15 03:12:57 | 0:20:44 | 0:10:04 | 0:10:40 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} | 3 | |
pass | 7600774 | 2024-03-14 15:52:12 | 2024-03-15 02:53:03 | 2024-03-15 03:37:03 | 0:44:00 | 0:32:40 | 0:11:20 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
fail | 7600775 | 2024-03-14 15:52:13 | 2024-03-15 02:53:54 | 2024-03-15 03:46:07 | 0:52:13 | 0:39:11 | 0:13:02 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} | 3 | |
Failure Reason:
"2024-03-15T03:21:50.354807+0000 mon.a (mon.0) 186 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
fail | 7600776 | 2024-03-14 15:52:14 | 2024-03-15 02:57:36 | 2024-03-15 03:38:05 | 0:40:29 | 0:26:33 | 0:13:56 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} | 2 | |
Failure Reason:
"2024-03-15T03:31:32.144124+0000 osd.0 (osd.0) 6 : cluster [ERR] osd.0 pg[3.13]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600777 | 2024-03-14 15:52:14 | 2024-03-15 02:58:16 | 2024-03-15 03:33:13 | 0:34:57 | 0:22:20 | 0:12:37 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 2 | |
pass | 7600778 | 2024-03-14 15:52:15 | 2024-03-15 03:01:27 | 2024-03-15 03:39:22 | 0:37:55 | 0:27:44 | 0:10:11 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} | 2 | |
pass | 7600779 | 2024-03-14 15:52:16 | 2024-03-15 03:01:47 | 2024-03-15 03:22:11 | 0:20:24 | 0:10:23 | 0:10:01 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/ceph-snapmapper mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600780 | 2024-03-14 15:52:17 | 2024-03-15 03:02:48 | 2024-03-15 03:37:09 | 0:34:21 | 0:23:09 | 0:11:12 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} | 2 | |
pass | 7600781 | 2024-03-14 15:52:17 | 2024-03-15 03:02:48 | 2024-03-15 03:40:27 | 0:37:39 | 0:28:27 | 0:09:12 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 7600782 | 2024-03-14 15:52:18 | 2024-03-15 03:02:49 | 2024-03-15 03:59:43 | 0:56:54 | 0:46:31 | 0:10:23 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} | 2 | |
pass | 7600783 | 2024-03-14 15:52:19 | 2024-03-15 03:02:49 | 2024-03-15 03:36:05 | 0:33:16 | 0:22:01 | 0:11:15 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} | 2 | |
fail | 7600784 | 2024-03-14 15:52:20 | 2024-03-15 03:03:19 | 2024-03-15 03:39:39 | 0:36:20 | 0:24:33 | 0:11:47 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} | 3 | |
Failure Reason:
"2024-03-15T03:33:52.225534+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
pass | 7600785 | 2024-03-14 15:52:20 | 2024-03-15 03:04:00 | 2024-03-15 03:39:49 | 0:35:49 | 0:17:26 | 0:18:23 | smithi | main | centos | 9.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/repair_test} | 2 | |
pass | 7600786 | 2024-03-14 15:52:21 | 2024-03-15 03:04:20 | 2024-03-15 03:47:22 | 0:43:02 | 0:31:40 | 0:11:22 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} | 2 | |
pass | 7600787 | 2024-03-14 15:52:22 | 2024-03-15 03:04:21 | 2024-03-15 03:28:20 | 0:23:59 | 0:14:18 | 0:09:41 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} | 1 | |
pass | 7600788 | 2024-03-14 15:52:23 | 2024-03-15 03:04:21 | 2024-03-15 03:31:17 | 0:26:56 | 0:11:32 | 0:15:24 | smithi | main | ubuntu | 22.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/workunits} | 2 | |
pass | 7600789 | 2024-03-14 15:52:23 | 2024-03-15 03:09:32 | 2024-03-15 03:31:17 | 0:21:45 | 0:10:58 | 0:10:47 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600790 | 2024-03-14 15:52:24 | 2024-03-15 03:09:33 | 2024-03-15 03:35:22 | 0:25:49 | 0:14:01 | 0:11:48 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 7600791 | 2024-03-14 15:52:25 | 2024-03-15 03:10:43 | 2024-03-15 03:49:54 | 0:39:11 | 0:30:42 | 0:08:29 | smithi | main | centos | 9.stream | rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} | 1 | |
pass | 7600792 | 2024-03-14 15:52:26 | 2024-03-15 03:10:54 | 2024-03-15 03:48:15 | 0:37:21 | 0:26:14 | 0:11:07 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} | 2 | |
pass | 7600793 | 2024-03-14 15:52:27 | 2024-03-15 03:13:04 | 2024-03-15 03:32:55 | 0:19:51 | 0:10:22 | 0:09:29 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600794 | 2024-03-14 15:52:27 | 2024-03-15 03:13:05 | 2024-03-15 03:55:06 | 0:42:01 | 0:28:40 | 0:13:21 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} | 2 | |
pass | 7600795 | 2024-03-14 15:52:28 | 2024-03-15 03:13:45 | 2024-03-15 03:33:30 | 0:19:45 | 0:09:45 | 0:10:00 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600796 | 2024-03-14 15:52:29 | 2024-03-15 03:13:46 | 2024-03-15 03:45:35 | 0:31:49 | 0:19:51 | 0:11:58 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 | |
Failure Reason:
"2024-03-15T03:40:49.216190+0000 mon.smithi008 (mon.0) 584 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
pass | 7600797 | 2024-03-14 15:52:30 | 2024-03-15 03:14:26 | 2024-03-15 03:37:23 | 0:22:57 | 0:09:41 | 0:13:16 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/admin-socket mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600798 | 2024-03-14 15:52:30 | 2024-03-15 03:18:07 | 2024-03-15 03:55:36 | 0:37:29 | 0:28:22 | 0:09:07 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} | 2 | |
pass | 7600799 | 2024-03-14 15:52:31 | 2024-03-15 03:18:07 | 2024-03-15 06:02:24 | 2:44:17 | 2:33:24 | 0:10:53 | smithi | main | ubuntu | 22.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} | 1 | |
pass | 7600800 | 2024-03-14 15:52:32 | 2024-03-15 03:20:38 | 2024-03-15 04:05:52 | 0:45:14 | 0:34:32 | 0:10:42 | smithi | main | ubuntu | 22.04 | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 | |
dead | 7600801 | 2024-03-14 15:52:32 | 2024-03-15 03:22:19 | 2024-03-15 15:32:50 | 12:10:31 | smithi | main | ubuntu | 22.04 | rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} | 2 | |||
Failure Reason:
hit max job timeout |
||||||||||||||
pass | 7600802 | 2024-03-14 15:52:33 | 2024-03-15 03:23:19 | 2024-03-15 03:48:59 | 0:25:40 | 0:08:46 | 0:16:54 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600803 | 2024-03-14 15:52:34 | 2024-03-15 03:28:00 | 2024-03-15 03:45:08 | 0:17:08 | 0:08:54 | 0:08:14 | smithi | main | ubuntu | 22.04 | rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600804 | 2024-03-14 15:52:35 | 2024-03-15 03:28:00 | 2024-03-15 03:48:59 | 0:20:59 | 0:09:48 | 0:11:11 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} | 2 | |
pass | 7600805 | 2024-03-14 15:52:35 | 2024-03-15 03:29:21 | 2024-03-15 03:55:07 | 0:25:46 | 0:14:50 | 0:10:56 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
fail | 7600806 | 2024-03-14 15:52:36 | 2024-03-15 03:31:22 | 2024-03-15 04:13:21 | 0:41:59 | 0:29:01 | 0:12:58 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} | 2 | |
Failure Reason:
"2024-03-15T04:04:24.360550+0000 osd.4 (osd.4) 95 : cluster [ERR] osd.4 pg[3.1]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600807 | 2024-03-14 15:52:37 | 2024-03-15 03:31:32 | 2024-03-15 04:00:47 | 0:29:15 | 0:19:00 | 0:10:15 | smithi | main | centos | 9.stream | rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600808 | 2024-03-14 15:52:38 | 2024-03-15 03:31:32 | 2024-03-15 03:57:00 | 0:25:28 | 0:13:04 | 0:12:24 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} | 1 | |
pass | 7600809 | 2024-03-14 15:52:39 | 2024-03-15 03:33:03 | 2024-03-15 03:56:58 | 0:23:55 | 0:13:17 | 0:10:38 | smithi | main | ubuntu | 22.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} | 2 | |
pass | 7600810 | 2024-03-14 15:52:39 | 2024-03-15 03:33:13 | 2024-03-15 03:56:25 | 0:23:12 | 0:11:55 | 0:11:17 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} | 2 | |
fail | 7600811 | 2024-03-14 15:52:40 | 2024-03-15 03:33:24 | 2024-03-15 05:11:19 | 1:37:55 | 1:24:06 | 0:13:49 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} | 3 | |
Failure Reason:
"2024-03-15T04:02:29.089736+0000 mon.a (mon.0) 196 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c" in cluster log |
||||||||||||||
pass | 7600812 | 2024-03-14 15:52:41 | 2024-03-15 03:35:24 | 2024-03-15 03:56:36 | 0:21:12 | 0:11:53 | 0:09:19 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600813 | 2024-03-14 15:52:41 | 2024-03-15 03:35:25 | 2024-03-15 03:58:24 | 0:22:59 | 0:14:04 | 0:08:55 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} | 2 | |
pass | 7600814 | 2024-03-14 15:52:42 | 2024-03-15 03:35:25 | 2024-03-15 04:01:00 | 0:25:35 | 0:12:46 | 0:12:49 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600815 | 2024-03-14 15:52:43 | 2024-03-15 03:36:15 | 2024-03-15 04:12:12 | 0:35:57 | 0:25:19 | 0:10:38 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
Failure Reason:
"2024-03-15T04:01:05.399280+0000 osd.2 (osd.2) 272 : cluster [ERR] osd.2 pg[3.3s1]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600816 | 2024-03-14 15:52:44 | 2024-03-15 03:37:06 | 2024-03-15 04:06:22 | 0:29:16 | 0:19:11 | 0:10:05 | smithi | main | centos | 9.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} | 2 | |
fail | 7600817 | 2024-03-14 15:52:45 | 2024-03-15 03:37:06 | 2024-03-15 04:15:50 | 0:38:44 | 0:23:04 | 0:15:40 | smithi | main | centos | 9.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/e2e} | 2 | |
Failure Reason:
"2024-03-15T04:12:51.345019+0000 mon.a (mon.0) 630 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600818 | 2024-03-14 15:52:45 | 2024-03-15 03:37:17 | 2024-03-15 04:00:27 | 0:23:10 | 0:12:24 | 0:10:46 | smithi | main | centos | 9.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_latest} tasks/crash} | 2 | |
fail | 7600819 | 2024-03-14 15:52:46 | 2024-03-15 03:39:27 | 2024-03-15 04:33:28 | 0:54:01 | 0:41:58 | 0:12:03 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} | 2 | |
Failure Reason:
"2024-03-15T04:12:33.817622+0000 osd.0 (osd.0) 25 : cluster [ERR] osd.0 pg[1.1s2]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600820 | 2024-03-14 15:52:47 | 2024-03-15 03:39:58 | 2024-03-15 04:14:13 | 0:34:15 | 0:23:53 | 0:10:22 | smithi | main | ubuntu | 22.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7600821 | 2024-03-14 15:52:48 | 2024-03-15 03:40:29 | 2024-03-15 04:02:37 | 0:22:08 | 0:10:56 | 0:11:12 | smithi | main | ubuntu | 22.04 | rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 | |
fail | 7600822 | 2024-03-14 15:52:48 | 2024-03-15 03:40:29 | 2024-03-15 04:10:30 | 0:30:01 | 0:13:36 | 0:16:25 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 | |
Failure Reason:
"2024-03-15T04:07:31.953572+0000 mon.smithi032 (mon.0) 771 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
pass | 7600823 | 2024-03-14 15:52:49 | 2024-03-15 03:47:30 | 2024-03-15 04:09:15 | 0:21:45 | 0:12:56 | 0:08:49 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600824 | 2024-03-14 15:52:50 | 2024-03-15 03:47:31 | 2024-03-15 04:12:24 | 0:24:53 | 0:12:25 | 0:12:28 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
fail | 7600825 | 2024-03-14 15:52:51 | 2024-03-15 03:48:51 | 2024-03-15 05:01:38 | 1:12:47 | 1:02:17 | 0:10:30 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8fb72a1057818c8e23ab8db51bece79404afc7d7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
fail | 7600826 | 2024-03-14 15:52:51 | 2024-03-15 03:48:52 | 2024-03-15 04:45:42 | 0:56:50 | 0:41:17 | 0:15:33 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} | 2 | |
Failure Reason:
"2024-03-15T04:16:52.462296+0000 osd.5 (osd.5) 14 : cluster [ERR] osd.5 pg[4.2]: reservation requested while still reserved" in cluster log |
||||||||||||||
fail | 7600827 | 2024-03-14 15:52:52 | 2024-03-15 03:48:52 | 2024-03-15 04:12:06 | 0:23:14 | 0:12:53 | 0:10:21 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | |
Failure Reason:
Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats' |
||||||||||||||
pass | 7600828 | 2024-03-14 15:52:53 | 2024-03-15 03:48:52 | 2024-03-15 04:12:29 | 0:23:37 | 0:13:23 | 0:10:14 | smithi | main | ubuntu | 22.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} | 1 | |
pass | 7600829 | 2024-03-14 15:52:54 | 2024-03-15 03:48:53 | 2024-03-15 04:10:25 | 0:21:32 | 0:12:02 | 0:09:30 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 7600830 | 2024-03-14 15:52:54 | 2024-03-15 03:48:53 | 2024-03-15 06:30:20 | 2:41:27 | 2:30:16 | 0:11:11 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} | 1 | |
pass | 7600831 | 2024-03-14 15:52:55 | 2024-03-15 03:48:53 | 2024-03-15 04:14:35 | 0:25:42 | 0:16:19 | 0:09:23 | smithi | main | ubuntu | 22.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} | 2 | |
pass | 7600832 | 2024-03-14 15:52:56 | 2024-03-15 03:48:54 | 2024-03-15 04:11:13 | 0:22:19 | 0:11:07 | 0:11:12 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small} | 2 | |
fail | 7600833 | 2024-03-14 15:52:57 | 2024-03-15 03:50:04 | 2024-03-15 04:21:08 | 0:31:04 | 0:15:19 | 0:15:45 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 | |
Failure Reason:
"2024-03-15T04:11:52.401610+0000 mon.a (mon.0) 206 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
pass | 7600834 | 2024-03-14 15:52:57 | 2024-03-15 03:55:05 | 2024-03-15 04:18:21 | 0:23:16 | 0:10:06 | 0:13:10 | smithi | main | centos | 9.stream | rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} | 2 | |
pass | 7600835 | 2024-03-14 15:52:58 | 2024-03-15 03:55:16 | 2024-03-15 04:13:51 | 0:18:35 | 0:10:30 | 0:08:05 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 7600836 | 2024-03-14 15:52:59 | 2024-03-15 03:55:16 | 2024-03-15 04:14:36 | 0:19:20 | 0:09:38 | 0:09:42 | smithi | main | centos | 9.stream | rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} | 1 | |
fail | 7600837 | 2024-03-14 15:53:00 | 2024-03-15 03:55:16 | 2024-03-15 04:28:43 | 0:33:27 | 0:22:38 | 0:10:49 | smithi | main | centos | 9.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
Failure Reason:
"2024-03-15T04:18:04.819491+0000 osd.4 (osd.4) 15 : cluster [ERR] osd.4 pg[4.1]: reservation requested while still reserved" in cluster log |
||||||||||||||
pass | 7600838 | 2024-03-14 15:53:01 | 2024-03-15 03:55:37 | 2024-03-15 04:20:16 | 0:24:39 | 0:14:37 | 0:10:02 | smithi | main | ubuntu | 22.04 | rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} | 2 |