Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7550413 2024-02-07 16:44:36 2024-02-07 19:34:41 2024-02-07 19:49:17 0:14:36 0:05:32 0:09:04 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Command failed on smithi052 with status 5: 'sudo systemctl stop ceph-a0d37a00-c5f1-11ee-95b6-87774f69a715@mon.smithi052'

fail 7550415 2024-02-07 16:44:37 2024-02-07 19:34:42 2024-02-07 20:04:53 0:30:11 0:12:11 0:18:00 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-ae8ea17c-c5f3-11ee-95b6-87774f69a715@mon.a'

pass 7550417 2024-02-07 16:44:37 2024-02-07 19:43:14 2024-02-07 20:15:22 0:32:08 0:22:17 0:09:51 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
fail 7550419 2024-02-07 16:44:38 2024-02-07 19:45:55 2024-02-07 20:08:15 0:22:20 0:09:07 0:13:13 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-30bdc952-c5f4-11ee-95b6-87774f69a715@mon.a'

fail 7550421 2024-02-07 16:44:39 2024-02-07 19:47:16 2024-02-07 20:07:56 0:20:40 0:10:06 0:10:34 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-57b21540-c5f4-11ee-95b6-87774f69a715@mon.a'

dead 7550423 2024-02-07 16:44:40 2024-02-07 19:49:27 2024-02-08 07:59:12 12:09:45 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

fail 7550425 2024-02-07 16:44:41 2024-02-07 19:49:28 2024-02-07 20:04:22 0:14:54 0:05:46 0:09:08 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi129 with status 5: 'sudo systemctl stop ceph-cd903964-c5f3-11ee-95b6-87774f69a715@mon.smithi129'

fail 7550427 2024-02-07 16:44:41 2024-02-07 19:49:59 2024-02-07 21:48:30 1:58:31 1:47:19 0:11:12 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

fail 7550429 2024-02-07 16:44:42 2024-02-07 20:15:01 500 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-50811f72-c5f5-11ee-95b6-87774f69a715@mon.a'

pass 7550431 2024-02-07 16:44:43 2024-02-07 20:28:25 841 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7550433 2024-02-07 16:44:44 2024-02-07 23:48:52 12813 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi143 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7550435 2024-02-07 16:44:45 2024-02-07 20:04:56 2024-02-07 20:24:21 0:19:25 0:08:59 0:10:26 smithi main ubuntu 22.04 rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-57da441e-c5f6-11ee-95b6-87774f69a715@mon.a'

fail 7550437 2024-02-07 16:44:46 2024-02-07 20:04:57 2024-02-07 21:26:26 1:21:29 1:11:15 0:10:14 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} 2
Failure Reason:

reached maximum tries (501) after waiting for 3000 seconds

pass 7550439 2024-02-07 16:44:46 2024-02-07 20:05:58 2024-02-07 20:44:34 0:38:36 0:26:40 0:11:56 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 7550441 2024-02-07 16:44:47 2024-02-07 20:07:39 2024-02-07 20:28:40 0:21:01 0:09:01 0:12:00 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi114 with status 5: 'sudo systemctl stop ceph-30d3ae86-c5f7-11ee-95b6-87774f69a715@mon.smithi114'

fail 7550443 2024-02-07 16:44:48 2024-02-07 20:11:30 2024-02-07 21:48:37 1:37:07 1:24:15 0:12:52 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} 2
Failure Reason:

reached maximum tries (501) after waiting for 3000 seconds

dead 7550445 2024-02-07 16:44:49 2024-02-07 20:12:01 2024-02-07 20:32:01 0:20:00 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

fail 7550447 2024-02-07 16:44:50 2024-02-07 20:15:32 2024-02-07 23:35:08 3:19:36 3:08:46 0:10:50 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi145 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 7550449 2024-02-07 16:44:51 2024-02-07 20:21:16 2024-02-07 20:56:13 0:34:57 0:25:10 0:09:47 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 7550450 2024-02-07 16:44:52 2024-02-07 20:21:16 2024-02-07 20:40:22 0:19:06 0:10:17 0:08:49 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-d98c3dc6-c5f8-11ee-95b6-87774f69a715@mon.a'

dead 7550452 2024-02-07 16:44:52 2024-02-07 20:21:17 2024-02-08 08:31:44 12:10:27 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

hit max job timeout

fail 7550455 2024-02-07 16:44:53 2024-02-07 20:28:29 2024-02-07 20:57:34 0:29:05 0:18:43 0:10:22 smithi main centos 9.stream rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Command failed on smithi089 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6981e2f0-c5f9-11ee-95b6-87774f69a715 -e sha1=ca856288617c91349ab0ce4d19a0967a03e8f558 -- bash -c 'ceph orch ps'"

dead 7550457 2024-02-07 16:44:54 2024-02-07 20:28:30 2024-02-08 08:37:17 12:08:47 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

hit max job timeout

fail 7550459 2024-02-07 16:44:55 2024-02-07 20:47:57 327 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Command failed on smithi138 with status 5: 'sudo systemctl stop ceph-d774d25e-c5f9-11ee-95b6-87774f69a715@mon.smithi138'

fail 7550460 2024-02-07 16:44:56 2024-02-07 20:32:32 2024-02-07 20:50:29 0:17:57 0:05:27 0:12:30 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi053 with status 5: 'sudo systemctl stop ceph-2a98997a-c5fa-11ee-95b6-87774f69a715@mon.a'

fail 7550462 2024-02-07 16:44:57 2024-02-07 20:35:43 2024-02-07 20:53:03 0:17:20 0:08:31 0:08:49 smithi main ubuntu 22.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
Failure Reason:

Command failed on smithi114 with status 5: 'sudo systemctl stop ceph-96af6ba2-c5fa-11ee-95b6-87774f69a715@mon.smithi114'

dead 7550464 2024-02-07 16:44:57 2024-02-07 20:35:44 2024-02-08 08:45:31 12:09:47 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

hit max job timeout

fail 7550466 2024-02-07 16:44:58 2024-02-07 20:41:25 2024-02-07 20:59:27 0:18:02 0:08:11 0:09:51 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

dead 7550468 2024-02-07 16:44:59 2024-02-07 20:43:36 2024-02-08 08:53:35 12:09:59 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
Failure Reason:

hit max job timeout

fail 7550470 2024-02-07 16:45:00 2024-02-07 20:45:17 2024-02-07 21:07:19 0:22:02 0:07:52 0:14:10 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_timeout} 1
Failure Reason:

Command failed on smithi002 with status 5: 'sudo systemctl stop ceph-94559bf4-c5fc-11ee-95b6-87774f69a715@mon.a'

dead 7550472 2024-02-07 16:45:01 2024-02-07 20:50:59 2024-02-08 09:00:40 12:09:41 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} 2
Failure Reason:

hit max job timeout

fail 7550474 2024-02-07 16:45:02 2024-02-07 20:51:09 2024-02-07 21:06:09 0:15:00 0:05:38 0:09:22 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi102 with status 5: 'sudo systemctl stop ceph-60d7222a-c5fc-11ee-95b6-87774f69a715@mon.smithi102'

fail 7550477 2024-02-07 16:45:03 2024-02-07 20:56:21 2024-02-08 00:16:54 3:20:33 3:09:28 0:11:05 smithi main ubuntu 22.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} 1
Failure Reason:

Command failed (workunit test crush/crush-choose-args.sh) on smithi188 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh'

dead 7550478 2024-02-07 16:45:03 2024-02-07 20:57:02 2024-02-08 09:11:40 12:14:38 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} 2
Failure Reason:

hit max job timeout

fail 7550480 2024-02-07 16:45:04 2024-02-07 21:01:03 2024-02-07 21:26:03 0:25:00 0:10:20 0:14:40 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi063 with status 5: 'sudo systemctl stop ceph-3cdd91ee-c5ff-11ee-95b6-87774f69a715@mon.a'

fail 7550482 2024-02-07 16:45:05 2024-02-07 21:06:37 2024-02-07 22:22:09 1:15:32 0:59:36 0:15:56 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7550484 2024-02-07 16:45:06 2024-02-07 21:21:56 2024-02-07 21:40:57 0:19:01 0:08:22 0:10:39 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

Command failed on smithi120 with status 5: 'sudo systemctl stop ceph-4173d27a-c601-11ee-95b6-87774f69a715@mon.a'

fail 7550487 2024-02-07 16:45:07 2024-02-07 21:21:57 2024-02-07 21:44:21 0:22:24 0:10:49 0:11:35 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-9442e8ba-c601-11ee-95b6-87774f69a715@mon.a'

fail 7550490 2024-02-07 16:45:08 2024-02-07 21:30:19 2024-02-07 21:48:21 0:18:02 0:05:28 0:12:34 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi091 with status 5: 'sudo systemctl stop ceph-416e964c-c602-11ee-95b6-87774f69a715@mon.a'

dead 7550493 2024-02-07 16:45:09 2024-02-07 21:33:20 2024-02-08 09:46:09 12:12:49 smithi main ubuntu 22.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 3
Failure Reason:

hit max job timeout

fail 7550495 2024-02-07 16:45:09 2024-02-07 21:37:32 2024-02-07 21:57:06 0:19:34 0:08:45 0:10:49 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Command failed on smithi046 with status 5: 'sudo systemctl stop ceph-6394a652-c603-11ee-95b6-87774f69a715@mon.smithi046'

dead 7550497 2024-02-07 16:45:10 2024-02-07 21:37:32 2024-02-08 10:00:02 12:22:30 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

hit max job timeout

fail 7550499 2024-02-07 16:45:11 2024-02-07 21:52:35 2024-02-07 22:13:35 0:21:00 0:12:36 0:08:24 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

Command failed on smithi189 with status 5: 'sudo systemctl stop ceph-ee30d702-c605-11ee-95b6-87774f69a715@mon.a'

dead 7550501 2024-02-07 16:45:12 2024-02-07 21:52:56 2024-02-08 10:01:19 12:08:23 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

hit max job timeout

pass 7550503 2024-02-07 16:45:13 2024-02-07 21:52:56 2024-02-07 22:30:43 0:37:47 0:26:57 0:10:50 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 7550505 2024-02-07 16:45:14 2024-02-07 21:52:57 2024-02-07 22:12:06 0:19:09 0:08:19 0:10:50 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-7f3ad44c-c605-11ee-95b6-87774f69a715@mon.a'

fail 7550507 2024-02-07 16:45:15 2024-02-07 21:52:58 2024-02-08 01:14:15 3:21:17 3:08:14 0:13:03 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi112 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

pass 7550509 2024-02-07 16:45:15 2024-02-07 21:59:39 2024-02-07 22:34:38 0:34:59 0:16:35 0:18:24 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
fail 7550511 2024-02-07 16:45:16 2024-02-07 22:23:43 2024-02-07 22:38:56 0:15:13 0:05:47 0:09:26 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-68afae92-c609-11ee-95b6-87774f69a715@mon.smithi150'

fail 7550513 2024-02-07 16:45:17 2024-02-07 22:30:44 2024-02-07 22:56:02 0:25:18 0:10:42 0:14:36 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi160 with status 5: 'sudo systemctl stop ceph-a02568a6-c60b-11ee-95b6-87774f69a715@mon.a'

fail 7550515 2024-02-07 16:45:18 2024-02-07 22:39:04 2024-02-07 22:58:46 0:19:42 0:10:14 0:09:28 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-3555c98e-c60c-11ee-95b6-87774f69a715@mon.a'

fail 7550517 2024-02-07 16:45:19 2024-02-07 22:43:56 2024-02-07 23:13:55 0:29:59 0:07:53 0:22:06 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/e2e} 2
Failure Reason:

Command failed on smithi138 with status 5: 'sudo systemctl stop ceph-57dda740-c60e-11ee-95b6-87774f69a715@mon.a'

fail 7550519 2024-02-07 16:45:20 2024-02-07 23:03:29 2024-02-07 23:29:09 0:25:40 0:08:53 0:16:47 smithi main ubuntu 22.04 rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi063 with status 5: 'sudo systemctl stop ceph-3bc77dc2-c610-11ee-95b6-87774f69a715@mon.a'

pass 7550521 2024-02-07 16:45:20 2024-02-07 23:09:50 2024-02-07 23:39:31 0:29:41 0:18:32 0:11:09 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
dead 7550523 2024-02-07 16:45:21 2024-02-07 23:09:51 2024-02-08 11:35:00 12:25:09 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

fail 7550525 2024-02-07 16:45:22 2024-02-07 23:40:49 2024-02-07 23:55:33 0:14:44 0:05:15 0:09:29 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

Command failed on smithi077 with status 5: 'sudo systemctl stop ceph-04a50fea-c614-11ee-95b6-87774f69a715@mon.smithi077'

fail 7550527 2024-02-07 16:45:23 2024-02-07 23:40:50 2024-02-08 00:13:43 0:32:53 0:15:17 0:17:36 smithi main centos 9.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_latest} tasks/module_selftest} 2
Failure Reason:

Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest)

fail 7550529 2024-02-07 16:45:24 2024-02-07 23:55:12 2024-02-08 00:14:50 0:19:38 0:09:49 0:09:49 smithi main ubuntu 22.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

fail 7550531 2024-02-07 16:45:25 2024-02-07 23:55:53 2024-02-08 00:17:41 0:21:48 0:08:18 0:13:30 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi077 with status 5: 'sudo systemctl stop ceph-397662d4-c617-11ee-95b6-87774f69a715@mon.a'

pass 7550533 2024-02-07 16:45:25 2024-02-08 00:20:15 2024-02-08 02:29:12 2:08:57 1:58:03 0:10:54 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
fail 7550535 2024-02-07 16:45:26 2024-02-08 00:27:07 2024-02-08 00:43:56 0:16:49 0:07:49 0:09:00 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi077 with status 5: 'sudo systemctl stop ceph-ddd33e44-c61a-11ee-95b6-87774f69a715@mon.smithi077'

fail 7550537 2024-02-07 16:45:27 2024-02-08 00:27:07 2024-02-08 00:56:36 0:29:29 0:09:27 0:20:02 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-83d16cde-c61c-11ee-95b6-87774f69a715@mon.a'

fail 7550539 2024-02-07 16:45:28 2024-02-08 00:33:29 2024-02-08 01:05:59 0:32:30 0:18:27 0:14:03 smithi main centos 9.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

fail 7550541 2024-02-07 16:45:29 2024-02-08 00:57:43 2024-02-08 01:39:19 0:41:36 0:31:29 0:10:07 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

dead 7550543 2024-02-07 16:45:30 2024-02-08 00:58:14 2024-02-08 13:07:57 12:09:43 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

hit max job timeout

fail 7550545 2024-02-07 16:45:30 2024-02-08 01:04:15 2024-02-08 01:32:31 0:28:16 0:11:15 0:17:01 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi129 with status 5: 'sudo systemctl stop ceph-5c49321e-c621-11ee-95b6-87774f69a715@mon.a'

fail 7550547 2024-02-07 16:45:31 2024-02-08 01:13:37 2024-02-08 01:39:59 0:26:22 0:09:59 0:16:23 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi133 with status 5: 'sudo systemctl stop ceph-bca3a54e-c622-11ee-95b6-87774f69a715@mon.a'

fail 7550549 2024-02-07 16:45:32 2024-02-08 01:44:50 2024-02-08 02:02:12 0:17:22 0:08:46 0:08:36 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Command failed on smithi134 with status 5: 'sudo systemctl stop ceph-cc6bc9c2-c625-11ee-95b6-87774f69a715@mon.smithi134'

fail 7550551 2024-02-07 16:45:33 2024-02-08 01:44:51 2024-02-08 05:20:10 3:35:19 3:25:17 0:10:02 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc} 1
Failure Reason:

Command failed (workunit test misc/test-ceph-helpers.sh) on smithi138 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh'

fail 7550553 2024-02-07 16:45:34 2024-02-08 01:44:51 2024-02-08 01:59:46 0:14:55 0:05:18 0:09:37 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-5eae7da8-c625-11ee-95b6-87774f69a715@mon.a'

pass 7550555 2024-02-07 16:45:35 2024-02-08 01:44:52 2024-02-08 02:20:17 0:35:25 0:22:35 0:12:50 smithi main ubuntu 22.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
dead 7550557 2024-02-07 16:45:35 2024-02-08 01:49:43 2024-02-08 14:00:09 12:10:26 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

fail 7550559 2024-02-07 16:45:36 2024-02-08 01:51:04 2024-02-08 02:15:02 0:23:58 0:05:26 0:18:32 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-8badbdd0-c627-11ee-95b6-87774f69a715@mon.smithi073'

dead 7550561 2024-02-07 16:45:37 2024-02-08 02:04:57 2024-02-08 14:15:31 12:10:34 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

hit max job timeout

fail 7550563 2024-02-07 16:45:38 2024-02-08 02:07:48 2024-02-08 02:25:20 0:17:32 0:08:14 0:09:18 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

Command failed on smithi186 with status 5: 'sudo systemctl stop ceph-0c456ffa-c629-11ee-95b6-87774f69a715@mon.a'

fail 7550565 2024-02-07 16:45:39 2024-02-08 02:15:30 2024-02-08 08:41:15 6:25:45 6:15:44 0:10:01 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi073 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7550567 2024-02-07 16:45:40 2024-02-08 02:15:31 2024-02-08 05:46:58 3:31:27 3:15:28 0:15:59 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi032 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 7550569 2024-02-07 16:45:40 2024-02-08 07:11:42 2024-02-08 10:30:52 3:19:10 3:09:04 0:10:06 smithi main centos 9.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi159 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 7550571 2024-02-07 16:45:41 2024-02-08 07:11:43 2024-02-08 07:26:36 0:14:53 0:05:34 0:09:19 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Command failed on smithi084 with status 5: 'sudo systemctl stop ceph-3652cca0-c653-11ee-95b6-87774f69a715@mon.smithi084'

dead 7550573 2024-02-07 16:45:42 2024-02-08 07:11:43 2024-02-08 19:25:21 12:13:38 smithi main ubuntu 22.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

hit max job timeout

fail 7550575 2024-02-07 16:45:43 2024-02-08 07:20:46 2024-02-08 09:21:17 2:00:31 1:49:34 0:10:57 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
Failure Reason:

reached maximum tries (501) after waiting for 3000 seconds

fail 7550577 2024-02-07 16:45:44 2024-02-08 07:22:57 2024-02-08 07:43:00 0:20:03 0:10:00 0:10:03 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi072 with status 5: 'sudo systemctl stop ceph-60940f54-c655-11ee-95b6-87774f69a715@mon.a'

dead 7550579 2024-02-07 16:45:45 2024-02-08 07:24:19 2024-02-08 19:34:25 12:10:06 smithi main centos 9.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

hit max job timeout

fail 7550581 2024-02-07 16:45:46 2024-02-08 07:26:21 2024-02-08 08:09:15 0:42:54 0:29:39 0:13:15 smithi main ubuntu 22.04 rados/upgrade/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
Failure Reason:

Command failed on smithi049 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 29e38a9c-c656-11ee-95b6-87774f69a715 -e sha1=ca856288617c91349ab0ce4d19a0967a03e8f558 -- bash -c 'ceph orch ps'"

fail 7550583 2024-02-07 16:45:46 2024-02-08 07:27:01 2024-02-08 08:38:21 1:11:20 1:00:14 0:11:06 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/radosbench} 2
Failure Reason:

Command failed on smithi181 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2'

fail 7550585 2024-02-07 16:45:47 2024-02-08 07:27:22 2024-02-08 07:44:22 0:17:00 0:05:36 0:11:24 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-8d673114-c655-11ee-95b6-87774f69a715@mon.a'

dead 7550587 2024-02-07 16:45:48 2024-02-08 07:27:23 2024-02-08 19:35:42 12:08:19 smithi main centos 9.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

fail 7550589 2024-02-07 16:45:49 2024-02-08 07:28:44 2024-02-08 07:48:42 0:19:58 0:08:44 0:11:14 smithi main ubuntu 22.04 rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
Failure Reason:

Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-047816c4-c656-11ee-95b6-87774f69a715@mon.smithi057'

fail 7550591 2024-02-07 16:45:50 2024-02-08 07:30:55 2024-02-08 07:50:07 0:19:12 0:10:35 0:08:37 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_timeout} 1
Failure Reason:

Command failed on smithi138 with status 5: 'sudo systemctl stop ceph-78aadd7e-c656-11ee-95b6-87774f69a715@mon.a'

fail 7550593 2024-02-07 16:45:51 2024-02-08 07:30:56 2024-02-08 09:47:59 2:17:03 2:07:42 0:09:21 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

fail 7550595 2024-02-07 16:45:51 2024-02-08 07:32:57 2024-02-08 07:56:58 0:24:01 0:08:45 0:15:16 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi163 with status 5: 'sudo systemctl stop ceph-28752db8-c657-11ee-95b6-87774f69a715@mon.smithi163'

pass 7550597 2024-02-07 16:45:52 2024-02-08 07:36:38 2024-02-08 08:15:33 0:38:55 0:29:32 0:09:23 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
fail 7550599 2024-02-07 16:45:53 2024-02-08 07:39:49 2024-02-08 07:59:28 0:19:39 0:10:49 0:08:50 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} 2
Failure Reason:

Command failed on smithi110 with status 5: 'sudo systemctl stop ceph-af09be52-c657-11ee-95b6-87774f69a715@mon.a'

pass 7550601 2024-02-07 16:45:54 2024-02-08 07:40:40 2024-02-08 08:57:42 1:17:02 0:46:39 0:30:23 smithi main centos 9.stream rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} 2
fail 7550603 2024-02-07 16:45:55 2024-02-08 07:42:11 2024-02-08 08:13:49 0:31:38 0:21:48 0:09:50 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

Command failed on smithi008 with status 5: 'sudo systemctl stop ceph-b846bfa4-c659-11ee-95b6-87774f69a715@mon.a'

dead 7550605 2024-02-07 16:45:56 2024-02-08 07:43:05 2024-02-08 19:51:17 12:08:12 smithi main centos 9.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

fail 7550606 2024-02-07 16:45:57 2024-02-08 07:43:05 2024-02-08 08:06:18 0:23:13 0:10:54 0:12:19 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi003 with status 5: 'sudo systemctl stop ceph-7cd894a2-c658-11ee-95b6-87774f69a715@mon.a'

dead 7550607 2024-02-07 16:45:57 2024-02-08 07:45:16 2024-02-08 19:56:24 12:11:08 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
Failure Reason:

hit max job timeout

dead 7550608 2024-02-07 16:45:58 2024-02-08 07:47:17 2024-02-08 19:58:53 12:11:36 smithi main centos 9.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
Failure Reason:

hit max job timeout

fail 7550609 2024-02-07 16:45:59 2024-02-08 07:50:28 2024-02-08 08:07:21 0:16:53 0:05:39 0:11:14 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi038 with status 5: 'sudo systemctl stop ceph-aec1ea18-c658-11ee-95b6-87774f69a715@mon.smithi038'

dead 7550610 2024-02-07 16:46:00 2024-02-08 07:50:28 2024-02-08 20:01:13 12:10:45 smithi main ubuntu 22.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

hit max job timeout

fail 7550611 2024-02-07 16:46:01 2024-02-08 07:51:39 2024-02-08 08:38:45 0:47:06 0:19:36 0:27:30 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
Failure Reason:

Command failed on smithi080 with status 5: 'sudo systemctl stop ceph-19bbaaee-c65d-11ee-95b6-87774f69a715@mon.a'

dead 7550612 2024-02-07 16:46:01 2024-02-08 07:51:39 2024-02-08 20:03:13 12:11:34 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
Failure Reason:

hit max job timeout

fail 7550613 2024-02-07 16:46:02 2024-02-08 07:54:30 2024-02-08 08:14:28 0:19:58 0:08:53 0:11:05 smithi main ubuntu 22.04 rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi042 with status 5: 'sudo systemctl stop ceph-ce653c16-c659-11ee-95b6-87774f69a715@mon.a'

fail 7550614 2024-02-07 16:46:03 2024-02-08 07:56:40 2024-02-08 08:20:01 0:23:21 0:10:55 0:12:26 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-60f79754-c65a-11ee-95b6-87774f69a715@mon.a'

fail 7550615 2024-02-07 16:46:04 2024-02-08 07:58:21 2024-02-08 08:19:54 0:21:33 0:08:04 0:13:29 smithi main centos 9.stream rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

Command failed on smithi155 with status 5: 'sudo systemctl stop ceph-5a5ebdd2-c65a-11ee-95b6-87774f69a715@mon.smithi155'

dead 7550616 2024-02-07 16:46:05 2024-02-08 07:58:21 2024-02-08 20:07:11 12:08:50 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

hit max job timeout

fail 7550617 2024-02-07 16:46:06 2024-02-08 07:58:22 2024-02-08 11:18:07 3:19:45 3:10:50 0:08:55 smithi main ubuntu 22.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on smithi138 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 7550618 2024-02-07 16:46:06 2024-02-08 07:58:22 2024-02-08 08:15:17 0:16:55 0:08:23 0:08:32 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli} 1
Failure Reason:

Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-f75c1126-c659-11ee-95b6-87774f69a715@mon.a'

dead 7550619 2024-02-07 16:46:07 2024-02-08 07:58:22 2024-02-08 20:07:37 12:09:15 smithi main centos 9.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap-read mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

hit max job timeout

fail 7550620 2024-02-07 16:46:08 2024-02-08 07:58:53 2024-02-08 08:39:45 0:40:52 0:20:20 0:20:32 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi039 with status 5: 'sudo systemctl stop ceph-fbf59a9c-c65c-11ee-95b6-87774f69a715@mon.a'

fail 7550621 2024-02-07 16:46:09 2024-02-08 08:35:25 662 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi003 with status 5: 'sudo systemctl stop ceph-8ce12dd8-c65c-11ee-95b6-87774f69a715@mon.a'

fail 7550622 2024-02-07 16:46:10 2024-02-08 08:13:46 2024-02-08 08:47:06 0:33:20 0:23:14 0:10:06 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

fail 7550623 2024-02-07 16:46:10 2024-02-08 08:13:46 2024-02-08 08:33:14 0:19:28 0:09:04 0:10:24 smithi main ubuntu 22.04 rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi174 with status 5: 'sudo systemctl stop ceph-24b13726-c65c-11ee-95b6-87774f69a715@mon.smithi174'

dead 7550624 2024-02-07 16:46:11 2024-02-08 08:13:46 2024-02-08 20:22:27 12:08:41 smithi main centos 9.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

hit max job timeout

fail 7550625 2024-02-07 16:46:12 2024-02-08 08:13:47 2024-02-08 08:38:47 0:25:00 0:13:48 0:11:12 smithi main centos 9.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} 2
Failure Reason:

Command failed on smithi170 with status 5: 'sudo systemctl stop ceph-1bd1faea-c65d-11ee-95b6-87774f69a715@mon.a'

fail 7550626 2024-02-07 16:46:13 2024-02-08 08:13:47 2024-02-08 10:01:25 1:47:38 1:37:46 0:09:52 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

reached maximum tries (801) after waiting for 4800 seconds

fail 7550627 2024-02-07 16:46:14 2024-02-08 08:13:47 2024-02-08 08:31:45 0:17:58 0:06:10 0:11:48 smithi main centos 9.stream rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-0056eff6-c65c-11ee-95b6-87774f69a715@mon.a'

fail 7550628 2024-02-07 16:46:14 2024-02-08 08:13:48 2024-02-08 09:36:32 1:22:44 0:57:17 0:25:27 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

fail 7550629 2024-02-07 16:46:15 2024-02-08 08:15:38 2024-02-08 08:47:01 0:31:23 0:05:25 0:25:58 smithi main centos 9.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
Failure Reason:

Command failed on smithi113 with status 5: 'sudo systemctl stop ceph-66703fde-c65e-11ee-95b6-87774f69a715@mon.smithi113'

pass 7550630 2024-02-07 16:46:16 2024-02-08 08:17:29 2024-02-08 09:24:54 1:07:25 0:46:01 0:21:24 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
fail 7550631 2024-02-07 16:46:17 2024-02-08 08:29:21 2024-02-08 08:48:26 0:19:05 0:08:17 0:10:48 smithi main centos 9.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_latest}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_lazy_omap_stats'

fail 7550632 2024-02-07 16:46:18 2024-02-08 08:29:21 2024-02-08 13:48:15 5:18:54 5:08:21 0:10:33 smithi main centos 9.stream rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} 1
Failure Reason:

Command failed (workunit test osd/osd-reuse-id.sh) on smithi042 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ca856288617c91349ab0ce4d19a0967a03e8f558 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-reuse-id.sh'

fail 7550633 2024-02-07 16:46:19 2024-02-08 08:29:22 2024-02-08 08:51:02 0:21:40 0:11:03 0:10:37 smithi main ubuntu 22.04 rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-b43dc2a4-c65e-11ee-95b6-87774f69a715@mon.a'

fail 7550634 2024-02-07 16:46:19 2024-02-08 08:29:22 2024-02-08 08:48:52 0:19:30 0:08:47 0:10:43 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi001 with status 5: 'sudo systemctl stop ceph-93949ad2-c65e-11ee-95b6-87774f69a715@mon.a'