| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| rzarzynski | 2024-06-09 11:45:20 | 2024-06-09 11:49:11 | 2024-06-10 00:08:34 | 12:19:23 | rados | wip-osd-ec-partial-reads-eio | smithi | b1666de | 2 | 23 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7746423 |
|
2024-06-09 11:46:52 | 2024-06-09 11:49:10 | 2024-06-09 12:16:16 | 0:27:06 | 0:17:53 | 0:09:13 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
"2024-06-09T12:05:55.728895+0000 mon.smithi002 (mon.0) 121 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746424 |
|
2024-06-09 11:46:53 | 2024-06-09 11:49:11 | 2024-06-09 12:07:55 | 0:18:44 | 0:09:18 | 0:09:26 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} | 2 |
Failure Reason:
Command failed on smithi181 with status 1: 'sudo yum -y install cephfs-java' |
||||||||||||||
| fail | 7746425 |
|
2024-06-09 11:46:54 | 2024-06-09 11:49:11 | 2024-06-09 12:12:26 | 0:23:15 | 0:12:03 | 0:11:12 | smithi | main | ubuntu | 22.04 | rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
"2024-06-09T12:09:46.906152+0000 mon.a (mon.0) 101 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746426 |
|
2024-06-09 11:46:55 | 2024-06-09 11:50:31 | 2024-06-09 13:35:57 | 1:45:26 | 1:36:16 | 0:09:10 | smithi | main | centos | 9.stream | rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} | 1 |
Failure Reason:
Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi088 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh' |
||||||||||||||
| fail | 7746427 |
|
2024-06-09 11:46:56 | 2024-06-09 11:50:32 | 2024-06-09 12:32:17 | 0:41:45 | 0:30:40 | 0:11:05 | smithi | main | ubuntu | 22.04 | rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
"2024-06-09T12:11:59.957513+0000 mon.smithi052 (mon.0) 120 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746428 |
|
2024-06-09 11:46:57 | 2024-06-09 11:52:42 | 2024-06-09 12:30:09 | 0:37:27 | 0:28:10 | 0:09:17 | smithi | main | ubuntu | 22.04 | rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| dead | 7746429 |
|
2024-06-09 11:46:58 | 2024-06-09 11:52:43 | 2024-06-09 11:53:47 | 0:01:04 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} | 3 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi163 |
||||||||||||||
| dead | 7746430 |
|
2024-06-09 11:46:59 | 2024-06-09 11:52:43 | 2024-06-10 00:08:11 | 12:15:28 | smithi | main | centos | 9.stream | rados/upgrade/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7746431 |
|
2024-06-09 11:47:00 | 2024-06-09 11:52:43 | 2024-06-09 12:11:42 | 0:18:59 | 0:09:09 | 0:09:50 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 |
Failure Reason:
"2024-06-09T12:09:29.480872+0000 mon.a (mon.0) 110 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746432 |
|
2024-06-09 11:47:02 | 2024-06-09 11:52:44 | 2024-06-09 11:59:57 | 0:07:13 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} | 3 | ||
Failure Reason:
Command failed on smithi045 with status 1: 'sudo yum install -y kernel' |
||||||||||||||
| fail | 7746433 |
|
2024-06-09 11:47:03 | 2024-06-09 11:52:44 | 2024-06-09 12:57:34 | 1:04:50 | 0:53:12 | 0:11:38 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 7746434 |
|
2024-06-09 11:47:04 | 2024-06-09 11:54:25 | 2024-06-09 12:36:13 | 0:41:48 | 0:31:08 | 0:10:40 | smithi | main | ubuntu | 22.04 | rados/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
"2024-06-09T12:14:59.463234+0000 mon.smithi073 (mon.0) 117 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746435 |
|
2024-06-09 11:47:05 | 2024-06-09 11:54:45 | 2024-06-09 12:14:45 | 0:20:00 | 0:05:19 | 0:14:41 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
No module named 'tasks' |
||||||||||||||
| dead | 7746436 |
|
2024-06-09 11:47:06 | 2024-06-09 11:57:56 | 2024-06-10 00:08:34 | 12:10:38 | smithi | main | centos | 9.stream | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} | 4 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| pass | 7746437 |
|
2024-06-09 11:47:07 | 2024-06-09 11:58:26 | 2024-06-09 13:44:13 | 1:45:47 | 1:36:32 | 0:09:15 | smithi | main | ubuntu | 22.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} | 1 |
| fail | 7746438 |
|
2024-06-09 11:47:08 | 2024-06-09 11:58:27 | 2024-06-09 12:28:15 | 0:29:48 | 0:16:24 | 0:13:24 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
"2024-06-09T12:17:10.636078+0000 mon.smithi040 (mon.0) 121 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| fail | 7746439 |
|
2024-06-09 11:47:09 | 2024-06-09 11:59:27 | 2024-06-09 12:39:04 | 0:39:37 | 0:28:15 | 0:11:22 | smithi | main | ubuntu | 22.04 | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| fail | 7746440 |
|
2024-06-09 11:47:10 | 2024-06-09 11:59:58 | 2024-06-09 12:29:16 | 0:29:18 | 0:17:12 | 0:12:06 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
"2024-06-09T12:18:11.030114+0000 mon.smithi045 (mon.0) 121 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
| dead | 7746441 |
|
2024-06-09 11:47:11 | 2024-06-09 11:59:58 | 2024-06-09 12:01:32 | 0:01:34 | smithi | main | ubuntu | 22.04 | rados/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi161 |
||||||||||||||
| fail | 7746442 |
|
2024-06-09 11:47:12 | 2024-06-09 12:00:28 | 2024-06-09 12:36:07 | 0:35:39 | 0:24:02 | 0:11:37 | smithi | main | centos | 9.stream | rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} | 1 |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
| fail | 7746443 |
|
2024-06-09 11:47:13 | 2024-06-09 12:00:29 | 2024-06-09 12:41:58 | 0:41:29 | 0:29:53 | 0:11:36 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} | 2 |
Failure Reason:
valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun |
||||||||||||||
| fail | 7746444 |
|
2024-06-09 11:47:14 | 2024-06-09 12:01:09 | 2024-06-09 12:21:18 | 0:20:09 | 0:07:11 | 0:12:58 | smithi | main | centos | 9.stream | rados/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
Command failed on smithi098 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b1666dea20d5174cedbc48a829788e9546305dff shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 50f1662c-265a-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/nvme4n1' |
||||||||||||||
| pass | 7746445 |
|
2024-06-09 11:47:15 | 2024-06-09 12:04:20 | 2024-06-09 12:44:45 | 0:40:25 | 0:25:12 | 0:15:13 | smithi | main | ubuntu | 22.04 | rados/thrash-erasure-code-crush-4-nodes/{arch/x86_64 ceph mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=8-m=6-crush} | 4 |
| fail | 7746446 |
|
2024-06-09 11:47:16 | 2024-06-09 12:07:11 | 2024-06-09 12:39:09 | 0:31:58 | 0:21:31 | 0:10:27 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} | 2 |
Failure Reason:
"2024-06-09T12:37:27.483805+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 7746447 |
|
2024-06-09 11:47:18 | 2024-06-09 12:07:51 | 2024-06-09 12:14:47 | 0:06:56 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} | 3 | ||
Failure Reason:
Command failed on smithi038 with status 1: 'sudo yum install -y kernel' |
||||||||||||||
| fail | 7746448 |
|
2024-06-09 11:47:19 | 2024-06-09 12:08:02 | 2024-06-09 12:45:37 | 0:37:35 | 0:27:58 | 0:09:37 | smithi | main | centos | 9.stream | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| fail | 7746449 |
|
2024-06-09 11:47:20 | 2024-06-09 12:08:12 | 2024-06-09 12:15:50 | 0:07:38 | smithi | main | centos | 8.stream | rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} | 3 | ||
Failure Reason:
Command failed on smithi077 with status 1: 'sudo yum install -y kernel' |
||||||||||||||
| fail | 7746450 |
|
2024-06-09 11:47:21 | 2024-06-09 12:08:12 | 2024-06-09 18:38:39 | 6:30:27 | 6:21:03 | 0:09:24 | smithi | main | centos | 9.stream | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi104 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c821233d097eb6eb4287bbd1d0b6d01638e5f90 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 7746451 |
|
2024-06-09 11:47:22 | 2024-06-09 12:45:43 | 2024-06-09 13:14:11 | 0:28:28 | 0:16:22 | 0:12:06 | smithi | main | centos | 9.stream | rados/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
"2024-06-09T13:02:42.549949+0000 mon.smithi174 (mon.0) 121 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log |
||||||||||||||
Pulpito