Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7625880 2024-03-27 08:06:13 2024-03-27 08:07:01 2024-03-27 08:44:01 0:37:00 0:27:08 0:09:52 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} 2
Failure Reason:

"2024-03-27T08:41:44.889929+0000 mon.a (mon.0) 1353 : cluster [ERR] Health check failed: 41 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625881 2024-03-27 08:06:13 2024-03-27 08:07:02 2024-03-27 08:47:08 0:40:06 0:27:13 0:12:53 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} 2
Failure Reason:

"2024-03-27T08:44:49.053526+0000 mon.a (mon.0) 1351 : cluster [ERR] Health check failed: 41 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625882 2024-03-27 08:06:14 2024-03-27 08:08:02 2024-03-27 09:05:27 0:57:25 0:46:28 0:10:57 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} 1
pass 7625883 2024-03-27 08:06:14 2024-03-27 08:08:03 2024-03-27 09:02:58 0:54:55 0:46:09 0:08:46 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} 1
pass 7625884 2024-03-27 08:06:16 2024-03-27 08:08:03 2024-03-27 08:27:32 0:19:29 0:10:44 0:08:45 smithi main centos 9.stream crimson-rados/singleton/{all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/bluestore rados} 1
pass 7625885 2024-03-27 08:06:16 2024-03-27 08:08:44 2024-03-27 08:27:37 0:18:53 0:10:06 0:08:47 smithi main centos 9.stream crimson-rados/singleton/{all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/bluestore rados} 1
fail 7625886 2024-03-27 08:06:17 2024-03-27 08:08:44 2024-03-27 08:38:28 0:29:44 0:17:17 0:12:27 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

Command failed on smithi037 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 7625887 2024-03-27 08:06:17 2024-03-27 08:11:35 2024-03-27 08:36:34 0:24:59 0:15:15 0:09:44 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7625888 2024-03-27 08:06:18 2024-03-27 08:11:35 2024-03-27 08:50:00 0:38:25 0:26:38 0:11:47 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7625889 2024-03-27 08:06:18 2024-03-27 08:12:56 2024-03-27 08:51:40 0:38:44 0:27:17 0:11:27 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
fail 7625890 2024-03-27 08:06:20 2024-03-27 08:14:36 2024-03-27 08:43:23 0:28:47 0:19:05 0:09:42 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2024-03-27T08:41:04.783057+0000 mon.a (mon.0) 427 : cluster [ERR] Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625891 2024-03-27 08:06:20 2024-03-27 08:14:37 2024-03-27 08:43:13 0:28:36 0:19:47 0:08:49 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2024-03-27T08:41:55.073245+0000 mon.a (mon.0) 436 : cluster [ERR] Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625892 2024-03-27 08:06:21 2024-03-27 08:14:37 2024-03-27 08:47:32 0:32:55 0:24:19 0:08:36 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7625893 2024-03-27 08:06:21 2024-03-27 08:14:37 2024-03-27 08:48:11 0:33:34 0:24:02 0:09:32 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
pass 7625894 2024-03-27 08:06:23 2024-03-27 08:15:08 2024-03-27 08:52:37 0:37:29 0:26:22 0:11:07 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} 2
pass 7625895 2024-03-27 08:06:23 2024-03-27 08:15:18 2024-03-27 08:52:21 0:37:03 0:26:17 0:10:46 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} 2
pass 7625896 2024-03-27 08:06:24 2024-03-27 08:17:09 2024-03-27 08:41:11 0:24:02 0:13:15 0:10:47 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_python} 2
pass 7625897 2024-03-27 08:06:24 2024-03-27 08:17:59 2024-03-27 08:41:02 0:23:03 0:13:14 0:09:49 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_python} 2
fail 7625898 2024-03-27 08:06:26 2024-03-27 08:18:00 2024-03-27 08:39:49 0:21:49 0:12:01 0:09:48 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_cls_tests} 1
Failure Reason:

"2024-03-27T08:38:57.344336+0000 mon.a (mon.0) 214 : cluster [ERR] Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625899 2024-03-27 08:06:26 2024-03-27 08:20:07 2024-03-27 08:44:45 0:24:38 0:11:32 0:13:06 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_cls_tests} 1
Failure Reason:

"2024-03-27T08:43:14.233507+0000 mon.a (mon.0) 210 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625900 2024-03-27 08:06:27 2024-03-27 08:26:29 2024-03-27 08:56:32 0:30:03 0:19:29 0:10:34 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 7625901 2024-03-27 08:06:27 2024-03-27 08:27:19 2024-03-27 08:56:14 0:28:55 0:20:30 0:08:25 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 7625902 2024-03-27 08:06:28 2024-03-27 08:27:30 2024-03-27 08:56:34 0:29:04 0:19:07 0:09:57 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 7625903 2024-03-27 08:06:28 2024-03-27 08:27:40 2024-03-27 08:59:23 0:31:43 0:20:02 0:11:41 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-localized} 2
fail 7625904 2024-03-27 08:06:30 2024-03-27 08:28:21 2024-03-27 08:47:34 0:19:13 0:09:54 0:09:19 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence} 1
Failure Reason:

"2024-03-27T08:46:06.843999+0000 mon.a (mon.0) 143 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625905 2024-03-27 08:06:30 2024-03-27 08:28:41 2024-03-27 08:50:14 0:21:33 0:10:19 0:11:14 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence} 1
Failure Reason:

"2024-03-27T08:48:42.056205+0000 mon.a (mon.0) 137 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625906 2024-03-27 08:06:31 2024-03-27 08:28:41 2024-03-27 09:00:25 0:31:44 0:19:43 0:12:01 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} 2
pass 7625907 2024-03-27 08:06:31 2024-03-27 08:28:42 2024-03-27 08:58:11 0:29:29 0:19:03 0:10:26 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} 2
pass 7625908 2024-03-27 08:06:33 2024-03-27 08:29:02 2024-03-27 09:09:11 0:40:09 0:28:23 0:11:46 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7625909 2024-03-27 08:06:33 2024-03-27 08:30:13 2024-03-27 09:06:55 0:36:42 0:28:15 0:08:27 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
fail 7625910 2024-03-27 08:06:34 2024-03-27 08:30:13 2024-03-27 08:53:03 0:22:50 0:13:06 0:09:44 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/readwrite} 2
Failure Reason:

"2024-03-27T08:51:01.097945+0000 mon.a (mon.0) 160 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625911 2024-03-27 08:06:34 2024-03-27 08:30:13 2024-03-27 08:53:23 0:23:10 0:13:21 0:09:49 smithi main centos 9.stream crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/readwrite} 2
Failure Reason:

"2024-03-27T08:51:36.431145+0000 mon.a (mon.0) 170 : cluster [ERR] Health check failed: 5 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625912 2024-03-27 08:06:35 2024-03-27 08:30:14 2024-03-27 09:03:21 0:33:07 0:23:30 0:09:37 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests} 1
Failure Reason:

"2024-03-27T09:02:02.856774+0000 mon.a (mon.0) 766 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625913 2024-03-27 08:06:35 2024-03-27 08:30:14 2024-03-27 09:10:08 0:39:54 0:24:38 0:15:16 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests} 1
fail 7625914 2024-03-27 08:06:37 2024-03-27 08:33:25 2024-03-27 09:19:40 0:46:15 0:33:28 0:12:47 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

Command failed on smithi046 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats'

fail 7625915 2024-03-27 08:06:37 2024-03-27 08:36:36 2024-03-27 09:21:12 0:44:36 0:33:19 0:11:17 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

Command failed on smithi007 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats'

pass 7625916 2024-03-27 08:06:38 2024-03-27 08:38:26 2024-03-27 09:16:43 0:38:17 0:27:08 0:11:09 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 7625917 2024-03-27 08:06:38 2024-03-27 08:39:57 2024-03-27 09:17:27 0:37:30 0:26:57 0:10:33 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} 2
fail 7625918 2024-03-27 08:06:39 2024-03-27 08:40:17 2024-03-27 09:11:30 0:31:13 0:20:30 0:10:43 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2024-03-27T09:09:15.038353+0000 mon.a (mon.0) 669 : cluster [ERR] Health check failed: 9 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

fail 7625919 2024-03-27 08:06:40 2024-03-27 08:40:18 2024-03-27 09:11:50 0:31:32 0:20:18 0:11:14 smithi main centos 9.stream crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2024-03-27T09:09:32.817031+0000 mon.a (mon.0) 673 : cluster [ERR] Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS)" in cluster log

pass 7625920 2024-03-27 08:06:41 2024-03-27 08:40:28 2024-03-27 09:05:46 0:25:18 0:14:22 0:10:56 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7625921 2024-03-27 08:06:41 2024-03-27 08:40:28 2024-03-27 09:06:12 0:25:44 0:14:44 0:11:00 smithi main centos 9.stream crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2