User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
---|---|---|---|---|---|---|---|---|---|---|
rfriedma | 2022-10-20 20:19:00 | 2022-10-20 20:23:56 | 2022-10-20 23:03:27 | 2:39:31 | rados:thrash | wip-rf-tous1 | smithi | ee31f5c | 33 | 5 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 7076847 | 2022-10-20 20:20:40 | 2022-10-20 20:23:56 | 2022-10-20 21:15:49 | 0:51:53 | 0:45:07 | 0:06:46 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7076848 | 2022-10-20 20:20:41 | 2022-10-20 20:24:46 | 2022-10-20 20:54:21 | 0:29:35 | 0:22:50 | 0:06:45 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} | 2 | |
pass | 7076849 | 2022-10-20 20:20:42 | 2022-10-20 20:25:07 | 2022-10-20 20:58:05 | 0:32:58 | 0:22:08 | 0:10:50 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} | 2 | |
fail | 7076850 | 2022-10-20 20:20:44 | 2022-10-20 20:28:58 | 2022-10-20 21:01:52 | 0:32:54 | 0:25:32 | 0:07:22 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps} | 2 | |
Failure Reason:
"1666298792.3716264 osd.5 (osd.5) 23 : cluster [WRN] look_for_stuck_scrubs: replica-scrub timed out on pg[3.2] (requested by 3.2 @ 2022-10-20 20:46:26)" in cluster log |
||||||||||||||
pass | 7076851 | 2022-10-20 20:20:45 | 2022-10-20 20:28:58 | 2022-10-20 20:48:14 | 0:19:16 | 0:13:13 | 0:06:03 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7076852 | 2022-10-20 20:20:46 | 2022-10-20 20:28:58 | 2022-10-20 20:53:08 | 0:24:10 | 0:13:59 | 0:10:11 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} | 2 | |
pass | 7076853 | 2022-10-20 20:20:48 | 2022-10-20 20:31:49 | 2022-10-20 21:46:59 | 1:15:10 | 1:04:03 | 0:11:07 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} | 2 | |
pass | 7076854 | 2022-10-20 20:20:49 | 2022-10-20 20:35:40 | 2022-10-20 20:59:20 | 0:23:40 | 0:15:55 | 0:07:45 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 7076855 | 2022-10-20 20:20:50 | 2022-10-20 20:36:20 | 2022-10-20 21:10:36 | 0:34:16 | 0:25:49 | 0:08:27 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} | 2 | |
pass | 7076856 | 2022-10-20 20:20:52 | 2022-10-20 20:37:11 | 2022-10-20 21:09:10 | 0:31:59 | 0:24:46 | 0:07:13 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} | 2 | |
pass | 7076857 | 2022-10-20 20:20:53 | 2022-10-20 20:38:11 | 2022-10-20 21:15:43 | 0:37:32 | 0:27:49 | 0:09:43 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 | |
pass | 7076858 | 2022-10-20 20:20:54 | 2022-10-20 20:38:12 | 2022-10-20 21:22:03 | 0:43:51 | 0:34:38 | 0:09:13 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
fail | 7076859 | 2022-10-20 20:20:56 | 2022-10-20 20:40:23 | 2022-10-20 21:12:33 | 0:32:10 | 0:21:37 | 0:10:33 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} | 2 | |
Failure Reason:
"1666299789.380777 osd.3 (osd.3) 178 : cluster [WRN] look_for_stuck_scrubs: replica-scrub timed out on pg[4.2] (requested by 4.2 @ 2022-10-20 21:03:03)" in cluster log |
||||||||||||||
pass | 7076860 | 2022-10-20 20:20:57 | 2022-10-20 20:40:43 | 2022-10-20 21:10:28 | 0:29:45 | 0:18:07 | 0:11:38 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} | 2 | |
pass | 7076861 | 2022-10-20 20:20:58 | 2022-10-20 20:45:04 | 2022-10-20 21:10:07 | 0:25:03 | 0:11:05 | 0:13:58 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7076862 | 2022-10-20 20:20:59 | 2022-10-20 20:48:15 | 2022-10-20 21:34:32 | 0:46:17 | 0:35:12 | 0:11:05 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} | 2 | |
pass | 7076863 | 2022-10-20 20:21:01 | 2022-10-20 20:53:16 | 2022-10-20 21:15:32 | 0:22:16 | 0:14:07 | 0:08:09 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 7076864 | 2022-10-20 20:21:02 | 2022-10-20 20:54:26 | 2022-10-20 21:21:26 | 0:27:00 | 0:16:19 | 0:10:41 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 7076865 | 2022-10-20 20:21:03 | 2022-10-20 20:58:07 | 2022-10-20 21:32:22 | 0:34:15 | 0:26:03 | 0:08:12 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} | 2 | |
pass | 7076866 | 2022-10-20 20:21:05 | 2022-10-20 20:59:28 | 2022-10-20 21:30:57 | 0:31:29 | 0:22:25 | 0:09:04 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} | 2 | |
pass | 7076867 | 2022-10-20 20:21:06 | 2022-10-20 21:01:58 | 2022-10-20 21:37:00 | 0:35:02 | 0:23:02 | 0:12:00 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} | 2 | |
pass | 7076868 | 2022-10-20 20:21:07 | 2022-10-20 21:08:00 | 2022-10-20 21:40:20 | 0:32:20 | 0:24:36 | 0:07:44 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} | 2 | |
pass | 7076869 | 2022-10-20 20:21:09 | 2022-10-20 21:09:20 | 2022-10-20 21:39:29 | 0:30:09 | 0:22:33 | 0:07:36 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
pass | 7076870 | 2022-10-20 20:21:10 | 2022-10-20 21:10:11 | 2022-10-20 21:31:59 | 0:21:48 | 0:14:35 | 0:07:13 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7076871 | 2022-10-20 20:21:11 | 2022-10-20 21:10:31 | 2022-10-20 21:48:01 | 0:37:30 | 0:31:23 | 0:06:07 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench} | 2 | |
pass | 7076872 | 2022-10-20 20:21:13 | 2022-10-20 21:10:41 | 2022-10-20 21:50:40 | 0:39:59 | 0:30:45 | 0:09:14 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} | 2 | |
pass | 7076873 | 2022-10-20 20:21:14 | 2022-10-20 21:11:32 | 2022-10-20 21:34:00 | 0:22:28 | 0:15:13 | 0:07:15 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} | 2 | |
pass | 7076874 | 2022-10-20 20:21:15 | 2022-10-20 21:12:42 | 2022-10-20 21:43:02 | 0:30:20 | 0:17:36 | 0:12:44 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 7076875 | 2022-10-20 20:21:16 | 2022-10-20 21:15:33 | 2022-10-20 21:47:25 | 0:31:52 | 0:21:00 | 0:10:52 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} | 2 | |
fail | 7076876 | 2022-10-20 20:21:18 | 2022-10-20 21:15:44 | 2022-10-20 21:49:17 | 0:33:33 | 0:22:45 | 0:10:48 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} | 2 | |
Failure Reason:
"1666301780.483673 osd.7 (osd.7) 145 : cluster [WRN] look_for_stuck_scrubs: replica-scrub timed out on pg[4.0] (requested by 4.0 @ 2022-10-20 21:36:14)" in cluster log |
||||||||||||||
pass | 7076877 | 2022-10-20 20:21:19 | 2022-10-20 21:15:54 | 2022-10-20 21:48:54 | 0:33:00 | 0:20:24 | 0:12:36 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} | 2 | |
pass | 7076878 | 2022-10-20 20:21:20 | 2022-10-20 21:21:35 | 2022-10-20 21:43:48 | 0:22:13 | 0:15:34 | 0:06:39 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} | 2 | |
fail | 7076879 | 2022-10-20 20:21:22 | 2022-10-20 21:22:05 | 2022-10-20 21:52:39 | 0:30:34 | 0:11:58 | 0:18:36 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} | 2 | |
Failure Reason:
Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op snap_create 10 --op snap_remove 10 --op rollback 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0' |
||||||||||||||
fail | 7076880 | 2022-10-20 20:21:23 | 2022-10-20 21:31:07 | 2022-10-20 22:11:33 | 0:40:26 | 0:33:18 | 0:07:08 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
Failure Reason:
"1666303064.2322917 osd.6 (osd.6) 342 : cluster [WRN] look_for_stuck_scrubs: replica-scrub timed out on pg[3.5] (requested by 3.5 @ 2022-10-20 21:57:33)" in cluster log |
||||||||||||||
pass | 7076881 | 2022-10-20 20:21:24 | 2022-10-20 21:32:08 | 2022-10-20 23:03:27 | 1:31:19 | 1:24:01 | 0:07:18 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} | 2 | |
pass | 7076882 | 2022-10-20 20:21:25 | 2022-10-20 21:32:28 | 2022-10-20 21:57:36 | 0:25:08 | 0:16:48 | 0:08:20 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} | 2 | |
pass | 7076883 | 2022-10-20 20:21:27 | 2022-10-20 21:34:09 | 2022-10-20 22:02:13 | 0:28:04 | 0:18:40 | 0:09:24 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} | 2 | |
pass | 7076884 | 2022-10-20 20:21:28 | 2022-10-20 21:34:39 | 2022-10-20 22:10:10 | 0:35:31 | 0:26:27 | 0:09:04 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} | 2 |