User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
---|---|---|---|---|---|---|---|---|---|---|
rfriedma | 2022-10-18 19:19:45 | 2022-10-18 19:34:29 | 2022-10-18 23:22:29 | 3:48:00 | rados:thrash | wip-rf-slow-replica | smithi | 223478c | 19 | 5 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 7073277 | 2022-10-18 19:25:54 | 2022-10-18 19:26:48 | 2022-10-18 19:56:04 | 0:29:16 | 0:12:22 | 0:16:54 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} | 2 | |
fail | 7073278 | 2022-10-18 19:25:55 | 2022-10-18 19:34:29 | 2022-10-18 20:19:59 | 0:45:30 | 0:38:42 | 0:06:48 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=223478c5c9f1ef4cad9214ca07a919f120fdc55d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
pass | 7073279 | 2022-10-18 19:25:57 | 2022-10-18 19:34:30 | 2022-10-18 20:10:39 | 0:36:09 | 0:26:32 | 0:09:37 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 | |
pass | 7073280 | 2022-10-18 19:25:59 | 2022-10-18 19:37:00 | 2022-10-18 20:11:51 | 0:34:51 | 0:23:24 | 0:11:27 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} | 2 | |
fail | 7073281 | 2022-10-18 19:26:01 | 2022-10-18 19:38:31 | 2022-10-18 20:18:37 | 0:40:06 | 0:32:09 | 0:07:57 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
Failure Reason:
"1666122833.4019043 osd.5 (osd.5) 27 : cluster [WRN] osd.5 ep: 136 scrubber::ReplicaReservations pg[3.28]: timeout on replica reservations (since 2022-10-18 19:53:51)" in cluster log |
||||||||||||||
pass | 7073282 | 2022-10-18 19:26:02 | 2022-10-18 19:39:11 | 2022-10-18 20:18:01 | 0:38:50 | 0:27:50 | 0:11:00 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} | 2 | |
pass | 7073283 | 2022-10-18 19:26:04 | 2022-10-18 19:43:12 | 2022-10-18 20:11:07 | 0:27:55 | 0:20:59 | 0:06:56 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 7073284 | 2022-10-18 19:26:05 | 2022-10-18 19:43:43 | 2022-10-18 20:08:35 | 0:24:52 | 0:12:55 | 0:11:57 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7073285 | 2022-10-18 19:26:07 | 2022-10-18 19:45:03 | 2022-10-18 20:25:41 | 0:40:38 | 0:34:03 | 0:06:35 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} | 2 | |
pass | 7073286 | 2022-10-18 19:26:09 | 2022-10-18 19:45:04 | 2022-10-18 20:05:01 | 0:19:57 | 0:11:49 | 0:08:08 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} | 2 | |
pass | 7073287 | 2022-10-18 19:26:10 | 2022-10-18 19:46:04 | 2022-10-18 20:09:36 | 0:23:32 | 0:12:59 | 0:10:33 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} | 2 | |
pass | 7073288 | 2022-10-18 19:26:12 | 2022-10-18 19:46:15 | 2022-10-18 20:29:31 | 0:43:16 | 0:35:53 | 0:07:23 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
fail | 7073289 | 2022-10-18 19:26:14 | 2022-10-18 19:46:25 | 2022-10-18 20:44:49 | 0:58:24 | 0:47:26 | 0:10:58 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
"1666123658.0405319 osd.7 (osd.7) 19 : cluster [WRN] osd.7 ep: 245 scrubber::ReplicaReservations pg[16.e]: timeout on replica reservations (since 2022-10-18 20:07:36)" in cluster log |
||||||||||||||
pass | 7073290 | 2022-10-18 19:26:15 | 2022-10-18 19:49:46 | 2022-10-18 20:18:50 | 0:29:04 | 0:22:27 | 0:06:37 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} | 2 | |
fail | 7073291 | 2022-10-18 19:26:17 | 2022-10-18 19:49:46 | 2022-10-18 20:31:19 | 0:41:33 | 0:33:25 | 0:08:08 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} | 2 | |
Failure Reason:
"1666124692.0944474 osd.0 (osd.0) 624 : cluster [WRN] osd.0 ep: 876 scrubber::ReplicaReservations pg[3.1]: timeout on replica reservations (since 2022-10-18 20:24:50)" in cluster log |
||||||||||||||
pass | 7073292 | 2022-10-18 19:26:19 | 2022-10-18 19:52:17 | 2022-10-18 20:15:52 | 0:23:35 | 0:12:46 | 0:10:49 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7073293 | 2022-10-18 19:26:20 | 2022-10-18 19:52:28 | 2022-10-18 20:17:35 | 0:25:07 | 0:15:29 | 0:09:38 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 7073294 | 2022-10-18 19:26:22 | 2022-10-18 19:52:28 | 2022-10-18 20:36:58 | 0:44:30 | 0:36:43 | 0:07:47 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
fail | 7073295 | 2022-10-18 19:26:24 | 2022-10-18 19:52:48 | 2022-10-18 23:22:29 | 3:29:41 | 3:22:22 | 0:07:19 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi116 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=223478c5c9f1ef4cad9214ca07a919f120fdc55d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
pass | 7073296 | 2022-10-18 19:26:25 | 2022-10-18 19:53:29 | 2022-10-18 20:21:17 | 0:27:48 | 0:21:18 | 0:06:30 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} | 2 | |
pass | 7073297 | 2022-10-18 19:26:27 | 2022-10-18 19:54:10 | 2022-10-18 20:37:32 | 0:43:22 | 0:35:55 | 0:07:27 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
pass | 7073298 | 2022-10-18 19:26:29 | 2022-10-18 19:54:30 | 2022-10-18 20:27:58 | 0:33:28 | 0:26:30 | 0:06:58 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench} | 2 | |
pass | 7073299 | 2022-10-18 19:26:30 | 2022-10-18 19:55:21 | 2022-10-18 20:20:01 | 0:24:40 | 0:12:51 | 0:11:49 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 7073300 | 2022-10-18 19:26:32 | 2022-10-18 19:55:51 | 2022-10-18 20:21:20 | 0:25:29 | 0:18:03 | 0:07:26 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} | 2 |