| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| rfriedma | 2022-09-21 06:47:34 | 2022-09-21 07:16:12 | 2022-09-21 20:03:04 | 12:46:52 | rados:thrash | wip-rf-tout | smithi | 6305285 | 20 | 25 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7039817 |
|
2022-09-21 06:49:22 | 2022-09-21 07:16:12 | 2022-09-21 09:07:13 | 1:51:01 | 1:42:08 | 0:08:53 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
reached maximum tries (800) after waiting for 4800 seconds |
||||||||||||||
| dead | 7039818 |
|
2022-09-21 06:49:23 | 2022-09-21 07:16:12 | 2022-09-21 19:29:39 | 12:13:27 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039819 |
|
2022-09-21 06:49:25 | 2022-09-21 07:16:12 | 2022-09-21 07:57:35 | 0:41:23 | 0:26:26 | 0:14:57 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
Command failed on smithi043 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3' |
||||||||||||||
| dead | 7039820 |
|
2022-09-21 06:49:26 | 2022-09-21 07:16:32 | 2022-09-21 19:31:58 | 12:15:26 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039821 |
|
2022-09-21 06:49:28 | 2022-09-21 07:16:33 | 2022-09-21 19:32:26 | 12:15:53 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039822 |
|
2022-09-21 06:49:29 | 2022-09-21 07:16:53 | 2022-09-21 07:51:45 | 0:34:52 | 0:19:04 | 0:15:48 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op snap_create 10 --op snap_remove 10 --op rollback 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0' |
||||||||||||||
| fail | 7039823 |
|
2022-09-21 06:49:30 | 2022-09-21 07:17:23 | 2022-09-21 10:47:08 | 3:29:45 | 3:18:44 | 0:11:01 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi079 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6305285498299a3c7e152fb8c6764cc90fea22e5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| dead | 7039824 |
|
2022-09-21 06:49:32 | 2022-09-21 07:17:33 | 2022-09-21 19:32:20 | 12:14:47 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039825 |
|
2022-09-21 06:49:34 | 2022-09-21 07:17:44 | 2022-09-21 19:34:19 | 12:16:35 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039826 |
|
2022-09-21 06:49:35 | 2022-09-21 07:18:14 | 2022-09-21 19:32:48 | 12:14:34 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039827 |
|
2022-09-21 06:49:37 | 2022-09-21 07:18:14 | 2022-09-21 08:13:59 | 0:55:45 | 0:36:00 | 0:19:45 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
Command failed on smithi093 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' |
||||||||||||||
| fail | 7039828 |
|
2022-09-21 06:49:38 | 2022-09-21 07:18:14 | 2022-09-21 07:57:29 | 0:39:15 | 0:21:45 | 0:17:30 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
Command failed on smithi078 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0' |
||||||||||||||
| fail | 7039829 |
|
2022-09-21 06:49:40 | 2022-09-21 07:18:25 | 2022-09-21 07:47:57 | 0:29:32 | 0:14:06 | 0:15:26 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
Command failed on smithi130 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0' |
||||||||||||||
| fail | 7039830 |
|
2022-09-21 06:49:41 | 2022-09-21 07:20:05 | 2022-09-21 08:40:40 | 1:20:35 | 1:07:39 | 0:12:56 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
reached maximum tries (500) after waiting for 3000 seconds |
||||||||||||||
| dead | 7039831 |
|
2022-09-21 06:49:43 | 2022-09-21 07:20:25 | 2022-09-21 19:38:31 | 12:18:06 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039832 |
|
2022-09-21 06:49:44 | 2022-09-21 07:20:55 | 2022-09-21 19:37:36 | 12:16:41 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039833 |
|
2022-09-21 06:49:46 | 2022-09-21 07:21:46 | 2022-09-21 19:39:39 | 12:17:53 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039834 |
|
2022-09-21 06:49:47 | 2022-09-21 07:23:37 | 2022-09-21 19:44:00 | 12:20:23 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039835 |
|
2022-09-21 06:49:49 | 2022-09-21 07:25:38 | 2022-09-21 09:13:25 | 1:47:47 | 1:39:20 | 0:08:27 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
reached maximum tries (800) after waiting for 4800 seconds |
||||||||||||||
| fail | 7039836 |
|
2022-09-21 06:49:50 | 2022-09-21 07:25:38 | 2022-09-21 07:53:37 | 0:27:59 | 0:15:28 | 0:12:31 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
Command failed on smithi143 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4' |
||||||||||||||
| dead | 7039837 |
|
2022-09-21 06:49:52 | 2022-09-21 07:25:39 | 2022-09-21 19:42:46 | 12:17:07 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039838 |
|
2022-09-21 06:49:54 | 2022-09-21 07:26:29 | 2022-09-21 10:54:28 | 3:27:59 | 3:16:08 | 0:11:51 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi088 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6305285498299a3c7e152fb8c6764cc90fea22e5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 7039839 |
|
2022-09-21 06:49:55 | 2022-09-21 07:26:40 | 2022-09-21 08:48:06 | 1:21:26 | 1:04:47 | 0:16:39 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
reached maximum tries (500) after waiting for 3000 seconds |
||||||||||||||
| fail | 7039840 |
|
2022-09-21 06:49:57 | 2022-09-21 07:28:41 | 2022-09-21 08:48:17 | 1:19:36 | 1:08:20 | 0:11:16 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
reached maximum tries (500) after waiting for 3000 seconds |
||||||||||||||
| fail | 7039841 |
|
2022-09-21 06:49:59 | 2022-09-21 07:30:22 | 2022-09-21 08:00:21 | 0:29:59 | 0:13:17 | 0:16:42 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} | 2 |
Failure Reason:
Command failed on smithi116 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1' |
||||||||||||||
| dead | 7039842 |
|
2022-09-21 06:50:00 | 2022-09-21 07:30:22 | 2022-09-21 19:46:52 | 12:16:30 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039843 |
|
2022-09-21 06:50:02 | 2022-09-21 07:30:53 | 2022-09-21 19:47:48 | 12:16:55 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039844 |
|
2022-09-21 06:50:04 | 2022-09-21 07:30:53 | 2022-09-21 19:49:51 | 12:18:58 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039845 |
|
2022-09-21 06:50:06 | 2022-09-21 07:32:33 | 2022-09-21 19:50:43 | 12:18:10 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039846 |
|
2022-09-21 06:50:08 | 2022-09-21 07:33:04 | 2022-09-21 08:01:50 | 0:28:46 | 0:19:18 | 0:09:28 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
Command failed on smithi017 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0' |
||||||||||||||
| dead | 7039847 |
|
2022-09-21 06:50:10 | 2022-09-21 07:33:04 | 2022-09-21 19:50:22 | 12:17:18 | smithi | main | centos | 8.stream | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039848 |
|
2022-09-21 06:50:11 | 2022-09-21 07:33:14 | 2022-09-21 19:51:24 | 12:18:10 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039849 |
|
2022-09-21 06:50:13 | 2022-09-21 07:33:54 | 2022-09-21 19:57:31 | 12:23:37 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/dedup-io-snaps} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039850 |
|
2022-09-21 06:50:14 | 2022-09-21 07:34:25 | 2022-09-21 19:52:14 | 12:17:49 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039851 |
|
2022-09-21 06:50:16 | 2022-09-21 07:34:46 | 2022-09-21 11:06:05 | 3:31:19 | 3:18:14 | 0:13:05 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6305285498299a3c7e152fb8c6764cc90fea22e5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 7039852 |
|
2022-09-21 06:50:17 | 2022-09-21 07:37:56 | 2022-09-21 09:23:15 | 1:45:19 | 1:29:56 | 0:15:23 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
Command failed on smithi036 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4' |
||||||||||||||
| fail | 7039853 |
|
2022-09-21 06:50:19 | 2022-09-21 07:38:16 | 2022-09-21 08:16:10 | 0:37:54 | 0:25:48 | 0:12:06 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
Command failed on smithi112 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4' |
||||||||||||||
| dead | 7039854 |
|
2022-09-21 06:50:21 | 2022-09-21 07:38:47 | 2022-09-21 19:59:44 | 12:20:57 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039855 |
|
2022-09-21 06:50:23 | 2022-09-21 07:38:57 | 2022-09-21 19:59:48 | 12:20:51 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039856 |
|
2022-09-21 06:50:25 | 2022-09-21 07:41:18 | 2022-09-21 20:01:16 | 12:19:58 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039857 |
|
2022-09-21 06:50:26 | 2022-09-21 07:41:38 | 2022-09-21 20:01:18 | 12:19:40 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 7039858 |
|
2022-09-21 06:50:28 | 2022-09-21 07:41:38 | 2022-09-21 20:00:59 | 12:19:21 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7039859 |
|
2022-09-21 06:50:30 | 2022-09-21 07:41:59 | 2022-09-21 08:17:06 | 0:35:07 | 0:22:24 | 0:12:43 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
Command failed on smithi063 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2' |
||||||||||||||
| fail | 7039860 |
|
2022-09-21 06:50:32 | 2022-09-21 07:42:39 | 2022-09-21 09:05:08 | 1:22:29 | 1:08:45 | 0:13:44 | smithi | main | ubuntu | 20.04 | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
reached maximum tries (500) after waiting for 3000 seconds |
||||||||||||||
| dead | 7039861 |
|
2022-09-21 06:50:34 | 2022-09-21 07:43:29 | 2022-09-21 20:03:04 | 12:19:35 | smithi | main | rhel | 8.6 | rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
Pulpito