| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| sage | 2021-11-25 14:18:24 | 2021-11-25 14:20:00 | 2021-11-26 07:56:35 | 17:36:35 | rados | wip-sage3-testing-2021-11-24-1439 | smithi | 7660f57 | 63 | 480 | 2 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 6525326 |
|
2021-11-25 14:18:48 | 2021-11-25 14:19:58 | 2021-11-25 14:54:09 | 0:34:11 | 0:22:32 | 0:11:39 | smithi | master | centos | 8.2 | rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525327 |
|
2021-11-25 14:18:49 | 2021-11-25 14:19:58 | 2021-11-25 14:59:20 | 0:39:22 | 0:26:38 | 0:12:44 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T14:45:42.585181+0000 mgr.y (mgr.4107) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525328 |
|
2021-11-25 14:18:50 | 2021-11-25 14:19:58 | 2021-11-25 14:51:50 | 0:31:52 | 0:22:51 | 0:09:01 | smithi | master | rhel | 8.4 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/prometheus} | 2 |
Failure Reason:
Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) |
||||||||||||||
| fail | 6525329 |
|
2021-11-25 14:18:51 | 2021-11-25 14:19:59 | 2021-11-25 15:01:56 | 0:41:57 | 0:29:21 | 0:12:36 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525330 |
|
2021-11-25 14:18:51 | 2021-11-25 14:19:59 | 2021-11-25 15:02:12 | 0:42:13 | 0:30:16 | 0:11:57 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T14:45:31.024543+0000 mgr.y (mgr.4107) 45 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525331 |
|
2021-11-25 14:18:52 | 2021-11-25 14:19:59 | 2021-11-25 14:54:06 | 0:34:07 | 0:20:43 | 0:13:24 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 2 |
Failure Reason:
"2021-11-25T14:38:32.769634+0000 mgr.x (mgr.4101) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525332 |
|
2021-11-25 14:18:53 | 2021-11-25 14:19:59 | 2021-11-25 15:08:24 | 0:48:25 | 0:37:31 | 0:10:54 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T14:45:45.363412+0000 mgr.x (mgr.4108) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525333 |
|
2021-11-25 14:18:54 | 2021-11-25 14:20:00 | 2021-11-25 14:46:16 | 0:26:16 | 0:15:32 | 0:10:44 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} | 1 | ||
| pass | 6525334 |
|
2021-11-25 14:18:55 | 2021-11-25 14:20:00 | 2021-11-25 14:39:45 | 0:19:45 | 0:10:30 | 0:09:15 | smithi | master | centos | 8.stream | rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} | 1 |
| fail | 6525335 |
|
2021-11-25 14:18:56 | 2021-11-25 14:20:10 | 2021-11-25 15:00:04 | 0:39:54 | 0:27:52 | 0:12:02 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T14:38:36.219418+0000 mgr.y (mgr.4106) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525336 |
|
2021-11-25 14:18:57 | 2021-11-25 14:20:21 | 2021-11-25 14:51:44 | 0:31:23 | 0:21:54 | 0:09:29 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525337 |
|
2021-11-25 14:18:58 | 2021-11-25 14:20:21 | 2021-11-25 14:58:13 | 0:37:52 | 0:28:47 | 0:09:05 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T14:49:53.632575+0000 mgr.y (mgr.4103) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525338 |
|
2021-11-25 14:18:59 | 2021-11-25 14:20:31 | 2021-11-25 15:08:49 | 0:48:18 | 0:34:42 | 0:13:36 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
| pass | 6525339 |
|
2021-11-25 14:19:00 | 2021-11-25 14:21:02 | 2021-11-25 14:46:50 | 0:25:48 | 0:12:22 | 0:13:26 | smithi | master | centos | 8.3 | rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} | 3 |
| fail | 6525340 |
|
2021-11-25 14:19:00 | 2021-11-25 14:22:32 | 2021-11-25 14:57:50 | 0:35:18 | 0:22:41 | 0:12:37 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T14:40:57.113651+0000 mgr.y (mgr.4098) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525341 |
|
2021-11-25 14:19:01 | 2021-11-25 14:22:43 | 2021-11-25 14:53:07 | 0:30:24 | 0:13:20 | 0:17:04 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 |
Failure Reason:
"2021-11-25T14:49:54.006267+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525342 |
|
2021-11-25 14:19:02 | 2021-11-25 14:29:24 | 2021-11-25 15:07:41 | 0:38:17 | 0:18:06 | 0:20:11 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525343 |
|
2021-11-25 14:19:03 | 2021-11-25 14:38:25 | 2021-11-25 15:11:55 | 0:33:30 | 0:19:31 | 0:13:59 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T15:00:29.349852+0000 mgr.x (mgr.4102) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525344 |
|
2021-11-25 14:19:04 | 2021-11-25 14:38:26 | 2021-11-25 16:46:22 | 2:07:56 | 1:55:47 | 0:12:09 | smithi | master | centos | 8.3 | rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} | 1 |
Failure Reason:
Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi173 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh' |
||||||||||||||
| fail | 6525345 |
|
2021-11-25 14:19:05 | 2021-11-25 14:39:16 | 2021-11-25 15:20:49 | 0:41:33 | 0:34:29 | 0:07:04 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T15:05:18.855119+0000 mgr.y (mgr.4100) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525346 |
|
2021-11-25 14:19:06 | 2021-11-25 14:39:16 | 2021-11-25 15:09:05 | 0:29:49 | 0:20:05 | 0:09:44 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525347 |
|
2021-11-25 14:19:06 | 2021-11-25 14:39:47 | 2021-11-25 15:12:50 | 0:33:03 | 0:25:03 | 0:08:00 | smithi | master | rhel | 8.4 | rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T15:06:53.927821+0000 mgr.x (mgr.4101) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525348 |
|
2021-11-25 14:19:07 | 2021-11-25 14:41:47 | 2021-11-25 15:27:25 | 0:45:38 | 0:35:57 | 0:09:41 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T15:10:25.049425+0000 mgr.x (mgr.4102) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525349 |
|
2021-11-25 14:19:08 | 2021-11-25 14:44:08 | 2021-11-25 15:11:45 | 0:27:37 | 0:16:18 | 0:11:19 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T15:06:03.248645+0000 mgr.x (mgr.4107) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525350 |
|
2021-11-25 14:19:09 | 2021-11-25 14:46:19 | 2021-11-25 15:20:43 | 0:34:24 | 0:22:52 | 0:11:32 | smithi | master | ubuntu | 20.04 | rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| fail | 6525351 |
|
2021-11-25 14:19:10 | 2021-11-25 14:46:59 | 2021-11-25 15:16:36 | 0:29:37 | 0:22:55 | 0:06:42 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525352 |
|
2021-11-25 14:19:11 | 2021-11-25 14:46:59 | 2021-11-25 15:36:30 | 0:49:31 | 0:41:47 | 0:07:44 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T15:13:43.274103+0000 mgr.x (mgr.4102) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525353 |
|
2021-11-25 14:19:12 | 2021-11-25 14:47:00 | 2021-11-25 15:26:48 | 0:39:48 | 0:25:52 | 0:13:56 | smithi | master | ubuntu | 20.04 | rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525354 |
|
2021-11-25 14:19:13 | 2021-11-25 14:51:00 | 2021-11-25 15:29:32 | 0:38:32 | 0:28:05 | 0:10:27 | smithi | master | ubuntu | 20.04 | rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} | 1 |
| fail | 6525355 |
|
2021-11-25 14:19:14 | 2021-11-25 14:51:51 | 2021-11-25 18:13:53 | 3:22:02 | 3:09:34 | 0:12:28 | smithi | master | ubuntu | 20.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi097 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525356 |
|
2021-11-25 14:19:15 | 2021-11-25 14:51:51 | 2021-11-25 15:26:15 | 0:34:24 | 0:23:45 | 0:10:39 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T15:12:23.383061+0000 mgr.x (mgr.4105) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525357 |
|
2021-11-25 14:19:16 | 2021-11-25 14:53:12 | 2021-11-25 15:26:28 | 0:33:16 | 0:23:31 | 0:09:45 | smithi | master | centos | 8.3 | rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525358 |
|
2021-11-25 14:19:17 | 2021-11-25 14:53:12 | 2021-11-25 15:26:14 | 0:33:02 | 0:22:01 | 0:11:01 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} | 1 |
Failure Reason:
"2021-11-25T15:10:06.263629+0000 mgr.x (mgr.4100) 29 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525359 |
|
2021-11-25 14:19:18 | 2021-11-25 14:54:12 | 2021-11-25 15:49:27 | 0:55:15 | 0:49:24 | 0:05:51 | smithi | master | rhel | 8.4 | rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} | 2 |
Failure Reason:
"2021-11-25T15:21:01.245742+0000 mgr.x (mgr.4109) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525360 |
|
2021-11-25 14:19:19 | 2021-11-25 14:54:13 | 2021-11-25 15:29:38 | 0:35:25 | 0:20:34 | 0:14:51 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T15:14:09.960775+0000 mgr.x (mgr.4112) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525361 |
|
2021-11-25 14:19:20 | 2021-11-25 14:57:54 | 2021-11-25 17:57:47 | 2:59:53 | 2:51:48 | 0:08:05 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} | 2 |
Failure Reason:
"2021-11-25T15:25:25.179637+0000 mgr.y (mgr.4101) 47 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525362 |
|
2021-11-25 14:19:21 | 2021-11-25 14:58:14 | 2021-11-25 15:15:43 | 0:17:29 | 0:06:57 | 0:10:32 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T15:13:41.993065+0000 mgr.x (mgr.4103) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525363 |
|
2021-11-25 14:19:21 | 2021-11-25 14:58:14 | 2021-11-25 15:24:28 | 0:26:14 | 0:13:07 | 0:13:07 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} | 2 |
Failure Reason:
"2021-11-25T15:19:23.438545+0000 mgr.y (mgr.4108) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525364 |
|
2021-11-25 14:19:22 | 2021-11-25 14:59:25 | 2021-11-25 15:41:21 | 0:41:56 | 0:31:22 | 0:10:34 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525365 |
|
2021-11-25 14:19:23 | 2021-11-25 15:00:05 | 2021-11-25 15:33:31 | 0:33:26 | 0:22:01 | 0:11:25 | smithi | master | centos | 8.3 | rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} | 2 |
Failure Reason:
"2021-11-25T15:21:01.390455+0000 mgr.x (mgr.4102) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525366 |
|
2021-11-25 14:19:24 | 2021-11-25 15:02:06 | 2021-11-25 15:35:35 | 0:33:29 | 0:22:36 | 0:10:53 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T15:22:02.006830+0000 mgr.y (mgr.4104) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525367 |
|
2021-11-25 14:19:25 | 2021-11-25 15:02:16 | 2021-11-25 15:19:40 | 0:17:24 | 0:04:45 | 0:12:39 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} | 1 | ||
| fail | 6525368 |
|
2021-11-25 14:19:26 | 2021-11-25 15:06:27 | 2021-11-25 15:25:20 | 0:18:53 | 0:07:25 | 0:11:28 | smithi | master | ubuntu | 20.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{ubuntu_latest} tasks/workunits} | 2 |
Failure Reason:
"2021-11-25T15:23:26.623861+0000 mgr.z (mgr.4108) 27 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.z: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525369 |
|
2021-11-25 14:19:27 | 2021-11-25 15:07:47 | 2021-11-25 15:37:27 | 0:29:40 | 0:19:23 | 0:10:17 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T15:28:18.974566+0000 mgr.x (mgr.4108) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525370 |
|
2021-11-25 14:19:28 | 2021-11-25 15:08:28 | 2021-11-25 15:39:38 | 0:31:10 | 0:18:23 | 0:12:47 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525371 |
|
2021-11-25 14:19:29 | 2021-11-25 15:08:58 | 2021-11-25 15:34:53 | 0:25:55 | 0:13:59 | 0:11:56 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T15:32:23.230759+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525372 |
|
2021-11-25 14:19:30 | 2021-11-25 15:11:49 | 2021-11-25 15:35:26 | 0:23:37 | 0:13:20 | 0:10:17 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T15:32:02.775996+0000 mgr.y (mgr.4101) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525373 |
|
2021-11-25 14:19:31 | 2021-11-25 15:11:59 | 2021-11-25 15:40:33 | 0:28:34 | 0:17:05 | 0:11:29 | smithi | master | ubuntu | 20.04 | rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.0} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525374 |
|
2021-11-25 14:19:31 | 2021-11-25 15:13:00 | 2021-11-25 15:48:10 | 0:35:10 | 0:20:25 | 0:14:45 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525375 |
|
2021-11-25 14:19:32 | 2021-11-25 15:16:41 | 2021-11-25 15:43:07 | 0:26:26 | 0:13:29 | 0:12:57 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
"2021-11-25T15:35:57.368073+0000 mgr.y (mgr.4102) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525376 |
|
2021-11-25 14:19:33 | 2021-11-25 15:19:41 | 2021-11-25 16:04:22 | 0:44:41 | 0:34:16 | 0:10:25 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525377 |
|
2021-11-25 14:19:34 | 2021-11-25 15:20:52 | 2021-11-25 15:47:55 | 0:27:03 | 0:16:44 | 0:10:19 | smithi | master | centos | 8.3 | rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T15:38:37.204717+0000 mgr.x (mgr.4109) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525378 |
|
2021-11-25 14:19:35 | 2021-11-25 15:20:52 | 2021-11-25 15:50:31 | 0:29:39 | 0:20:12 | 0:09:27 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525379 |
|
2021-11-25 14:19:36 | 2021-11-25 15:21:13 | 2021-11-25 16:01:48 | 0:40:35 | 0:27:02 | 0:13:33 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T15:44:22.250976+0000 mgr.y (mgr.4100) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525380 |
|
2021-11-25 14:19:37 | 2021-11-25 15:29:47 | 2021-11-25 16:03:53 | 0:34:06 | 0:23:26 | 0:10:40 | smithi | master | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525381 |
|
2021-11-25 14:19:38 | 2021-11-25 15:30:08 | 2021-11-25 19:01:10 | 3:31:02 | 3:15:14 | 0:15:48 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi136 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525382 |
|
2021-11-25 14:19:39 | 2021-11-25 15:33:39 | 2021-11-25 15:54:17 | 0:20:38 | 0:08:25 | 0:12:13 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} | 3 |
Failure Reason:
Command failed on smithi081 with status 5: 'sudo systemctl stop ceph-8be646f4-4e07-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525383 |
|
2021-11-25 14:19:40 | 2021-11-25 15:34:59 | 2021-11-25 16:08:11 | 0:33:12 | 0:23:08 | 0:10:04 | smithi | master | centos | 8.2 | rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525384 |
|
2021-11-25 14:19:41 | 2021-11-25 15:34:59 | 2021-11-25 16:53:04 | 1:18:05 | 1:06:35 | 0:11:30 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T15:55:33.743769+0000 mgr.y (mgr.4104) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525385 |
|
2021-11-25 14:19:42 | 2021-11-25 15:35:30 | 2021-11-25 16:02:44 | 0:27:14 | 0:17:36 | 0:09:38 | smithi | master | centos | 8.2 | rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525386 |
|
2021-11-25 14:19:43 | 2021-11-25 15:35:40 | 2021-11-25 16:27:51 | 0:52:11 | 0:45:15 | 0:06:56 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T16:02:59.493345+0000 mgr.x (mgr.4102) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525387 |
|
2021-11-25 14:19:43 | 2021-11-25 15:36:31 | 2021-11-25 16:19:42 | 0:43:11 | 0:37:34 | 0:05:37 | smithi | master | rhel | 8.4 | rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525388 |
|
2021-11-25 14:19:44 | 2021-11-25 15:37:31 | 2021-11-25 16:24:15 | 0:46:44 | 0:32:43 | 0:14:01 | smithi | master | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 |
| fail | 6525389 |
|
2021-11-25 14:19:45 | 2021-11-25 15:39:42 | 2021-11-25 16:00:40 | 0:20:58 | 0:11:47 | 0:09:11 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T15:57:09.047992+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525390 |
|
2021-11-25 14:19:46 | 2021-11-25 15:39:42 | 2021-11-25 16:24:36 | 0:44:54 | 0:36:11 | 0:08:43 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} | 2 |
Failure Reason:
"2021-11-25T16:07:18.174436+0000 mgr.y (mgr.4104) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525391 |
|
2021-11-25 14:19:47 | 2021-11-25 15:41:23 | 2021-11-25 16:14:15 | 0:32:52 | 0:24:30 | 0:08:22 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T16:09:41.261692+0000 mgr.y (mgr.4104) 49 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525392 |
|
2021-11-25 14:19:48 | 2021-11-25 15:43:13 | 2021-11-25 16:29:08 | 0:45:55 | 0:30:28 | 0:15:27 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525393 |
|
2021-11-25 14:19:49 | 2021-11-25 15:48:04 | 2021-11-25 16:22:30 | 0:34:26 | 0:22:42 | 0:11:44 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T16:04:57.848945+0000 mgr.y (mgr.4104) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525394 |
|
2021-11-25 14:19:50 | 2021-11-25 15:48:15 | 2021-11-25 16:12:08 | 0:23:53 | 0:12:27 | 0:11:26 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} | 1 |
Failure Reason:
"2021-11-25T16:04:05.266082+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525395 |
|
2021-11-25 14:19:51 | 2021-11-25 15:48:35 | 2021-11-25 16:05:21 | 0:16:46 | 0:06:16 | 0:10:30 | smithi | master | ubuntu | 20.04 | rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} | 2 |
| fail | 6525396 |
|
2021-11-25 14:19:51 | 2021-11-25 15:49:35 | 2021-11-25 16:42:54 | 0:53:19 | 0:46:44 | 0:06:35 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 |
Failure Reason:
"2021-11-25T16:16:40.772887+0000 mgr.x (mgr.4104) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525397 |
|
2021-11-25 14:19:52 | 2021-11-25 15:49:36 | 2021-11-25 16:19:05 | 0:29:29 | 0:22:33 | 0:06:56 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525398 |
|
2021-11-25 14:19:53 | 2021-11-25 15:49:46 | 2021-11-25 16:27:16 | 0:37:30 | 0:26:50 | 0:10:40 | smithi | master | centos | 8.3 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} | 2 |
Failure Reason:
"2021-11-25T16:16:39.881442+0000 mgr.y (mgr.4101) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525399 |
|
2021-11-25 14:19:54 | 2021-11-25 15:49:57 | 2021-11-25 16:23:56 | 0:33:59 | 0:27:22 | 0:06:37 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T16:16:35.443870+0000 mgr.y (mgr.4100) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525400 |
|
2021-11-25 14:19:55 | 2021-11-25 15:50:37 | 2021-11-25 16:22:35 | 0:31:58 | 0:25:05 | 0:06:53 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525401 |
|
2021-11-25 14:19:56 | 2021-11-25 15:51:17 | 2021-11-25 16:28:10 | 0:36:53 | 0:28:01 | 0:08:52 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T16:19:35.198280+0000 mgr.x (mgr.4107) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525402 |
|
2021-11-25 14:19:57 | 2021-11-25 15:54:22 | 2021-11-25 16:48:35 | 0:54:13 | 0:46:03 | 0:08:10 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T16:22:05.343325+0000 mgr.x (mgr.4102) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525403 |
|
2021-11-25 14:19:58 | 2021-11-25 15:55:02 | 2021-11-25 16:22:16 | 0:27:14 | 0:11:30 | 0:15:44 | smithi | master | centos | 8.stream | rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} | 2 |
Failure Reason:
"2021-11-25T16:20:09.998448+0000 mgr.x (mgr.4101) 70 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525404 |
|
2021-11-25 14:19:59 | 2021-11-25 16:00:43 | 2021-11-25 16:34:33 | 0:33:50 | 0:20:43 | 0:13:07 | smithi | master | centos | 8.3 | rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525405 |
|
2021-11-25 14:20:00 | 2021-11-25 16:01:54 | 2021-11-25 16:30:47 | 0:28:53 | 0:18:06 | 0:10:47 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T16:19:26.008568+0000 mgr.y (mgr.4104) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525406 |
|
2021-11-25 14:20:01 | 2021-11-25 16:02:54 | 2021-11-25 16:33:55 | 0:31:01 | 0:18:52 | 0:12:09 | smithi | master | centos | 8.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} | 2 |
Failure Reason:
Test failure: test_remove_from_blocklist (tasks.mgr.dashboard.test_auth.AuthTest) |
||||||||||||||
| pass | 6525407 |
|
2021-11-25 14:20:02 | 2021-11-25 16:03:55 | 2021-11-25 16:25:38 | 0:21:43 | 0:09:40 | 0:12:03 | smithi | master | ubuntu | 20.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/crash} | 2 |
| fail | 6525408 |
|
2021-11-25 14:20:03 | 2021-11-25 16:23:59 | 418 | smithi | master | ubuntu | 20.04 | rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} | 1 | |||
Failure Reason:
"2021-11-25T16:21:44.609442+0000 mgr.x (mgr.4099) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525409 |
|
2021-11-25 14:20:03 | 2021-11-25 16:05:26 | 2021-11-25 16:30:50 | 0:25:24 | 0:14:20 | 0:11:04 | smithi | master | centos | 8.stream | rados/rest/{mgr-restful supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T16:26:37.037727+0000 mgr.x (mgr.4102) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525410 |
|
2021-11-25 14:20:04 | 2021-11-25 16:08:16 | 2021-11-25 16:44:57 | 0:36:41 | 0:31:19 | 0:05:22 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T16:32:48.572867+0000 mgr.x (mgr.4101) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525411 |
|
2021-11-25 14:20:05 | 2021-11-25 16:08:16 | 2021-11-25 16:32:56 | 0:24:40 | 0:11:17 | 0:13:23 | smithi | master | ubuntu | 20.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} | 1 |
| pass | 6525412 |
|
2021-11-25 14:20:06 | 2021-11-25 16:12:17 | 2021-11-25 17:42:41 | 1:30:24 | 1:19:20 | 0:11:04 | smithi | master | centos | 8.2 | rados/upgrade/parallel/{0-random-distro$/{centos_8.2_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
| fail | 6525413 |
|
2021-11-25 14:20:07 | 2021-11-25 16:14:18 | 2021-11-25 17:07:14 | 0:52:56 | 0:36:37 | 0:16:19 | smithi | master | centos | 8.3 | rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} | 1 |
Failure Reason:
"2021-11-25T17:04:56.236233+0000 mgr.y (mgr.4100) 211 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525414 |
|
2021-11-25 14:20:08 | 2021-11-25 16:19:09 | 2021-11-25 16:47:05 | 0:27:56 | 0:16:37 | 0:11:19 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525415 |
|
2021-11-25 14:20:08 | 2021-11-25 16:19:09 | 2021-11-25 17:09:38 | 0:50:29 | 0:32:15 | 0:18:14 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T16:55:09.643413+0000 mgr.y (mgr.4110) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525416 |
|
2021-11-25 14:20:09 | 2021-11-25 16:19:39 | 2021-11-25 16:53:38 | 0:33:59 | 0:21:58 | 0:12:01 | smithi | master | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525417 |
|
2021-11-25 14:20:10 | 2021-11-25 16:22:20 | 2021-11-25 17:27:43 | 1:05:23 | 0:48:24 | 0:16:59 | smithi | master | centos | 8.3 | rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} | 2 |
Failure Reason:
"2021-11-25T16:56:21.158453+0000 mgr.x (mgr.4104) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525418 |
|
2021-11-25 14:20:11 | 2021-11-25 16:22:41 | 2021-11-25 16:53:54 | 0:31:13 | 0:18:36 | 0:12:37 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T16:40:21.344188+0000 mgr.x (mgr.4110) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525419 |
|
2021-11-25 14:20:12 | 2021-11-25 16:22:41 | 2021-11-25 16:59:35 | 0:36:54 | 0:24:37 | 0:12:17 | smithi | master | centos | 8.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T16:44:15.437433+0000 mgr.y (mgr.4107) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525420 |
|
2021-11-25 14:20:13 | 2021-11-25 16:24:01 | 2021-11-25 17:42:38 | 1:18:37 | 1:03:28 | 0:15:09 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} | 2 |
Failure Reason:
"2021-11-25T17:15:02.038020+0000 mgr.x (mgr.4100) 234 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525421 |
|
2021-11-25 14:20:14 | 2021-11-25 16:24:02 | 2021-11-25 17:12:36 | 0:48:34 | 0:35:06 | 0:13:28 | smithi | master | centos | 8.3 | rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525422 |
|
2021-11-25 14:20:15 | 2021-11-25 16:24:22 | 2021-11-25 17:13:20 | 0:48:58 | 0:34:09 | 0:14:49 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T16:54:30.133222+0000 mgr.y (mgr.4107) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525423 |
|
2021-11-25 14:20:16 | 2021-11-25 16:24:42 | 2021-11-25 16:54:38 | 0:29:56 | 0:19:20 | 0:10:36 | smithi | master | centos | 8.stream | rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
Command failed (workunit test rados/test_crash.sh) on smithi129 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crash.sh' |
||||||||||||||
| pass | 6525424 |
|
2021-11-25 14:20:17 | 2021-11-25 16:25:43 | 2021-11-25 17:09:13 | 0:43:30 | 0:30:46 | 0:12:44 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525425 |
|
2021-11-25 14:20:17 | 2021-11-25 16:27:23 | 2021-11-25 17:01:55 | 0:34:32 | 0:22:42 | 0:11:50 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T16:44:16.014709+0000 mgr.x (mgr.4100) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525426 |
|
2021-11-25 14:20:18 | 2021-11-25 16:27:54 | 2021-11-25 16:56:11 | 0:28:17 | 0:22:18 | 0:05:59 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T16:53:10.754405+0000 mgr.x (mgr.4102) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525427 |
|
2021-11-25 14:20:19 | 2021-11-25 16:27:54 | 2021-11-25 16:54:29 | 0:26:35 | 0:14:37 | 0:11:58 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T16:49:58.045933+0000 mgr.x (mgr.4105) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525428 |
|
2021-11-25 14:20:20 | 2021-11-25 16:29:15 | 2021-11-25 17:12:15 | 0:43:00 | 0:30:56 | 0:12:04 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T16:50:59.306293+0000 mgr.y (mgr.4107) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525429 |
|
2021-11-25 14:20:21 | 2021-11-25 16:30:55 | 2021-11-25 17:16:21 | 0:45:26 | 0:33:05 | 0:12:21 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
| fail | 6525430 |
|
2021-11-25 14:20:22 | 2021-11-25 16:33:06 | 2021-11-25 17:13:30 | 0:40:24 | 0:25:01 | 0:15:23 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T17:08:25.614476+0000 mgr.y (mgr.4100) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525431 |
|
2021-11-25 14:20:23 | 2021-11-25 16:33:56 | 2021-11-25 17:07:55 | 0:33:59 | 0:26:30 | 0:07:29 | smithi | master | rhel | 8.4 | rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} | 2 |
Failure Reason:
"2021-11-25T17:03:04.855280+0000 mgr.x (mgr.4712) 51 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525432 |
|
2021-11-25 14:20:24 | 2021-11-25 16:34:37 | 2021-11-25 17:34:18 | 0:59:41 | 0:41:22 | 0:18:19 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T17:03:04.555507+0000 mgr.x (mgr.4105) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525433 |
|
2021-11-25 14:20:25 | 2021-11-25 16:42:58 | 2021-11-25 17:09:39 | 0:26:41 | 0:16:47 | 0:09:54 | smithi | master | centos | 8.stream | rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525434 |
|
2021-11-25 14:20:26 | 2021-11-25 16:42:58 | 2021-11-25 17:22:10 | 0:39:12 | 0:30:52 | 0:08:20 | smithi | master | rhel | 8.4 | rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T17:10:20.684535+0000 mgr.x (mgr.4101) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525435 |
|
2021-11-25 14:20:26 | 2021-11-25 16:44:59 | 2021-11-25 17:06:15 | 0:21:16 | 0:09:28 | 0:11:48 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} | 1 |
Failure Reason:
"2021-11-25T17:02:11.576845+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525436 |
|
2021-11-25 14:20:27 | 2021-11-25 17:42:49 | 2021-11-25 18:26:07 | 0:43:18 | 0:36:14 | 0:07:04 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T18:08:37.285263+0000 mgr.y (mgr.4109) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525437 |
|
2021-11-25 14:20:28 | 2021-11-25 17:42:49 | 2021-11-25 18:16:34 | 0:33:45 | 0:17:24 | 0:16:21 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525438 |
|
2021-11-25 14:20:29 | 2021-11-25 17:49:01 | 2021-11-25 18:18:01 | 0:29:00 | 0:16:58 | 0:12:02 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T18:11:48.773920+0000 mgr.x (mgr.4102) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525439 |
|
2021-11-25 14:20:30 | 2021-11-25 17:49:01 | 2021-11-25 18:25:41 | 0:36:40 | 0:21:19 | 0:15:21 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T18:13:48.901985+0000 mgr.y (mgr.4113) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525440 |
|
2021-11-25 14:20:31 | 2021-11-25 17:52:52 | 2021-11-25 18:22:16 | 0:29:24 | 0:23:03 | 0:06:21 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525441 |
|
2021-11-25 14:20:32 | 2021-11-25 17:52:52 | 2021-11-25 18:19:07 | 0:26:15 | 0:18:02 | 0:08:13 | smithi | master | rhel | 8.4 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_python} | 2 |
Failure Reason:
"2021-11-25T18:11:25.279919+0000 mgr.y (mgr.4114) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525442 |
|
2021-11-25 14:20:33 | 2021-11-25 17:53:32 | 2021-11-25 18:42:05 | 0:48:33 | 0:40:00 | 0:08:33 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T18:20:44.149966+0000 mgr.x (mgr.4102) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525443 |
|
2021-11-25 14:20:34 | 2021-11-25 17:53:53 | 2021-11-25 18:25:27 | 0:31:34 | 0:25:08 | 0:06:26 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525444 |
|
2021-11-25 14:20:35 | 2021-11-25 17:53:53 | 2021-11-25 18:32:18 | 0:38:25 | 0:25:09 | 0:13:16 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T18:16:04.462405+0000 mgr.y (mgr.4110) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525445 |
|
2021-11-25 14:20:36 | 2021-11-25 17:55:24 | 2021-11-25 18:24:43 | 0:29:19 | 0:14:37 | 0:14:42 | smithi | master | centos | 8.3 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/failover} | 2 |
Failure Reason:
"2021-11-25T18:19:42.801473+0000 mgr.x (mgr.5142) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525446 |
|
2021-11-25 14:20:36 | 2021-11-25 17:55:44 | 2021-11-25 18:23:53 | 0:28:09 | 0:18:03 | 0:10:06 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525447 |
|
2021-11-25 14:20:37 | 2021-11-25 17:55:44 | 2021-11-25 19:11:18 | 1:15:34 | 1:06:08 | 0:09:26 | smithi | master | rhel | 8.4 | rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} | 2 |
Failure Reason:
"2021-11-25T18:23:47.795383+0000 mgr.x (mgr.4101) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525448 |
|
2021-11-25 14:20:38 | 2021-11-25 17:57:05 | 2021-11-25 18:26:26 | 0:29:21 | 0:16:32 | 0:12:49 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T18:15:14.962064+0000 mgr.y (mgr.4100) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525449 |
|
2021-11-25 14:20:39 | 2021-11-25 17:57:55 | 2021-11-25 18:25:50 | 0:27:55 | 0:16:52 | 0:11:03 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525450 |
|
2021-11-25 14:20:40 | 2021-11-25 17:57:56 | 2021-11-25 18:19:35 | 0:21:39 | 0:09:39 | 0:12:00 | smithi | master | ubuntu | 20.04 | rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} | 2 |
| fail | 6525451 |
|
2021-11-25 14:20:41 | 2021-11-25 17:59:27 | 2021-11-25 18:23:44 | 0:24:17 | 0:12:55 | 0:11:22 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 |
Failure Reason:
"2021-11-25T18:20:35.305229+0000 mgr.x (mgr.4104) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525452 |
|
2021-11-25 14:20:42 | 2021-11-25 17:59:47 | 2021-11-25 18:20:34 | 0:20:47 | 0:11:26 | 0:09:21 | smithi | master | centos | 8.stream | rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T18:18:40.188219+0000 mgr.x (mgr.4101) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525453 |
|
2021-11-25 14:20:43 | 2021-11-25 17:59:47 | 2021-11-25 18:45:23 | 0:45:36 | 0:36:38 | 0:08:58 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T18:27:43.410846+0000 mgr.y (mgr.4104) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525454 |
|
2021-11-25 14:20:44 | 2021-11-25 18:01:38 | 2021-11-25 18:45:10 | 0:43:32 | 0:35:11 | 0:08:21 | smithi | master | rhel | 8.4 | rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525455 |
|
2021-11-25 14:20:44 | 2021-11-25 18:03:29 | 2021-11-25 18:27:41 | 0:24:12 | 0:13:58 | 0:10:14 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T18:24:47.338234+0000 mgr.x (mgr.4108) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525456 |
|
2021-11-25 14:20:45 | 2021-11-25 18:03:29 | 2021-11-25 18:24:11 | 0:20:42 | 0:08:16 | 0:12:26 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} | 3 |
Failure Reason:
Command failed on smithi013 with status 5: 'sudo systemctl stop ceph-c1d16ad6-4e1c-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525457 |
|
2021-11-25 14:20:46 | 2021-11-25 18:07:20 | 2021-11-25 18:30:46 | 0:23:26 | 0:10:44 | 0:12:42 | smithi | master | ubuntu | 20.04 | rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T18:24:35.095114+0000 mgr.x (mgr.4099) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525458 |
|
2021-11-25 14:20:47 | 2021-11-25 18:08:50 | 2021-11-25 18:42:21 | 0:33:31 | 0:22:57 | 0:10:34 | smithi | master | centos | 8.stream | rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525459 |
|
2021-11-25 14:20:48 | 2021-11-25 18:08:50 | 2021-11-25 18:50:54 | 0:42:04 | 0:26:32 | 0:15:32 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T18:29:33.466053+0000 mgr.x (mgr.4102) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525460 |
|
2021-11-25 14:20:49 | 2021-11-25 18:13:11 | 2021-11-25 18:43:05 | 0:29:54 | 0:22:34 | 0:07:20 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T18:39:35.348216+0000 mgr.y (mgr.4110) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525461 |
|
2021-11-25 14:20:50 | 2021-11-25 18:54:01 | 1649 | smithi | master | centos | 8.stream | rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 | |||
| fail | 6525462 |
|
2021-11-25 14:20:50 | 2021-11-25 18:16:43 | 2021-11-25 19:01:48 | 0:45:05 | 0:32:20 | 0:12:45 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} | 2 |
Failure Reason:
"2021-11-25T18:33:47.987829+0000 mgr.x (mgr.4100) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525463 |
|
2021-11-25 14:20:51 | 2021-11-25 18:18:03 | 2021-11-25 18:46:04 | 0:28:01 | 0:15:55 | 0:12:06 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
"2021-11-25T18:40:03.363623+0000 mgr.x (mgr.4111) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525464 |
|
2021-11-25 14:20:52 | 2021-11-25 18:19:14 | 2021-11-25 19:03:18 | 0:44:04 | 0:32:35 | 0:11:29 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525465 |
|
2021-11-25 14:20:53 | 2021-11-25 18:19:44 | 2021-11-25 18:51:04 | 0:31:20 | 0:22:24 | 0:08:56 | smithi | master | rhel | 8.4 | rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} | 2 |
Failure Reason:
Command failed (workunit test mon/pool_ops.sh) on smithi204 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh' |
||||||||||||||
| fail | 6525466 |
|
2021-11-25 14:20:54 | 2021-11-25 18:21:35 | 2021-11-25 19:07:07 | 0:45:32 | 0:36:46 | 0:08:46 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T18:40:40.313644+0000 mgr.y (mgr.4110) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525467 |
|
2021-11-25 14:20:55 | 2021-11-25 18:21:35 | 2021-11-25 18:54:06 | 0:32:31 | 0:21:46 | 0:10:45 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} | 2 |
Failure Reason:
"2021-11-25T18:39:11.261646+0000 mgr.y (mgr.4113) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525468 |
|
2021-11-25 14:20:56 | 2021-11-25 18:21:35 | 2021-11-25 18:38:22 | 0:16:47 | 0:08:57 | 0:07:50 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
| pass | 6525469 |
|
2021-11-25 14:20:57 | 2021-11-25 18:21:36 | 2021-11-25 18:58:22 | 0:36:46 | 0:31:34 | 0:05:12 | smithi | master | rhel | 8.4 | rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} | 1 |
| fail | 6525470 |
|
2021-11-25 14:20:58 | 2021-11-25 18:21:36 | 2021-11-25 18:59:38 | 0:38:02 | 0:27:27 | 0:10:35 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} | 2 |
Failure Reason:
"2021-11-25T18:38:10.219711+0000 mgr.y (mgr.4104) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525471 |
|
2021-11-25 14:20:59 | 2021-11-25 18:21:36 | 2021-11-25 18:52:07 | 0:30:31 | 0:18:53 | 0:11:38 | smithi | master | ubuntu | 20.04 | rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525472 |
|
2021-11-25 14:20:59 | 2021-11-25 18:21:37 | 2021-11-25 18:49:09 | 0:27:32 | 0:18:43 | 0:08:49 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} | 2 |
Failure Reason:
"2021-11-25T18:40:33.894266+0000 mgr.y (mgr.4110) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525473 |
|
2021-11-25 14:21:00 | 2021-11-25 18:21:37 | 2021-11-25 21:45:22 | 3:23:45 | 3:12:49 | 0:10:56 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi170 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525474 |
|
2021-11-25 14:21:01 | 2021-11-25 18:21:37 | 2021-11-25 18:57:40 | 0:36:03 | 0:24:40 | 0:11:23 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525475 |
|
2021-11-25 14:21:02 | 2021-11-25 18:21:38 | 2021-11-25 18:44:25 | 0:22:47 | 0:11:44 | 0:11:03 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} | 1 |
Failure Reason:
"2021-11-25T18:38:51.048375+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525476 |
|
2021-11-25 14:21:03 | 2021-11-25 18:21:38 | 2021-11-25 19:32:03 | 1:10:25 | 0:56:37 | 0:13:48 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T18:41:20.709549+0000 mgr.x (mgr.4100) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525477 |
|
2021-11-25 14:21:04 | 2021-11-25 18:21:38 | 2021-11-25 18:52:40 | 0:31:02 | 0:22:12 | 0:08:50 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525478 |
|
2021-11-25 14:21:05 | 2021-11-25 18:21:39 | 2021-11-25 19:01:28 | 0:39:49 | 0:31:29 | 0:08:20 | smithi | master | rhel | 8.4 | rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} | 2 |
Failure Reason:
"2021-11-25T18:50:04.570174+0000 mgr.x (mgr.4101) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525479 |
|
2021-11-25 14:21:06 | 2021-11-25 18:21:39 | 2021-11-25 19:56:43 | 1:35:04 | 1:26:45 | 0:08:19 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T18:49:31.775412+0000 mgr.y (mgr.4107) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525480 |
|
2021-11-25 14:21:07 | 2021-11-25 18:21:39 | 2021-11-25 18:55:28 | 0:33:49 | 0:23:42 | 0:10:07 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T18:50:58.458372+0000 mgr.y (mgr.4106) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525481 |
|
2021-11-25 14:21:08 | 2021-11-25 18:21:40 | 2021-11-25 19:03:42 | 0:42:02 | 0:34:59 | 0:07:03 | smithi | master | rhel | 8.4 | rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525482 |
|
2021-11-25 14:21:09 | 2021-11-25 18:21:40 | 2021-11-25 18:53:13 | 0:31:33 | 0:20:35 | 0:10:58 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T18:43:48.079520+0000 mgr.y (mgr.4111) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525483 |
|
2021-11-25 14:21:10 | 2021-11-25 18:21:41 | 2021-11-25 18:57:56 | 0:36:15 | 0:22:59 | 0:13:16 | smithi | master | ubuntu | 20.04 | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi121 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| fail | 6525484 |
|
2021-11-25 14:21:11 | 2021-11-25 18:21:41 | 2021-11-25 18:51:03 | 0:29:22 | 0:16:49 | 0:12:33 | smithi | master | ubuntu | 20.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} | 2 |
Failure Reason:
"2021-11-25T18:40:26.776706+0000 mgr.x (mgr.4109) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525485 |
|
2021-11-25 14:21:12 | 2021-11-25 18:21:41 | 2021-11-25 18:39:39 | 0:17:58 | 0:07:33 | 0:10:25 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T18:37:30.784182+0000 mgr.x (mgr.4101) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525486 |
|
2021-11-25 14:21:13 | 2021-11-25 18:21:42 | 2021-11-25 18:51:59 | 0:30:17 | 0:21:57 | 0:08:20 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525487 |
|
2021-11-25 14:21:14 | 2021-11-25 18:21:42 | 2021-11-25 18:54:54 | 0:33:12 | 0:25:04 | 0:08:08 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T18:49:35.820805+0000 mgr.y (mgr.4104) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525488 |
|
2021-11-25 14:21:14 | 2021-11-25 18:21:42 | 2021-11-25 18:57:02 | 0:35:20 | 0:25:59 | 0:09:21 | smithi | master | rhel | 8.4 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/insights} | 2 |
Failure Reason:
"2021-11-25T18:52:57.608204+0000 mgr.x (mgr.5445) 60 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525489 |
|
2021-11-25 14:21:15 | 2021-11-25 18:21:43 | 2021-11-25 18:56:01 | 0:34:18 | 0:23:11 | 0:11:07 | smithi | master | centos | 8.stream | rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525490 |
|
2021-11-25 14:21:16 | 2021-11-25 18:21:43 | 2021-11-25 18:45:20 | 0:23:37 | 0:11:55 | 0:11:42 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T18:40:14.091139+0000 mgr.y (mgr.4111) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525491 |
|
2021-11-25 14:21:17 | 2021-11-25 18:21:43 | 2021-11-25 19:03:19 | 0:41:36 | 0:29:18 | 0:12:18 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525492 |
|
2021-11-25 14:21:18 | 2021-11-25 18:21:44 | 2021-11-25 19:00:48 | 0:39:04 | 0:28:04 | 0:11:00 | smithi | master | centos | 8.3 | rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} | 2 |
Failure Reason:
"2021-11-25T18:42:50.752085+0000 mgr.x (mgr.4102) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525493 |
|
2021-11-25 14:21:19 | 2021-11-25 18:21:44 | 2021-11-25 18:50:47 | 0:29:03 | 0:16:56 | 0:12:07 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T18:44:02.481223+0000 mgr.x (mgr.4108) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525494 |
|
2021-11-25 14:21:20 | 2021-11-25 18:21:45 | 2021-11-25 18:50:33 | 0:28:48 | 0:18:15 | 0:10:33 | smithi | master | centos | 8.2 | rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525495 |
|
2021-11-25 14:21:21 | 2021-11-25 18:21:45 | 2021-11-25 19:05:08 | 0:43:23 | 0:37:34 | 0:05:49 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T18:49:06.723714+0000 mgr.y (mgr.4101) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525496 |
|
2021-11-25 14:21:22 | 2021-11-25 18:21:45 | 2021-11-25 18:52:19 | 0:30:34 | 0:21:28 | 0:09:06 | smithi | master | centos | 8.2 | rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525497 |
|
2021-11-25 14:21:23 | 2021-11-25 18:21:46 | 2021-11-25 18:43:19 | 0:21:33 | 0:10:25 | 0:11:08 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T18:42:40.864923+0000 mgr.x (mgr.4102) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525498 |
|
2021-11-25 14:21:24 | 2021-11-25 18:21:46 | 2021-11-25 18:54:09 | 0:32:23 | 0:23:43 | 0:08:40 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T18:39:47.582466+0000 mgr.y (mgr.4108) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525499 |
|
2021-11-25 14:21:25 | 2021-11-25 18:21:46 | 2021-11-25 18:43:04 | 0:21:18 | 0:08:07 | 0:13:11 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} | 1 | ||
| fail | 6525500 |
|
2021-11-25 14:21:26 | 2021-11-25 18:21:47 | 2021-11-25 19:01:32 | 0:39:45 | 0:26:58 | 0:12:47 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T18:40:37.654339+0000 mgr.x (mgr.4111) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525501 |
|
2021-11-25 14:21:27 | 2021-11-25 18:21:47 | 2021-11-25 18:54:08 | 0:32:21 | 0:18:47 | 0:13:34 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525502 |
|
2021-11-25 14:21:27 | 2021-11-25 18:22:17 | 2021-11-25 18:40:10 | 0:17:53 | 0:06:57 | 0:10:56 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 |
| fail | 6525503 |
|
2021-11-25 14:21:28 | 2021-11-25 18:22:18 | 2021-11-25 19:01:37 | 0:39:19 | 0:27:58 | 0:11:21 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T18:42:57.676217+0000 mgr.y (mgr.4100) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525504 |
|
2021-11-25 14:21:29 | 2021-11-25 18:23:48 | 2021-11-25 18:46:03 | 0:22:15 | 0:11:44 | 0:10:31 | smithi | master | centos | 8.3 | rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} | 3 |
| fail | 6525505 |
|
2021-11-25 14:21:30 | 2021-11-25 18:23:59 | 2021-11-25 19:12:24 | 0:48:25 | 0:37:35 | 0:10:50 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 |
Failure Reason:
"2021-11-25T18:42:06.508508+0000 mgr.x (mgr.4105) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525506 |
|
2021-11-25 14:21:31 | 2021-11-25 18:24:19 | 2021-11-25 18:52:06 | 0:27:47 | 0:20:06 | 0:07:41 | smithi | master | rhel | 8.4 | rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} | 1 |
| pass | 6525507 |
|
2021-11-25 14:21:32 | 2021-11-25 18:24:49 | 2021-11-25 19:02:51 | 0:38:02 | 0:27:32 | 0:10:30 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
| fail | 6525508 |
|
2021-11-25 14:21:33 | 2021-11-25 18:25:30 | 2021-11-25 19:07:07 | 0:41:37 | 0:31:23 | 0:10:14 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T18:46:06.932506+0000 mgr.y (mgr.4110) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525509 |
|
2021-11-25 14:21:34 | 2021-11-25 18:25:50 | 2021-11-25 18:57:46 | 0:31:56 | 0:20:44 | 0:11:12 | smithi | master | ubuntu | 20.04 | rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/host rook/master} | 3 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525510 |
|
2021-11-25 14:21:35 | 2021-11-25 18:26:11 | 2021-11-25 18:47:45 | 0:21:34 | 0:11:38 | 0:09:56 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} | 1 |
Failure Reason:
"2021-11-25T18:41:29.981460+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525511 |
|
2021-11-25 14:21:36 | 2021-11-25 18:26:11 | 2021-11-25 19:02:29 | 0:36:18 | 0:25:43 | 0:10:35 | smithi | master | ubuntu | 20.04 | rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525512 |
|
2021-11-25 14:21:37 | 2021-11-25 18:26:31 | 2021-11-25 19:11:24 | 0:44:53 | 0:36:15 | 0:08:38 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T18:55:15.193257+0000 mgr.y (mgr.4098) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525513 |
|
2021-11-25 14:21:38 | 2021-11-25 18:27:52 | 2021-11-25 19:13:12 | 0:45:20 | 0:30:41 | 0:14:39 | smithi | master | centos | 8.3 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T18:50:09.488466+0000 mgr.y (mgr.4110) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525514 |
|
2021-11-25 14:21:38 | 2021-11-25 18:31:43 | 2021-11-25 18:58:55 | 0:27:12 | 0:21:19 | 0:05:53 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T18:58:02.811899+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525515 |
|
2021-11-25 14:21:39 | 2021-11-25 18:31:43 | 2021-11-25 18:55:39 | 0:23:56 | 0:14:18 | 0:09:38 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T18:50:17.543798+0000 mgr.y (mgr.4103) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525516 |
|
2021-11-25 14:21:40 | 2021-11-25 18:32:24 | 2021-11-25 19:05:36 | 0:33:12 | 0:18:12 | 0:15:00 | smithi | master | centos | 8.3 | rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525517 |
|
2021-11-25 14:21:41 | 2021-11-25 18:38:25 | 2021-11-25 19:27:31 | 0:49:06 | 0:40:11 | 0:08:55 | smithi | master | rhel | 8.4 | rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T19:06:51.062967+0000 mgr.x (mgr.4099) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525518 |
|
2021-11-25 14:21:42 | 2021-11-25 18:40:16 | 2021-11-25 19:01:36 | 0:21:20 | 0:09:18 | 0:12:02 | smithi | master | centos | 8.3 | rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} | 1 |
| fail | 6525519 |
|
2021-11-25 14:21:43 | 2021-11-25 18:42:06 | 2021-11-25 19:19:46 | 0:37:40 | 0:26:41 | 0:10:59 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T19:02:15.581032+0000 mgr.y (mgr.4108) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525520 |
|
2021-11-25 14:21:44 | 2021-11-25 18:42:27 | 2021-11-25 19:26:21 | 0:43:54 | 0:36:27 | 0:07:27 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} | 2 |
Failure Reason:
"2021-11-25T19:09:04.845409+0000 mgr.x (mgr.4105) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525521 |
|
2021-11-25 14:21:45 | 2021-11-25 18:43:07 | 2021-11-25 19:14:50 | 0:31:43 | 0:20:51 | 0:10:52 | smithi | master | centos | 8.3 | rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525522 |
|
2021-11-25 14:21:45 | 2021-11-25 18:43:07 | 2021-11-25 19:33:41 | 0:50:34 | 0:39:07 | 0:11:27 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} | 2 |
Failure Reason:
"2021-11-25T19:20:23.874346+0000 mgr.y (mgr.4107) 204 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525523 |
|
2021-11-25 14:21:46 | 2021-11-25 18:44:28 | 2021-11-25 20:05:53 | 1:21:25 | 1:08:32 | 0:12:53 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T19:02:59.220878+0000 mgr.y (mgr.4100) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525524 |
|
2021-11-25 14:21:47 | 2021-11-25 18:45:18 | 2021-11-25 19:26:58 | 0:41:40 | 0:34:39 | 0:07:01 | smithi | master | rhel | 8.4 | rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525525 |
|
2021-11-25 14:21:48 | 2021-11-25 18:45:29 | 2021-11-25 19:23:15 | 0:37:46 | 0:26:18 | 0:11:28 | smithi | master | ubuntu | 20.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} | 2 |
Failure Reason:
"2021-11-25T19:11:58.417289+0000 mgr.x (mgr.7854) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525526 |
|
2021-11-25 14:21:49 | 2021-11-25 18:45:29 | 2021-11-25 19:03:53 | 0:18:24 | 0:07:52 | 0:10:32 | smithi | master | ubuntu | 20.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} | 2 |
Failure Reason:
"2021-11-25T19:03:06.694846+0000 mgr.x (mgr.4100) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525527 |
|
2021-11-25 14:21:50 | 2021-11-25 18:46:10 | 2021-11-25 19:15:49 | 0:29:39 | 0:18:39 | 0:11:00 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T19:06:33.890383+0000 mgr.x (mgr.4102) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525528 |
|
2021-11-25 14:21:51 | 2021-11-25 18:46:10 | 2021-11-25 19:16:07 | 0:29:57 | 0:18:27 | 0:11:30 | smithi | master | centos | 8.2 | rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525529 |
|
2021-11-25 14:21:51 | 2021-11-25 18:47:51 | 2021-11-25 19:16:14 | 0:28:23 | 0:21:35 | 0:06:48 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T19:14:37.137406+0000 mgr.x (mgr.4102) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525530 |
|
2021-11-25 14:21:52 | 2021-11-25 18:49:11 | 2021-11-25 20:32:20 | 1:43:09 | 1:37:52 | 0:05:17 | smithi | master | rhel | 8.4 | rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} | 1 |
| fail | 6525531 |
|
2021-11-25 14:21:53 | 2021-11-25 18:49:11 | 2021-11-25 19:09:52 | 0:20:41 | 0:08:36 | 0:12:05 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} | 3 |
Failure Reason:
Command failed on smithi058 with status 5: 'sudo systemctl stop ceph-e9505dfa-4e22-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525532 |
|
2021-11-25 14:21:54 | 2021-11-25 18:50:52 | 2021-11-25 19:29:52 | 0:39:00 | 0:29:16 | 0:09:44 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T19:09:34.902202+0000 mgr.y (mgr.4111) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525533 |
|
2021-11-25 14:21:55 | 2021-11-25 18:51:02 | 2021-11-25 19:13:16 | 0:22:14 | 0:11:20 | 0:10:54 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T19:09:24.818966+0000 mgr.x (mgr.4111) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525534 |
|
2021-11-25 14:21:56 | 2021-11-25 18:51:13 | 2021-11-25 19:34:06 | 0:42:53 | 0:32:26 | 0:10:27 | smithi | master | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} | 2 |
| fail | 6525535 |
|
2021-11-25 14:21:57 | 2021-11-25 18:51:53 | 2021-11-25 19:28:52 | 0:36:59 | 0:27:18 | 0:09:41 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T19:12:03.537675+0000 mgr.y (mgr.4104) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525536 |
|
2021-11-25 14:21:58 | 2021-11-25 18:51:53 | 2021-11-25 19:21:38 | 0:29:45 | 0:19:29 | 0:10:16 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T19:07:58.309367+0000 mgr.x (mgr.4110) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525537 |
|
2021-11-25 14:21:58 | 2021-11-25 18:52:04 | 2021-11-25 19:35:31 | 0:43:27 | 0:33:41 | 0:09:46 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525538 |
|
2021-11-25 14:21:59 | 2021-11-25 18:52:14 | 2021-11-25 19:23:43 | 0:31:29 | 0:22:24 | 0:09:05 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T19:10:51.081471+0000 mgr.y (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525539 |
|
2021-11-25 14:22:00 | 2021-11-25 18:52:14 | 2021-11-25 19:17:44 | 0:25:30 | 0:15:38 | 0:09:52 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} | 1 | ||
| fail | 6525540 |
|
2021-11-25 14:22:01 | 2021-11-25 18:52:25 | 2021-11-25 19:28:01 | 0:35:36 | 0:24:36 | 0:11:00 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T19:12:57.859212+0000 mgr.y (mgr.4111) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525541 |
|
2021-11-25 14:22:02 | 2021-11-25 18:52:45 | 2021-11-25 19:20:16 | 0:27:31 | 0:17:55 | 0:09:36 | smithi | master | centos | 8.3 | rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525542 |
|
2021-11-25 14:22:03 | 2021-11-25 18:53:16 | 2021-11-25 19:25:23 | 0:32:07 | 0:21:42 | 0:10:25 | smithi | master | centos | 8.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/e2e} | 2 |
| fail | 6525543 |
|
2021-11-25 14:22:04 | 2021-11-25 18:54:06 | 2021-11-25 19:11:25 | 0:17:19 | 0:07:16 | 0:10:03 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T19:09:24.791968+0000 mgr.x (mgr.4104) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525544 |
|
2021-11-25 14:22:04 | 2021-11-25 18:54:06 | 2021-11-25 19:25:06 | 0:31:00 | 0:24:23 | 0:06:37 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T19:20:47.241348+0000 mgr.y (mgr.4100) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525545 |
|
2021-11-25 14:22:05 | 2021-11-25 18:54:17 | 2021-11-25 19:41:32 | 0:47:15 | 0:40:26 | 0:06:49 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 |
Failure Reason:
"2021-11-25T19:21:18.589586+0000 mgr.x (mgr.4111) 54 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525546 |
|
2021-11-25 14:22:06 | 2021-11-25 18:54:17 | 2021-11-25 19:27:37 | 0:33:20 | 0:23:04 | 0:10:16 | smithi | master | centos | 8.2 | rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525547 |
|
2021-11-25 14:22:07 | 2021-11-25 18:54:17 | 2021-11-25 19:24:01 | 0:29:44 | 0:22:25 | 0:07:19 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T19:20:18.425552+0000 mgr.y (mgr.4100) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525548 |
|
2021-11-25 14:22:08 | 2021-11-25 18:54:58 | 2021-11-25 19:16:52 | 0:21:54 | 0:11:03 | 0:10:51 | smithi | master | centos | 8.stream | rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T19:14:37.369086+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525549 |
|
2021-11-25 14:22:09 | 2021-11-25 18:55:38 | 2021-11-25 19:17:12 | 0:21:34 | 0:11:20 | 0:10:14 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} | 1 |
Failure Reason:
"2021-11-25T19:11:14.012852+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525550 |
|
2021-11-25 14:22:10 | 2021-11-25 18:55:39 | 2021-11-25 19:22:51 | 0:27:12 | 0:17:49 | 0:09:23 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525551 |
|
2021-11-25 14:22:11 | 2021-11-25 18:55:39 | 2021-11-25 19:25:04 | 0:29:25 | 0:19:07 | 0:10:18 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
"2021-11-25T19:15:41.158035+0000 mgr.y (mgr.4107) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525552 |
|
2021-11-25 14:22:11 | 2021-11-25 18:55:49 | 2021-11-25 19:25:14 | 0:29:25 | 0:20:05 | 0:09:20 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525553 |
|
2021-11-25 14:22:12 | 2021-11-25 18:56:10 | 2021-11-25 19:42:15 | 0:46:05 | 0:34:34 | 0:11:31 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T19:16:34.908825+0000 mgr.x (mgr.4105) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525554 |
|
2021-11-25 14:22:13 | 2021-11-25 18:57:10 | 2021-11-25 21:30:59 | 2:33:49 | 2:26:08 | 0:07:41 | smithi | master | rhel | 8.4 | rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T19:22:41.286375+0000 mgr.x (mgr.4101) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525555 |
|
2021-11-25 14:22:14 | 2021-11-25 18:57:51 | 2021-11-25 19:40:54 | 0:43:03 | 0:36:02 | 0:07:01 | smithi | master | rhel | 8.4 | rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525556 |
|
2021-11-25 14:22:15 | 2021-11-25 18:57:51 | 2021-11-25 22:21:06 | 3:23:15 | 3:12:20 | 0:10:55 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi168 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525557 |
|
2021-11-25 14:22:16 | 2021-11-25 18:57:51 | 2021-11-25 19:27:16 | 0:29:25 | 0:22:03 | 0:07:22 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T19:23:17.697317+0000 mgr.x (mgr.4101) 77 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525558 |
|
2021-11-25 14:22:17 | 2021-11-25 18:58:02 | 2021-11-25 19:44:22 | 0:46:20 | 0:34:41 | 0:11:39 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| pass | 6525559 |
|
2021-11-25 14:22:18 | 2021-11-25 18:59:02 | 2021-11-25 19:18:56 | 0:19:54 | 0:06:25 | 0:13:29 | smithi | master | ubuntu | 20.04 | rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} | 3 |
| fail | 6525560 |
|
2021-11-25 14:22:18 | 2021-11-25 19:00:53 | 2021-11-25 19:23:46 | 0:22:53 | 0:10:03 | 0:12:50 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 |
Failure Reason:
"2021-11-25T19:19:06.176870+0000 mgr.x (mgr.4108) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525561 |
|
2021-11-25 14:22:19 | 2021-11-25 19:01:13 | 2021-11-25 19:51:10 | 0:49:57 | 0:38:57 | 0:11:00 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T19:17:25.394397+0000 mgr.y (mgr.4104) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525562 |
|
2021-11-25 14:22:20 | 2021-11-25 19:01:34 | 2021-11-25 19:24:46 | 0:23:12 | 0:12:22 | 0:10:50 | smithi | master | centos | 8.stream | rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T19:21:11.856218+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525563 |
|
2021-11-25 14:22:21 | 2021-11-25 19:01:34 | 2021-11-25 19:32:51 | 0:31:17 | 0:22:34 | 0:08:43 | smithi | master | centos | 8.3 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/progress} | 2 |
Failure Reason:
"2021-11-25T19:20:09.994085+0000 mgr.x (mgr.4562) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525564 |
|
2021-11-25 14:22:22 | 2021-11-25 19:01:44 | 2021-11-25 19:35:27 | 0:33:43 | 0:26:52 | 0:06:51 | smithi | master | rhel | 8.4 | rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} | 2 |
Failure Reason:
"2021-11-25T19:30:48.346352+0000 mgr.x (mgr.4851) 51 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525565 |
|
2021-11-25 14:22:23 | 2021-11-25 19:01:45 | 2021-11-25 19:49:00 | 0:47:15 | 0:39:46 | 0:07:29 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T19:28:32.227083+0000 mgr.x (mgr.4105) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525566 |
|
2021-11-25 14:22:24 | 2021-11-25 19:01:55 | 2021-11-25 19:44:05 | 0:42:10 | 0:32:03 | 0:10:07 | smithi | master | centos | 8.3 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} | 2 |
Failure Reason:
"2021-11-25T19:20:59.435954+0000 mgr.y (mgr.4104) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525567 |
|
2021-11-25 14:22:25 | 2021-11-25 19:02:36 | 2021-11-25 19:50:27 | 0:47:51 | 0:40:20 | 0:07:31 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T19:30:07.036616+0000 mgr.x (mgr.4101) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525568 |
|
2021-11-25 14:22:25 | 2021-11-25 19:02:56 | 2021-11-25 19:30:26 | 0:27:30 | 0:16:54 | 0:10:36 | smithi | master | centos | 8.2 | rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525569 |
|
2021-11-25 14:22:26 | 2021-11-25 19:03:27 | 2021-11-25 19:28:32 | 0:25:05 | 0:14:35 | 0:10:30 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T19:22:08.820825+0000 mgr.y (mgr.4103) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525570 |
|
2021-11-25 14:22:27 | 2021-11-25 19:03:27 | 2021-11-25 19:32:52 | 0:29:25 | 0:17:21 | 0:12:04 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525571 |
|
2021-11-25 14:22:28 | 2021-11-25 19:03:48 | 2021-11-25 19:35:18 | 0:31:30 | 0:20:50 | 0:10:40 | smithi | master | centos | 8.3 | rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} | 2 |
Failure Reason:
"2021-11-25T19:22:53.727477+0000 mgr.x (mgr.4104) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525572 |
|
2021-11-25 14:22:29 | 2021-11-25 19:03:58 | 2021-11-25 19:28:07 | 0:24:09 | 0:13:51 | 0:10:18 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T19:23:18.019505+0000 mgr.y (mgr.4107) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525573 |
|
2021-11-25 14:22:30 | 2021-11-25 19:05:18 | 2021-11-25 19:38:43 | 0:33:25 | 0:24:12 | 0:09:13 | smithi | master | centos | 8.stream | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects} | 2 |
Failure Reason:
"2021-11-25T19:25:05.068274+0000 mgr.y (mgr.4110) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525574 |
|
2021-11-25 14:22:31 | 2021-11-25 19:05:39 | 2021-11-25 19:25:13 | 0:19:34 | 0:09:39 | 0:09:55 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T19:21:05.623642+0000 mgr.x (mgr.4101) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525575 |
|
2021-11-25 14:22:31 | 2021-11-25 19:05:39 | 2021-11-25 19:22:38 | 0:16:59 | 0:04:42 | 0:12:17 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} | 1 | ||
| fail | 6525576 |
|
2021-11-25 14:22:32 | 2021-11-25 19:07:10 | 2021-11-25 19:38:14 | 0:31:04 | 0:24:50 | 0:06:14 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T19:32:41.882926+0000 mgr.x (mgr.4099) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525577 |
|
2021-11-25 14:22:33 | 2021-11-25 19:07:10 | 2021-11-25 19:34:29 | 0:27:19 | 0:21:13 | 0:06:06 | smithi | master | rhel | 8.4 | rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T19:32:31.298548+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525578 |
|
2021-11-25 14:22:34 | 2021-11-25 19:07:11 | 2021-11-26 01:35:11 | 6:28:00 | 6:14:47 | 0:13:13 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi062 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525579 |
|
2021-11-25 14:22:35 | 2021-11-25 19:10:01 | 2021-11-25 19:38:57 | 0:28:56 | 0:17:38 | 0:11:18 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525580 |
|
2021-11-25 14:22:36 | 2021-11-25 19:11:22 | 2021-11-25 19:37:04 | 0:25:42 | 0:15:14 | 0:10:28 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T19:30:09.324425+0000 mgr.x (mgr.4105) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525581 |
|
2021-11-25 14:22:37 | 2021-11-25 19:11:32 | 2021-11-25 19:40:22 | 0:28:50 | 0:20:06 | 0:08:44 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525582 |
|
2021-11-25 14:22:38 | 2021-11-25 19:11:33 | 2021-11-25 19:45:38 | 0:34:05 | 0:22:44 | 0:11:21 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T19:30:50.221879+0000 mgr.x (mgr.4110) 45 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525583 |
|
2021-11-25 14:22:38 | 2021-11-25 19:12:33 | 2021-11-25 19:38:28 | 0:25:55 | 0:12:55 | 0:13:00 | smithi | master | centos | 8.3 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T19:33:57.103757+0000 mgr.y (mgr.4107) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525584 |
|
2021-11-25 14:22:39 | 2021-11-25 19:13:24 | 2021-11-25 19:46:28 | 0:33:04 | 0:23:10 | 0:09:54 | smithi | master | centos | 8.3 | rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525585 |
|
2021-11-25 14:22:40 | 2021-11-25 19:13:24 | 2021-11-25 19:33:26 | 0:20:02 | 0:09:48 | 0:10:14 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} | 1 |
Failure Reason:
"2021-11-25T19:29:27.332161+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525586 |
|
2021-11-25 14:22:41 | 2021-11-25 19:13:24 | 2021-11-25 19:49:42 | 0:36:18 | 0:22:49 | 0:13:29 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T19:32:27.433478+0000 mgr.x (mgr.4105) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525587 |
|
2021-11-25 14:22:42 | 2021-11-25 19:14:55 | 2021-11-25 19:43:26 | 0:28:31 | 0:17:43 | 0:10:48 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525588 |
|
2021-11-25 14:22:43 | 2021-11-25 19:15:55 | 2021-11-25 19:47:19 | 0:31:24 | 0:25:26 | 0:05:58 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} | 1 |
| pass | 6525589 |
|
2021-11-25 14:22:44 | 2021-11-25 19:16:16 | 2021-11-25 19:40:04 | 0:23:48 | 0:13:43 | 0:10:05 | smithi | master | ubuntu | 20.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} | 1 |
| fail | 6525590 |
|
2021-11-25 14:22:45 | 2021-11-25 19:16:16 | 2021-11-25 19:52:21 | 0:36:05 | 0:26:16 | 0:09:49 | smithi | master | centos | 8.3 | rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} | 1 |
Failure Reason:
"2021-11-25T19:51:12.288548+0000 mgr.x (mgr.4121) 211 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525591 |
|
2021-11-25 14:22:45 | 2021-11-25 19:16:17 | 2021-11-25 19:52:21 | 0:36:04 | 0:24:53 | 0:11:11 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T19:35:38.190635+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525592 |
|
2021-11-25 14:22:46 | 2021-11-25 19:17:17 | 2021-11-25 19:38:43 | 0:21:26 | 0:11:16 | 0:10:10 | smithi | master | centos | 8.3 | rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T19:35:31.634594+0000 mgr.x (mgr.4100) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525593 |
|
2021-11-25 14:22:47 | 2021-11-25 19:17:47 | 2021-11-25 19:54:55 | 0:37:08 | 0:25:21 | 0:11:47 | smithi | master | ubuntu | 20.04 | rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525594 |
|
2021-11-25 14:22:48 | 2021-11-25 19:18:58 | 2021-11-25 20:07:02 | 0:48:04 | 0:39:54 | 0:08:10 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T19:45:46.360323+0000 mgr.y (mgr.4107) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525595 |
|
2021-11-25 14:22:49 | 2021-11-25 19:19:48 | 2021-11-25 20:04:05 | 0:44:17 | 0:33:31 | 0:10:46 | smithi | master | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} | 2 |
| fail | 6525596 |
|
2021-11-25 14:22:50 | 2021-11-25 19:20:19 | 2021-11-25 20:03:06 | 0:42:47 | 0:31:21 | 0:11:26 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T19:41:41.361661+0000 mgr.x (mgr.4108) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525597 |
|
2021-11-25 14:22:51 | 2021-11-25 19:21:49 | 2021-11-25 20:02:17 | 0:40:28 | 0:29:04 | 0:11:24 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525598 |
|
2021-11-25 14:22:51 | 2021-11-25 19:23:00 | 2021-11-25 20:04:36 | 0:41:36 | 0:35:23 | 0:06:13 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T19:49:09.494016+0000 mgr.y (mgr.4103) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525599 |
|
2021-11-25 14:22:52 | 2021-11-25 19:23:20 | 2021-11-25 19:41:06 | 0:17:46 | 0:08:13 | 0:09:33 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} | 3 |
Failure Reason:
Command failed on smithi136 with status 5: 'sudo systemctl stop ceph-7e255c2e-4e27-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525600 |
|
2021-11-25 14:22:53 | 2021-11-25 19:23:51 | 2021-11-25 19:47:10 | 0:23:19 | 0:13:33 | 0:09:46 | smithi | master | centos | 8.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8.stream} tasks/prometheus} | 2 |
Failure Reason:
Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus) |
||||||||||||||
| fail | 6525601 |
|
2021-11-25 14:22:54 | 2021-11-25 19:23:51 | 2021-11-25 19:53:15 | 0:29:24 | 0:21:49 | 0:07:35 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525602 |
|
2021-11-25 14:22:55 | 2021-11-25 19:24:11 | 2021-11-25 20:00:04 | 0:35:53 | 0:27:53 | 0:08:00 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T19:50:46.266419+0000 mgr.y (mgr.4107) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525603 |
|
2021-11-25 14:22:56 | 2021-11-25 19:24:52 | 2021-11-25 19:54:43 | 0:29:51 | 0:18:47 | 0:11:04 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 2 |
Failure Reason:
"2021-11-25T19:41:01.019506+0000 mgr.x (mgr.4103) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525604 |
|
2021-11-25 14:22:57 | 2021-11-25 19:25:12 | 2021-11-25 21:15:57 | 1:50:45 | 1:42:07 | 0:08:38 | smithi | master | centos | 8.3 | rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T19:42:33.276544+0000 mgr.x (mgr.4105) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525605 |
|
2021-11-25 14:22:58 | 2021-11-25 19:25:13 | 2021-11-25 22:18:07 | 2:52:54 | 2:43:37 | 0:09:17 | smithi | master | centos | 8.stream | rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T19:43:35.281924+0000 mgr.x (mgr.4102) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525606 |
|
2021-11-25 14:22:58 | 2021-11-25 19:25:13 | 2021-11-25 19:49:19 | 0:24:06 | 0:13:18 | 0:10:48 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T19:41:54.237406+0000 mgr.y (mgr.4107) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| dead | 6525607 |
|
2021-11-25 14:22:59 | 2021-11-25 19:25:23 | 2021-11-26 07:35:19 | 12:09:56 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 6525608 |
|
2021-11-25 14:23:00 | 2021-11-25 19:25:34 | 2021-11-25 19:57:33 | 0:31:59 | 0:22:09 | 0:09:50 | smithi | master | centos | 8.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} | 2 |
Failure Reason:
"2021-11-25T19:44:55.217338+0000 mgr.x (mgr.4107) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525609 |
|
2021-11-25 14:23:01 | 2021-11-25 19:26:24 | 2021-11-25 19:54:35 | 0:28:11 | 0:16:48 | 0:11:23 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T19:45:27.558779+0000 mgr.x (mgr.4099) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525610 |
|
2021-11-25 14:23:02 | 2021-11-25 19:27:05 | 2021-11-25 19:56:31 | 0:29:26 | 0:21:42 | 0:07:44 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525611 |
|
2021-11-25 14:23:03 | 2021-11-25 19:27:25 | 2021-11-25 20:04:31 | 0:37:06 | 0:27:15 | 0:09:51 | smithi | master | centos | 8.stream | rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi116 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| pass | 6525612 |
|
2021-11-25 14:23:03 | 2021-11-25 19:27:35 | 2021-11-25 19:55:05 | 0:27:30 | 0:21:37 | 0:05:53 | smithi | master | rhel | 8.4 | rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} | 2 |
| fail | 6525613 |
|
2021-11-25 14:23:04 | 2021-11-25 19:27:46 | 2021-11-25 20:04:22 | 0:36:36 | 0:25:12 | 0:11:24 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 |
Failure Reason:
"2021-11-25T19:45:50.637743+0000 mgr.x (mgr.4103) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525614 |
|
2021-11-25 14:23:05 | 2021-11-25 19:28:06 | 2021-11-25 19:51:46 | 0:23:40 | 0:14:01 | 0:09:39 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T19:44:25.944076+0000 mgr.x (mgr.4113) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525615 |
|
2021-11-25 14:23:06 | 2021-11-25 19:28:17 | 2021-11-25 19:59:56 | 0:31:39 | 0:24:21 | 0:07:18 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525616 |
|
2021-11-25 14:23:07 | 2021-11-25 19:28:37 | 2021-11-25 20:13:58 | 0:45:21 | 0:37:51 | 0:07:30 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T19:55:37.171117+0000 mgr.x (mgr.4108) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525617 |
|
2021-11-25 14:23:08 | 2021-11-25 19:28:57 | 2021-11-25 20:03:02 | 0:34:05 | 0:23:24 | 0:10:41 | smithi | master | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525618 |
|
2021-11-25 14:23:09 | 2021-11-25 19:29:58 | 2021-11-25 20:43:35 | 1:13:37 | 1:06:28 | 0:07:09 | smithi | master | rhel | 8.4 | rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T19:55:47.973947+0000 mgr.x (mgr.4105) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525619 |
|
2021-11-25 14:23:09 | 2021-11-25 19:30:28 | 2021-11-25 20:05:32 | 0:35:04 | 0:23:42 | 0:11:22 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T19:50:25.171111+0000 mgr.x (mgr.4101) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525620 |
|
2021-11-25 14:23:10 | 2021-11-25 19:32:09 | 2021-11-25 20:14:04 | 0:41:55 | 0:31:07 | 0:10:48 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T19:52:00.144341+0000 mgr.y (mgr.4103) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525621 |
|
2021-11-25 14:23:11 | 2021-11-25 19:32:59 | 2021-11-25 20:38:06 | 1:05:07 | 0:55:20 | 0:09:47 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T19:52:15.698933+0000 mgr.y (mgr.4105) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525622 |
|
2021-11-25 14:23:12 | 2021-11-25 19:33:00 | 2021-11-25 20:08:33 | 0:35:33 | 0:24:44 | 0:10:49 | smithi | master | centos | 8.3 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} | 2 |
Failure Reason:
"2021-11-25T19:51:57.807864+0000 mgr.x (mgr.4102) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525623 |
|
2021-11-25 14:23:13 | 2021-11-25 19:33:30 | 2021-11-25 20:01:09 | 0:27:39 | 0:17:15 | 0:10:24 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525624 |
|
2021-11-25 14:23:14 | 2021-11-25 19:33:50 | 2021-11-25 19:56:07 | 0:22:17 | 0:10:06 | 0:12:11 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} | 1 |
Failure Reason:
"2021-11-25T19:50:43.475348+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525625 |
|
2021-11-25 14:23:15 | 2021-11-25 19:33:51 | 2021-11-25 19:52:03 | 0:18:12 | 0:07:19 | 0:10:53 | smithi | master | ubuntu | 20.04 | rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} | 2 |
Failure Reason:
"2021-11-25T19:50:45.491440+0000 mgr.x (mgr.4107) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525626 |
|
2021-11-25 14:23:15 | 2021-11-25 19:34:11 | 2021-11-25 20:09:35 | 0:35:24 | 0:23:24 | 0:12:00 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T19:52:10.413354+0000 mgr.y (mgr.4110) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525627 |
|
2021-11-25 14:23:16 | 2021-11-25 19:35:22 | 2021-11-25 20:19:49 | 0:44:27 | 0:33:34 | 0:10:53 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 2 |
Failure Reason:
"2021-11-25T19:52:21.403793+0000 mgr.y (mgr.4110) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525628 |
|
2021-11-25 14:23:17 | 2021-11-25 19:35:32 | 2021-11-25 20:04:44 | 0:29:12 | 0:21:57 | 0:07:15 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525629 |
|
2021-11-25 14:23:18 | 2021-11-25 19:35:32 | 2021-11-25 20:14:26 | 0:38:54 | 0:27:29 | 0:11:25 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T19:57:31.492842+0000 mgr.y (mgr.4107) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525630 |
|
2021-11-25 14:23:19 | 2021-11-25 19:37:13 | 2021-11-25 20:11:27 | 0:34:14 | 0:22:53 | 0:11:21 | smithi | master | centos | 8.2 | rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525631 |
|
2021-11-25 14:23:20 | 2021-11-25 19:38:24 | 2021-11-25 20:39:55 | 1:01:31 | 0:51:56 | 0:09:35 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} | 2 |
Failure Reason:
"2021-11-25T20:13:59.681756+0000 mgr.x (mgr.4107) 234 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525632 |
|
2021-11-25 14:23:21 | 2021-11-25 19:38:34 | 2021-11-25 20:01:48 | 0:23:14 | 0:13:28 | 0:09:46 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T19:56:56.460465+0000 mgr.x (mgr.4101) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525633 |
|
2021-11-25 14:23:22 | 2021-11-25 19:38:34 | 2021-11-25 20:22:00 | 0:43:26 | 0:33:03 | 0:10:23 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| pass | 6525634 |
|
2021-11-25 14:23:23 | 2021-11-25 19:38:45 | 2021-11-25 19:53:58 | 0:15:13 | 0:06:00 | 0:09:13 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 |
| fail | 6525635 |
|
2021-11-25 14:23:23 | 2021-11-25 19:38:45 | 2021-11-25 19:57:48 | 0:19:03 | 0:09:40 | 0:09:23 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T19:56:20.657051+0000 mgr.x (mgr.4101) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525636 |
|
2021-11-25 14:23:24 | 2021-11-25 19:38:45 | 2021-11-25 20:02:15 | 0:23:30 | 0:11:10 | 0:12:20 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T19:56:59.462221+0000 mgr.x (mgr.4107) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525637 |
|
2021-11-25 14:23:25 | 2021-11-25 19:39:06 | 2021-11-25 20:04:00 | 0:24:54 | 0:13:44 | 0:11:10 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T20:01:16.367044+0000 mgr.x (mgr.4105) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525638 |
|
2021-11-25 14:23:26 | 2021-11-25 19:40:56 | 2021-11-25 20:10:34 | 0:29:38 | 0:22:17 | 0:07:21 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525639 |
|
2021-11-25 14:23:27 | 2021-11-25 19:41:07 | 2021-11-25 20:06:18 | 0:25:11 | 0:15:11 | 0:10:00 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
"2021-11-25T19:59:32.570393+0000 mgr.y (mgr.4103) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525640 |
|
2021-11-25 14:23:28 | 2021-11-25 19:41:07 | 2021-11-25 20:14:51 | 0:33:44 | 0:25:56 | 0:07:48 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525641 |
|
2021-11-25 14:23:29 | 2021-11-25 19:41:38 | 2021-11-25 20:09:25 | 0:27:47 | 0:20:58 | 0:06:49 | smithi | master | rhel | 8.4 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/workunits} | 2 |
Failure Reason:
"2021-11-25T20:07:49.097377+0000 mgr.x (mgr.4101) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525642 |
|
2021-11-25 14:23:30 | 2021-11-25 19:42:18 | 2021-11-25 20:16:34 | 0:34:16 | 0:20:26 | 0:13:50 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T20:00:59.012982+0000 mgr.x (mgr.4108) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525643 |
|
2021-11-25 14:23:31 | 2021-11-25 19:43:28 | 2021-11-25 20:14:10 | 0:30:42 | 0:18:39 | 0:12:03 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| dead | 6525644 |
|
2021-11-25 14:23:31 | 2021-11-25 19:44:09 | 2021-11-26 07:56:35 | 12:12:26 | smithi | master | ubuntu | 20.04 | rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.0} | 3 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 6525645 |
|
2021-11-25 14:23:32 | 2021-11-25 19:45:39 | 2021-11-25 23:11:48 | 3:26:09 | 3:14:45 | 0:11:24 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi084 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| pass | 6525646 |
|
2021-11-25 14:23:33 | 2021-11-25 19:46:30 | 2021-11-25 20:32:37 | 0:46:07 | 0:35:26 | 0:10:41 | smithi | master | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} | 2 |
| fail | 6525647 |
|
2021-11-25 14:23:34 | 2021-11-25 19:47:20 | 2021-11-25 21:06:28 | 1:19:08 | 1:09:07 | 0:10:01 | smithi | master | centos | 8.3 | rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T20:05:47.275840+0000 mgr.x (mgr.4107) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525648 |
|
2021-11-25 14:23:35 | 2021-11-25 19:47:21 | 2021-11-25 20:26:06 | 0:38:45 | 0:27:55 | 0:10:50 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T20:09:44.708592+0000 mgr.x (mgr.4102) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525649 |
|
2021-11-25 14:23:36 | 2021-11-25 19:49:01 | 2021-11-25 20:28:45 | 0:39:44 | 0:32:31 | 0:07:13 | smithi | master | rhel | 8.4 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} | 2 |
Failure Reason:
"2021-11-25T20:07:26.276555+0000 mgr.y (mgr.4104) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525650 |
|
2021-11-25 14:23:37 | 2021-11-25 19:49:42 | 2021-11-25 20:47:55 | 0:58:13 | 0:47:21 | 0:10:52 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525651 |
|
2021-11-25 14:23:38 | 2021-11-25 19:49:42 | 2021-11-25 20:55:10 | 1:05:28 | 0:56:18 | 0:09:10 | smithi | master | centos | 8.3 | rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} | 1 |
| fail | 6525652 |
|
2021-11-25 14:23:39 | 2021-11-25 19:49:52 | 2021-11-25 20:17:57 | 0:28:05 | 0:16:50 | 0:11:15 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525653 |
|
2021-11-25 14:23:39 | 2021-11-25 19:49:53 | 2021-11-25 21:25:49 | 1:35:56 | 1:29:27 | 0:06:29 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T20:17:19.013274+0000 mgr.x (mgr.4099) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525654 |
|
2021-11-25 14:23:40 | 2021-11-25 19:50:33 | 2021-11-25 20:24:14 | 0:33:41 | 0:24:06 | 0:09:35 | smithi | master | centos | 8.3 | rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525655 |
|
2021-11-25 14:23:41 | 2021-11-25 19:51:14 | 2021-11-25 20:18:35 | 0:27:21 | 0:20:27 | 0:06:54 | smithi | master | rhel | 8.4 | rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} | 1 |
| fail | 6525656 |
|
2021-11-25 14:23:42 | 2021-11-25 19:51:54 | 2021-11-25 20:15:34 | 0:23:40 | 0:13:58 | 0:09:42 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T20:08:12.921431+0000 mgr.y (mgr.4109) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525657 |
|
2021-11-25 14:23:43 | 2021-11-25 19:52:04 | 2021-11-25 20:19:39 | 0:27:35 | 0:17:54 | 0:09:41 | smithi | master | centos | 8.2 | rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525658 |
|
2021-11-25 14:23:44 | 2021-11-25 19:52:25 | 2021-11-25 20:18:25 | 0:26:00 | 0:15:20 | 0:10:40 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T20:12:01.944221+0000 mgr.y (mgr.4103) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525659 |
|
2021-11-25 14:23:45 | 2021-11-25 19:52:25 | 2021-11-25 20:14:59 | 0:22:34 | 0:11:05 | 0:11:29 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} | 1 |
Failure Reason:
"2021-11-25T20:09:02.947077+0000 mgr.x (mgr.4099) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525660 |
|
2021-11-25 14:23:46 | 2021-11-25 19:53:26 | 2021-11-25 21:09:26 | 1:16:00 | 1:04:38 | 0:11:22 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T20:09:34.817451+0000 mgr.x (mgr.4112) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525661 |
|
2021-11-25 14:23:47 | 2021-11-25 19:53:26 | 2021-11-25 20:32:11 | 0:38:45 | 0:27:15 | 0:11:30 | smithi | master | centos | 8.stream | rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 |
| fail | 6525662 |
|
2021-11-25 14:23:48 | 2021-11-25 19:54:36 | 2021-11-25 20:20:05 | 0:25:29 | 0:14:36 | 0:10:53 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T20:10:47.207961+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525663 |
|
2021-11-25 14:23:48 | 2021-11-25 19:54:47 | 2021-11-25 20:19:47 | 0:25:00 | 0:14:30 | 0:10:30 | smithi | master | centos | 8.stream | rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T20:13:56.203569+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525664 |
|
2021-11-25 14:23:49 | 2021-11-25 19:54:47 | 2021-11-25 20:36:02 | 0:41:15 | 0:30:23 | 0:10:52 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525665 |
|
2021-11-25 14:23:50 | 2021-11-25 19:54:58 | 2021-11-25 20:28:34 | 0:33:36 | 0:26:51 | 0:06:45 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T20:21:09.942139+0000 mgr.y (mgr.4107) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525666 |
|
2021-11-25 14:23:51 | 2021-11-25 19:55:08 | 2021-11-25 20:15:17 | 0:20:09 | 0:10:28 | 0:09:41 | smithi | master | centos | 8.stream | rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_no_skews} | 2 |
| fail | 6525667 |
|
2021-11-25 14:23:52 | 2021-11-25 19:56:39 | 2021-11-25 20:27:07 | 0:30:28 | 0:23:03 | 0:07:25 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 |
Failure Reason:
"2021-11-25T20:23:59.811229+0000 mgr.x (mgr.4101) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525668 |
|
2021-11-25 14:23:53 | 2021-11-25 19:56:49 | 2021-11-25 20:25:13 | 0:28:24 | 0:18:14 | 0:10:10 | smithi | master | ubuntu | 20.04 | rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525669 |
|
2021-11-25 14:23:54 | 2021-11-25 19:57:40 | 2021-11-25 20:35:19 | 0:37:39 | 0:24:19 | 0:13:20 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T20:19:52.799527+0000 mgr.y (mgr.4103) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525670 |
|
2021-11-25 14:23:55 | 2021-11-25 20:00:00 | 2021-11-25 20:19:29 | 0:19:29 | 0:08:13 | 0:11:16 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} | 3 |
Failure Reason:
Command failed on smithi099 with status 5: 'sudo systemctl stop ceph-9b0e98b4-4e2c-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525671 |
|
2021-11-25 14:23:56 | 2021-11-25 20:00:11 | 2021-11-25 20:35:25 | 0:35:14 | 0:23:15 | 0:11:59 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525672 |
|
2021-11-25 14:23:57 | 2021-11-25 20:01:51 | 2021-11-25 20:39:24 | 0:37:33 | 0:31:20 | 0:06:13 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T20:27:41.062921+0000 mgr.y (mgr.4110) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525673 |
|
2021-11-25 14:23:57 | 2021-11-25 20:02:22 | 2021-11-25 20:37:57 | 0:35:35 | 0:25:03 | 0:10:32 | smithi | master | centos | 8.3 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T20:21:30.366784+0000 mgr.y (mgr.4110) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525674 |
|
2021-11-25 14:23:58 | 2021-11-25 20:02:22 | 2021-11-25 20:19:40 | 0:17:18 | 0:06:44 | 0:10:34 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T20:17:28.022873+0000 mgr.x (mgr.4102) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525675 |
|
2021-11-25 14:23:59 | 2021-11-25 20:02:22 | 2021-11-25 20:45:52 | 0:43:30 | 0:35:44 | 0:07:46 | smithi | master | rhel | 8.4 | rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525676 |
|
2021-11-25 14:24:00 | 2021-11-25 20:03:03 | 2021-11-25 23:28:42 | 3:25:39 | 3:14:27 | 0:11:12 | smithi | master | centos | 8.3 | rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi112 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525677 |
|
2021-11-25 14:24:01 | 2021-11-25 20:03:13 | 2021-11-25 20:42:54 | 0:39:41 | 0:33:12 | 0:06:29 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T20:30:32.715375+0000 mgr.y (mgr.4112) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525678 |
|
2021-11-25 14:24:02 | 2021-11-25 20:04:04 | 2021-11-25 20:47:19 | 0:43:15 | 0:36:29 | 0:06:46 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T20:31:11.309091+0000 mgr.x (mgr.4111) 46 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525679 |
|
2021-11-25 14:24:03 | 2021-11-25 20:04:04 | 2021-11-25 20:33:42 | 0:29:38 | 0:18:25 | 0:11:13 | smithi | master | centos | 8.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} | 2 |
Failure Reason:
Test failure: test_token_ttl (tasks.mgr.dashboard.test_auth.AuthTest) |
||||||||||||||
| pass | 6525680 |
|
2021-11-25 14:24:04 | 2021-11-25 20:04:15 | 2021-11-25 20:24:42 | 0:20:27 | 0:09:38 | 0:10:49 | smithi | master | ubuntu | 20.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/crash} | 2 |
| fail | 6525681 |
|
2021-11-25 14:24:05 | 2021-11-25 20:04:25 | 2021-11-25 20:33:26 | 0:29:01 | 0:19:39 | 0:09:22 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T20:22:41.012571+0000 mgr.x (mgr.4101) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525682 |
|
2021-11-25 14:24:06 | 2021-11-25 20:04:25 | 2021-11-25 21:41:55 | 1:37:30 | 1:30:09 | 0:07:21 | smithi | master | rhel | 8.4 | rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
| fail | 6525683 |
|
2021-11-25 14:24:07 | 2021-11-25 20:04:46 | 2021-11-25 20:32:01 | 0:27:15 | 0:18:11 | 0:09:04 | smithi | master | centos | 8.3 | rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525684 |
|
2021-11-25 14:24:08 | 2021-11-25 20:04:46 | 2021-11-25 20:47:36 | 0:42:50 | 0:28:46 | 0:14:04 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T20:24:08.780660+0000 mgr.y (mgr.4104) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525685 |
|
2021-11-25 14:24:09 | 2021-11-25 20:05:36 | 2021-11-25 20:35:26 | 0:29:50 | 0:18:42 | 0:11:08 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} | 2 |
Failure Reason:
"2021-11-25T20:25:21.988399+0000 mgr.y (mgr.4107) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525686 |
|
2021-11-25 14:24:10 | 2021-11-25 20:05:57 | 2021-11-25 20:39:46 | 0:33:49 | 0:22:25 | 0:11:24 | smithi | master | centos | 8.stream | rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525687 |
|
2021-11-25 14:24:11 | 2021-11-25 20:06:27 | 2021-11-25 20:50:25 | 0:43:58 | 0:36:09 | 0:07:49 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T20:33:09.549211+0000 mgr.y (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525688 |
|
2021-11-25 14:24:12 | 2021-11-25 20:07:08 | 2021-11-25 20:49:58 | 0:42:50 | 0:30:18 | 0:12:32 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525689 |
|
2021-11-25 14:24:12 | 2021-11-25 20:08:38 | 2021-11-25 20:52:34 | 0:43:56 | 0:33:54 | 0:10:02 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T20:28:59.811074+0000 mgr.y (mgr.4104) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525690 |
|
2021-11-25 14:24:13 | 2021-11-25 20:09:29 | 2021-11-25 20:42:10 | 0:32:41 | 0:23:33 | 0:09:08 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T20:37:26.367462+0000 mgr.y (mgr.4101) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525691 |
|
2021-11-25 14:24:14 | 2021-11-25 20:10:39 | 2021-11-25 20:42:08 | 0:31:29 | 0:23:58 | 0:07:31 | smithi | master | rhel | 8.4 | rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T20:36:15.779871+0000 mgr.x (mgr.4102) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525692 |
|
2021-11-25 14:24:15 | 2021-11-25 20:11:30 | 2021-11-25 20:59:01 | 0:47:31 | 0:35:19 | 0:12:12 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
| fail | 6525693 |
|
2021-11-25 14:24:16 | 2021-11-25 20:14:00 | 2021-11-25 20:47:14 | 0:33:14 | 0:26:38 | 0:06:36 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T20:39:56.264926+0000 mgr.y (mgr.4107) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525694 |
|
2021-11-25 14:24:17 | 2021-11-25 20:14:11 | 2021-11-25 20:38:00 | 0:23:49 | 0:13:46 | 0:10:03 | smithi | master | centos | 8.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/readwrite} | 2 |
Failure Reason:
"2021-11-25T20:33:34.124529+0000 mgr.y (mgr.4104) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525695 |
|
2021-11-25 14:24:18 | 2021-11-25 20:14:11 | 2021-11-25 20:54:00 | 0:39:49 | 0:32:22 | 0:07:27 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T20:41:55.473074+0000 mgr.y (mgr.4100) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525696 |
|
2021-11-25 14:24:19 | 2021-11-25 20:14:31 | 2021-11-25 20:42:16 | 0:27:45 | 0:16:25 | 0:11:20 | smithi | master | centos | 8.stream | rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} | 2 |
Failure Reason:
"2021-11-25T20:36:16.331603+0000 mgr.z (mgr.14674) 51 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.z: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525697 |
|
2021-11-25 14:24:20 | 2021-11-25 20:15:02 | 2021-11-25 20:34:20 | 0:19:18 | 0:08:23 | 0:10:55 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T20:30:24.676958+0000 mgr.x (mgr.4101) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525698 |
|
2021-11-25 14:24:21 | 2021-11-25 20:15:02 | 2021-11-25 20:56:33 | 0:41:31 | 0:34:27 | 0:07:04 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} | 2 |
Failure Reason:
"2021-11-25T20:41:13.152723+0000 mgr.y (mgr.4101) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525699 |
|
2021-11-25 14:24:22 | 2021-11-25 20:15:22 | 2021-11-25 20:48:47 | 0:33:25 | 0:23:02 | 0:10:23 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T20:35:13.706071+0000 mgr.y (mgr.4107) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525700 |
|
2021-11-25 14:24:23 | 2021-11-25 20:15:43 | 2021-11-25 20:44:14 | 0:28:31 | 0:18:12 | 0:10:19 | smithi | master | centos | 8.2 | rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525701 |
|
2021-11-25 14:24:24 | 2021-11-25 20:16:43 | 2021-11-25 20:36:16 | 0:19:33 | 0:09:56 | 0:09:37 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} | 1 |
Failure Reason:
"2021-11-25T20:31:57.545304+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525702 |
|
2021-11-25 14:24:25 | 2021-11-25 20:16:44 | 2021-11-25 20:42:33 | 0:25:49 | 0:13:48 | 0:12:01 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T20:37:52.235468+0000 mgr.x (mgr.4108) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525703 |
|
2021-11-25 14:24:26 | 2021-11-25 20:18:34 | 2021-11-25 20:48:14 | 0:29:40 | 0:20:29 | 0:09:11 | smithi | master | centos | 8.2 | rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525704 |
|
2021-11-25 14:24:27 | 2021-11-25 20:18:45 | 2021-11-25 20:44:35 | 0:25:50 | 0:14:38 | 0:11:12 | smithi | master | centos | 8.stream | rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T20:38:19.956380+0000 mgr.x (mgr.4102) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525705 |
|
2021-11-25 14:24:28 | 2021-11-25 20:19:35 | 2021-11-25 20:43:19 | 0:23:44 | 0:13:23 | 0:10:21 | smithi | master | ubuntu | 20.04 | rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} | 1 |
| fail | 6525706 |
|
2021-11-25 14:24:29 | 2021-11-25 20:19:35 | 2021-11-25 21:01:18 | 0:41:43 | 0:35:06 | 0:06:37 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T20:46:27.144377+0000 mgr.x (mgr.4105) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525707 |
|
2021-11-25 14:24:30 | 2021-11-25 20:19:46 | 2021-11-25 20:46:24 | 0:26:38 | 0:21:16 | 0:05:22 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525708 |
|
2021-11-25 14:24:31 | 2021-11-25 20:19:46 | 2021-11-25 20:57:39 | 0:37:53 | 0:26:58 | 0:10:55 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T20:40:21.110341+0000 mgr.y (mgr.4110) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525709 |
|
2021-11-25 14:24:31 | 2021-11-25 20:19:56 | 2021-11-25 20:37:14 | 0:17:18 | 0:07:54 | 0:09:24 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} | 1 | ||
| fail | 6525710 |
|
2021-11-25 14:24:32 | 2021-11-25 20:19:57 | 2021-11-25 20:50:56 | 0:30:59 | 0:24:54 | 0:06:05 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T20:45:07.028006+0000 mgr.x (mgr.4101) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525711 |
|
2021-11-25 14:24:33 | 2021-11-25 20:19:57 | 2021-11-25 20:42:55 | 0:22:58 | 0:12:21 | 0:10:37 | smithi | master | centos | 8.stream | rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/mon} | 1 |
Failure Reason:
Command failed (workunit test mon/health-mute.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh' |
||||||||||||||
| fail | 6525712 |
|
2021-11-25 14:24:34 | 2021-11-25 20:20:07 | 2021-11-25 20:55:52 | 0:35:45 | 0:23:53 | 0:11:52 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T20:38:47.880033+0000 mgr.y (mgr.4100) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525713 |
|
2021-11-25 14:24:35 | 2021-11-25 20:22:08 | 2021-11-25 20:51:22 | 0:29:14 | 0:17:57 | 0:11:17 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525714 |
|
2021-11-25 14:24:36 | 2021-11-25 20:24:19 | 2021-11-25 20:58:16 | 0:33:57 | 0:23:13 | 0:10:44 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T20:43:35.353675+0000 mgr.y (mgr.4100) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525715 |
|
2021-11-25 14:24:37 | 2021-11-25 20:24:49 | 2021-11-25 21:06:23 | 0:41:34 | 0:34:53 | 0:06:41 | smithi | master | rhel | 8.4 | rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525716 |
|
2021-11-25 14:24:38 | 2021-11-25 20:25:19 | 2021-11-25 20:48:03 | 0:22:44 | 0:12:33 | 0:10:11 | smithi | master | centos | 8.stream | rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T20:44:38.015907+0000 mgr.x (mgr.4100) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525717 |
|
2021-11-25 14:24:39 | 2021-11-25 20:25:20 | 2021-11-25 20:51:09 | 0:25:49 | 0:15:39 | 0:10:10 | smithi | master | centos | 8.3 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/failover} | 2 |
Failure Reason:
"2021-11-25T20:47:08.598349+0000 mgr.x (mgr.5115) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525718 |
|
2021-11-25 14:24:40 | 2021-11-25 20:26:10 | 2021-11-25 21:02:09 | 0:35:59 | 0:27:39 | 0:08:20 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T20:52:41.581847+0000 mgr.y (mgr.4110) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525719 |
|
2021-11-25 14:24:41 | 2021-11-25 20:27:10 | 2021-11-25 20:56:00 | 0:28:50 | 0:17:54 | 0:10:56 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 6525720 |
|
2021-11-25 14:24:42 | 2021-11-25 20:28:41 | 2021-11-25 20:48:06 | 0:19:25 | 0:09:38 | 0:09:47 | smithi | master | centos | 8.3 | rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} | 3 |
| fail | 6525721 |
|
2021-11-25 14:24:43 | 2021-11-25 20:28:51 | 2021-11-25 21:21:54 | 0:53:03 | 0:42:15 | 0:10:48 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 |
Failure Reason:
"2021-11-25T20:58:57.249306+0000 mgr.x (mgr.4102) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525722 |
|
2021-11-25 14:24:44 | 2021-11-25 20:32:12 | 2021-11-25 20:52:08 | 0:19:56 | 0:09:58 | 0:09:58 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T20:48:46.034909+0000 mgr.y (mgr.4104) 45 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525723 |
|
2021-11-25 14:24:44 | 2021-11-25 20:32:23 | 2021-11-25 21:00:10 | 0:27:47 | 0:17:45 | 0:10:02 | smithi | master | centos | 8.3 | rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525724 |
|
2021-11-25 14:24:45 | 2021-11-25 20:32:43 | 2021-11-25 20:51:02 | 0:18:19 | 0:07:18 | 0:11:01 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T20:49:02.776779+0000 mgr.x (mgr.4104) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525725 |
|
2021-11-25 14:24:46 | 2021-11-25 20:33:33 | 2021-11-25 21:00:57 | 0:27:24 | 0:21:19 | 0:06:05 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op snap_create 10 --op snap_remove 10 --op rollback 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0' |
||||||||||||||
| fail | 6525726 |
|
2021-11-25 14:24:47 | 2021-11-25 20:33:44 | 2021-11-25 21:06:28 | 0:32:44 | 0:20:41 | 0:12:03 | smithi | master | centos | 8.3 | rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525727 |
|
2021-11-25 14:24:48 | 2021-11-25 20:35:24 | 2021-11-25 21:12:05 | 0:36:41 | 0:25:39 | 0:11:02 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T20:53:03.874967+0000 mgr.y (mgr.4107) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525728 |
|
2021-11-25 14:24:49 | 2021-11-25 20:35:35 | 2021-11-25 21:23:10 | 0:47:35 | 0:37:40 | 0:09:55 | smithi | master | ubuntu | 20.04 | rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} | 2 |
Failure Reason:
"2021-11-25T20:51:20.639524+0000 mgr.x (mgr.4105) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525729 |
|
2021-11-25 14:24:50 | 2021-11-25 20:35:35 | 2021-11-25 21:19:10 | 0:43:35 | 0:34:01 | 0:09:34 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T20:54:28.048260+0000 mgr.y (mgr.4107) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525730 |
|
2021-11-25 14:24:51 | 2021-11-25 20:36:05 | 2021-11-25 21:23:25 | 0:47:20 | 0:41:02 | 0:06:18 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} | 2 |
Failure Reason:
"2021-11-25T21:02:45.115739+0000 mgr.x (mgr.4109) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525731 |
|
2021-11-25 14:24:52 | 2021-11-25 20:36:26 | 2021-11-25 21:11:38 | 0:35:12 | 0:22:42 | 0:12:30 | smithi | master | centos | 8.stream | rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525732 |
|
2021-11-25 14:24:53 | 2021-11-25 20:38:06 | 2021-11-25 20:59:36 | 0:21:30 | 0:11:28 | 0:10:02 | smithi | master | centos | 8.3 | rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T20:55:57.112214+0000 mgr.x (mgr.4102) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525733 |
|
2021-11-25 14:24:53 | 2021-11-25 20:38:07 | 2021-11-25 21:03:52 | 0:25:45 | 0:14:56 | 0:10:49 | smithi | master | ubuntu | 20.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} | 2 |
Failure Reason:
"2021-11-25T20:54:41.409498+0000 mgr.x (mgr.4102) 47 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525734 |
|
2021-11-25 14:24:54 | 2021-11-25 20:38:07 | 2021-11-26 00:02:05 | 3:23:58 | 3:12:19 | 0:11:39 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi081 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| pass | 6525735 |
|
2021-11-25 14:24:55 | 2021-11-25 20:38:18 | 2021-11-25 21:23:10 | 0:44:52 | 0:32:31 | 0:12:21 | smithi | master | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 |
| fail | 6525736 |
|
2021-11-25 14:24:56 | 2021-11-25 20:39:28 | 2021-11-25 21:01:49 | 0:22:21 | 0:10:56 | 0:11:25 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} | 1 |
Failure Reason:
"2021-11-25T20:55:34.435100+0000 mgr.x (mgr.4099) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525737 |
|
2021-11-25 14:24:57 | 2021-11-25 20:39:48 | 2021-11-25 21:13:58 | 0:34:10 | 0:24:08 | 0:10:02 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T20:55:54.790112+0000 mgr.x (mgr.4105) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525738 |
|
2021-11-25 14:24:58 | 2021-11-25 20:39:59 | 2021-11-25 21:29:30 | 0:49:31 | 0:38:34 | 0:10:57 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} | 2 |
Failure Reason:
"2021-11-25T21:16:40.159960+0000 mgr.x (mgr.4106) 204 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525739 |
|
2021-11-25 14:24:59 | 2021-11-25 20:42:09 | 2021-11-25 21:25:40 | 0:43:31 | 0:33:04 | 0:10:27 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525740 |
|
2021-11-25 14:25:00 | 2021-11-25 20:42:20 | 2021-11-25 22:32:15 | 1:49:55 | 1:38:41 | 0:11:14 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T20:58:59.776939+0000 mgr.y (mgr.4109) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525741 |
|
2021-11-25 14:25:00 | 2021-11-25 20:42:20 | 2021-11-25 21:07:36 | 0:25:16 | 0:19:28 | 0:05:48 | smithi | master | rhel | 8.4 | rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} | 1 |
| pass | 6525742 |
|
2021-11-25 14:25:01 | 2021-11-25 20:42:20 | 2021-11-25 21:07:50 | 0:25:30 | 0:15:23 | 0:10:07 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} | 1 | ||
| fail | 6525743 |
|
2021-11-25 14:25:02 | 2021-11-25 20:42:21 | 2021-11-25 21:14:06 | 0:31:45 | 0:24:35 | 0:07:10 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T21:10:42.178437+0000 mgr.y (mgr.4107) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525744 |
|
2021-11-25 14:25:03 | 2021-11-25 20:43:01 | 2021-11-25 21:11:26 | 0:28:25 | 0:16:10 | 0:12:15 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T21:03:12.007549+0000 mgr.x (mgr.4108) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525745 |
|
2021-11-25 14:25:04 | 2021-11-25 20:43:22 | 2021-11-25 21:17:16 | 0:33:54 | 0:22:44 | 0:11:10 | smithi | master | ubuntu | 20.04 | rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
Command failed (workunit test cephtool/test.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' |
||||||||||||||
| fail | 6525746 |
|
2021-11-25 14:25:05 | 2021-11-25 20:43:42 | 2021-11-25 21:04:13 | 0:20:31 | 0:08:27 | 0:12:04 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} | 3 |
Failure Reason:
Command failed on smithi090 with status 5: 'sudo systemctl stop ceph-e3d8cece-4e32-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525747 |
|
2021-11-25 14:25:06 | 2021-11-25 20:44:43 | 2021-11-25 21:15:01 | 0:30:18 | 0:22:17 | 0:08:01 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525748 |
|
2021-11-25 14:25:07 | 2021-11-25 20:46:03 | 2021-11-25 21:13:37 | 0:27:34 | 0:16:52 | 0:10:42 | smithi | master | centos | 8.stream | rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T21:06:08.344210+0000 mgr.x (mgr.4109) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525749 |
|
2021-11-25 14:25:07 | 2021-11-25 20:46:34 | 2021-11-25 21:12:58 | 0:26:24 | 0:14:34 | 0:11:50 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T21:03:52.242568+0000 mgr.x (mgr.4103) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525750 |
|
2021-11-25 14:25:08 | 2021-11-25 20:47:24 | 2021-11-25 21:23:19 | 0:35:55 | 0:24:52 | 0:11:03 | smithi | master | ubuntu | 20.04 | rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525751 |
|
2021-11-25 14:25:09 | 2021-11-25 20:47:24 | 2021-11-25 21:14:59 | 0:27:35 | 0:16:56 | 0:10:39 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T21:06:19.772798+0000 mgr.y (mgr.4115) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525752 |
|
2021-11-25 14:25:10 | 2021-11-25 20:47:45 | 2021-11-25 21:15:19 | 0:27:34 | 0:18:13 | 0:09:21 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525753 |
|
2021-11-25 14:25:11 | 2021-11-25 20:48:05 | 2021-11-25 21:27:35 | 0:39:30 | 0:28:58 | 0:10:32 | smithi | master | ubuntu | 20.04 | rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T21:03:34.664740+0000 mgr.x (mgr.4099) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525754 |
|
2021-11-25 14:25:12 | 2021-11-25 20:48:15 | 2021-11-25 21:13:49 | 0:25:34 | 0:16:18 | 0:09:16 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T21:07:27.491281+0000 mgr.x (mgr.4108) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525755 |
|
2021-11-25 14:25:13 | 2021-11-25 20:48:16 | 2021-11-25 21:09:42 | 0:21:26 | 0:11:10 | 0:10:16 | smithi | master | centos | 8.stream | rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T21:07:24.764855+0000 mgr.x (mgr.4102) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525756 |
|
2021-11-25 14:25:13 | 2021-11-25 20:48:16 | 2021-11-25 21:18:00 | 0:29:44 | 0:19:41 | 0:10:03 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525757 |
|
2021-11-25 14:25:14 | 2021-11-25 20:48:57 | 2021-11-25 21:23:33 | 0:34:36 | 0:25:56 | 0:08:40 | smithi | master | rhel | 8.4 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/insights} | 2 |
Failure Reason:
"2021-11-25T21:19:17.039050+0000 mgr.x (mgr.5099) 61 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525758 |
|
2021-11-25 14:25:15 | 2021-11-25 20:50:07 | 2021-11-25 21:29:47 | 0:39:40 | 0:33:01 | 0:06:39 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T21:16:23.467627+0000 mgr.x (mgr.4104) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525759 |
|
2021-11-25 14:25:16 | 2021-11-25 20:50:27 | 2021-11-25 21:20:08 | 0:29:41 | 0:22:11 | 0:07:30 | smithi | master | rhel | 8.4 | rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525760 |
|
2021-11-25 14:25:17 | 2021-11-25 20:50:58 | 2021-11-25 21:08:37 | 0:17:39 | 0:08:13 | 0:09:26 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T21:06:41.115088+0000 mgr.x (mgr.4115) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525761 |
|
2021-11-25 14:25:18 | 2021-11-25 20:51:08 | 2021-11-25 21:24:23 | 0:33:15 | 0:24:25 | 0:08:50 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T21:10:55.734619+0000 mgr.x (mgr.4109) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525762 |
|
2021-11-25 14:25:19 | 2021-11-25 20:51:19 | 2021-11-25 21:34:28 | 0:43:09 | 0:35:50 | 0:07:19 | smithi | master | rhel | 8.4 | rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525763 |
|
2021-11-25 14:25:20 | 2021-11-25 20:51:29 | 2021-11-25 21:21:54 | 0:30:25 | 0:19:32 | 0:10:53 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T21:08:33.557406+0000 mgr.y (mgr.4100) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525764 |
|
2021-11-25 14:25:21 | 2021-11-25 20:52:09 | 2021-11-25 21:31:44 | 0:39:35 | 0:30:01 | 0:09:34 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525765 |
|
2021-11-25 14:25:22 | 2021-11-25 20:52:40 | 2021-11-25 21:25:58 | 0:33:18 | 0:20:53 | 0:12:25 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T21:10:20.573923+0000 mgr.x (mgr.4105) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525766 |
|
2021-11-25 14:25:23 | 2021-11-25 20:54:10 | 2021-11-25 21:13:11 | 0:19:01 | 0:06:30 | 0:12:31 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T21:11:19.475435+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525767 |
|
2021-11-25 14:25:24 | 2021-11-25 20:55:11 | 2021-11-26 01:33:24 | 4:38:13 | 4:31:59 | 0:06:14 | smithi | master | rhel | 8.4 | rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd-backfill} | 1 |
| fail | 6525768 |
|
2021-11-25 14:25:24 | 2021-11-25 20:56:01 | 2021-11-25 21:31:21 | 0:35:20 | 0:25:26 | 0:09:54 | smithi | master | centos | 8.3 | rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} | 1 |
Failure Reason:
"2021-11-25T21:29:16.115067+0000 mgr.y (mgr.4102) 211 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525769 |
|
2021-11-25 14:25:25 | 2021-11-25 20:56:02 | 2021-11-25 21:27:02 | 0:31:00 | 0:22:27 | 0:08:33 | smithi | master | centos | 8.2 | rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525770 |
|
2021-11-25 14:25:26 | 2021-11-25 20:56:02 | 2021-11-25 21:46:00 | 0:49:58 | 0:41:44 | 0:08:14 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T21:22:38.861297+0000 mgr.y (mgr.4109) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525771 |
|
2021-11-25 14:25:27 | 2021-11-25 20:56:42 | 2021-11-25 21:45:16 | 0:48:34 | 0:39:46 | 0:08:48 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 |
Failure Reason:
"2021-11-25T21:24:02.005901+0000 mgr.y (mgr.4110) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525772 |
|
2021-11-25 14:25:28 | 2021-11-25 20:57:43 | 2021-11-25 21:18:04 | 0:20:21 | 0:09:04 | 0:11:17 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} | 1 |
Failure Reason:
"2021-11-25T21:14:22.349734+0000 mgr.x (mgr.4100) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525773 |
|
2021-11-25 14:25:29 | 2021-11-25 20:58:23 | 2021-11-25 21:20:34 | 0:22:11 | 0:11:55 | 0:10:16 | smithi | master | ubuntu | 20.04 | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} | 2 |
Failure Reason:
"2021-11-25T21:15:13.340462+0000 mgr.x (mgr.4101) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525774 |
|
2021-11-25 14:25:30 | 2021-11-25 20:59:04 | 2021-11-25 21:15:16 | 0:16:12 | 0:04:42 | 0:11:30 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} | 1 | ||
| fail | 6525775 |
|
2021-11-25 14:25:31 | 2021-11-25 20:59:04 | 2021-11-25 21:54:52 | 0:55:48 | 0:42:50 | 0:12:58 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T21:16:51.044007+0000 mgr.x (mgr.4105) 49 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525776 |
|
2021-11-25 14:25:32 | 2021-11-25 20:59:45 | 2021-11-25 21:51:29 | 0:51:44 | 0:43:53 | 0:07:51 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T21:26:01.836206+0000 mgr.x (mgr.4105) 41 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525777 |
|
2021-11-25 14:25:33 | 2021-11-25 21:00:15 | 2021-11-25 21:32:42 | 0:32:27 | 0:21:55 | 0:10:32 | smithi | master | centos | 8.stream | rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} | 3 |
| fail | 6525778 |
|
2021-11-25 14:25:33 | 2021-11-25 21:01:26 | 2021-11-25 21:22:18 | 0:20:52 | 0:09:52 | 0:11:00 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 |
Failure Reason:
"2021-11-25T21:19:20.774727+0000 mgr.x (mgr.4105) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525779 |
|
2021-11-25 14:25:34 | 2021-11-25 21:02:16 | 2021-11-25 21:33:45 | 0:31:29 | 0:18:16 | 0:13:13 | smithi | master | ubuntu | 20.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525780 |
|
2021-11-25 14:25:35 | 2021-11-25 21:03:57 | 2021-11-25 21:39:48 | 0:35:51 | 0:28:07 | 0:07:44 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T21:30:33.349241+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525781 |
|
2021-11-25 14:25:36 | 2021-11-25 21:04:17 | 2021-11-25 21:30:30 | 0:26:13 | 0:15:37 | 0:10:36 | smithi | master | ubuntu | 20.04 | rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525782 |
|
2021-11-25 14:25:37 | 2021-11-25 21:04:17 | 2021-11-25 21:33:31 | 0:29:14 | 0:17:20 | 0:11:54 | smithi | master | centos | 8.stream | rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525783 |
|
2021-11-25 14:25:38 | 2021-11-25 21:06:28 | 2021-11-25 21:27:51 | 0:21:23 | 0:11:52 | 0:09:31 | smithi | master | centos | 8.3 | rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} | 2 |
Failure Reason:
Command failed (workunit test mon/pool_ops.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh' |
||||||||||||||
| fail | 6525784 |
|
2021-11-25 14:25:39 | 2021-11-25 21:06:38 | 2021-11-25 21:54:25 | 0:47:47 | 0:37:34 | 0:10:13 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T21:23:14.431264+0000 mgr.y (mgr.4104) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525785 |
|
2021-11-25 14:25:40 | 2021-11-25 21:06:39 | 2021-11-25 22:05:01 | 0:58:22 | 0:45:54 | 0:12:28 | smithi | master | ubuntu | 20.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} | 2 |
Failure Reason:
"2021-11-25T21:25:25.140346+0000 mgr.y (mgr.4101) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525786 |
|
2021-11-25 14:25:41 | 2021-11-25 21:07:59 | 2021-11-25 21:48:49 | 0:40:50 | 0:29:59 | 0:10:51 | smithi | master | centos | 8.3 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T21:28:47.349223+0000 mgr.x (mgr.4102) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525787 |
|
2021-11-25 14:25:42 | 2021-11-25 21:09:30 | 2021-11-25 22:09:30 | 1:00:00 | 0:51:34 | 0:08:26 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T21:39:00.288260+0000 mgr.x (mgr.4111) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525788 |
|
2021-11-25 14:25:43 | 2021-11-25 21:11:30 | 2021-11-25 21:41:14 | 0:29:44 | 0:20:21 | 0:09:23 | smithi | master | centos | 8.stream | rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525789 |
|
2021-11-25 14:25:44 | 2021-11-25 21:11:41 | 2021-11-25 21:30:44 | 0:19:03 | 0:10:02 | 0:09:01 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T21:29:26.436289+0000 mgr.x (mgr.4101) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525790 |
|
2021-11-25 14:25:45 | 2021-11-25 21:11:41 | 2021-11-25 21:37:45 | 0:26:04 | 0:16:17 | 0:09:47 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} | 2 |
Failure Reason:
"2021-11-25T21:31:29.812296+0000 mgr.x (mgr.4102) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525791 |
|
2021-11-25 14:25:45 | 2021-11-25 21:12:11 | 2021-11-25 21:56:02 | 0:43:51 | 0:32:46 | 0:11:05 | smithi | master | centos | 8.stream | rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T21:32:20.519228+0000 mgr.x (mgr.4107) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525792 |
|
2021-11-25 14:25:46 | 2021-11-25 21:13:02 | 2021-11-25 21:50:30 | 0:37:28 | 0:26:39 | 0:10:49 | smithi | master | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
| fail | 6525793 |
|
2021-11-25 14:25:47 | 2021-11-25 21:13:12 | 2021-11-26 03:41:50 | 6:28:38 | 6:16:09 | 0:12:29 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi025 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525794 |
|
2021-11-25 14:25:48 | 2021-11-25 21:13:53 | 2021-11-25 21:49:18 | 0:35:25 | 0:26:02 | 0:09:23 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 |
Failure Reason:
"2021-11-25T21:32:43.729542+0000 mgr.y (mgr.4103) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525795 |
|
2021-11-25 14:25:49 | 2021-11-25 21:14:03 | 2021-11-25 21:57:03 | 0:43:00 | 0:36:12 | 0:06:48 | smithi | master | rhel | 8.4 | rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525796 |
|
2021-11-25 14:25:50 | 2021-11-25 21:14:13 | 2021-11-25 21:38:23 | 0:24:10 | 0:14:07 | 0:10:03 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T21:35:40.448520+0000 mgr.x (mgr.4108) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525797 |
|
2021-11-25 14:25:51 | 2021-11-25 21:15:04 | 2021-11-25 21:57:54 | 0:42:50 | 0:35:57 | 0:06:53 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} | 2 |
Failure Reason:
"2021-11-25T21:41:45.362234+0000 mgr.x (mgr.4099) 35 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525798 |
|
2021-11-25 14:25:52 | 2021-11-25 21:15:04 | 2021-11-25 21:51:20 | 0:36:16 | 0:26:15 | 0:10:01 | smithi | master | ubuntu | 20.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} | 2 |
Failure Reason:
"2021-11-25T21:41:39.848340+0000 mgr.x (mgr.7866) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525799 |
|
2021-11-25 14:25:53 | 2021-11-25 21:15:25 | 2021-11-25 21:42:40 | 0:27:15 | 0:17:49 | 0:09:26 | smithi | master | centos | 8.2 | rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525800 |
|
2021-11-25 14:25:53 | 2021-11-25 21:15:25 | 2021-11-25 21:47:10 | 0:31:45 | 0:18:04 | 0:13:41 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} | 2 |
Failure Reason:
"2021-11-25T21:33:50.446761+0000 mgr.x (mgr.4103) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525801 |
|
2021-11-25 14:25:54 | 2021-11-25 21:17:26 | 2021-11-25 22:02:24 | 0:44:58 | 0:32:31 | 0:12:27 | smithi | master | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} | 2 |
| fail | 6525802 |
|
2021-11-25 14:25:55 | 2021-11-25 21:18:06 | 2021-11-25 21:39:09 | 0:21:03 | 0:11:03 | 0:10:00 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T21:35:50.853150+0000 mgr.x (mgr.4101) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525803 |
|
2021-11-25 14:25:56 | 2021-11-25 21:18:06 | 2021-11-25 21:58:21 | 0:40:15 | 0:29:57 | 0:10:18 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-snaps} | 2 |
Failure Reason:
"2021-11-25T21:38:52.276425+0000 mgr.y (mgr.4110) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525804 |
|
2021-11-25 14:25:57 | 2021-11-25 21:19:17 | 2021-11-25 22:05:22 | 0:46:05 | 0:34:45 | 0:11:20 | smithi | master | centos | 8.stream | rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} | 1 |
Failure Reason:
"2021-11-25T21:39:02.447149+0000 mgr.x (mgr.4107) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525805 |
|
2021-11-25 14:25:58 | 2021-11-25 21:20:17 | 2021-11-25 23:55:31 | 2:35:14 | 2:12:42 | 0:22:32 | smithi | master | centos | 8.3 | rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8}} | 1 |
| fail | 6525806 |
|
2021-11-25 14:25:59 | 2021-11-25 21:20:18 | 2021-11-25 22:03:40 | 0:43:22 | 0:33:44 | 0:09:38 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525807 |
|
2021-11-25 14:26:00 | 2021-11-25 21:20:38 | 2021-11-25 21:44:02 | 0:23:24 | 0:10:21 | 0:13:03 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} | 2 |
Failure Reason:
"2021-11-25T21:38:50.684608+0000 mgr.x (mgr.4101) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525808 |
|
2021-11-25 14:26:01 | 2021-11-25 21:21:58 | 2021-11-25 21:55:03 | 0:33:05 | 0:23:49 | 0:09:16 | smithi | master | centos | 8.3 | rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525809 |
|
2021-11-25 14:26:02 | 2021-11-25 21:21:59 | 2021-11-25 21:43:23 | 0:21:24 | 0:11:37 | 0:09:47 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} | 2 |
Failure Reason:
"2021-11-25T21:41:02.332972+0000 mgr.y (mgr.4101) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525810 |
|
2021-11-25 14:26:03 | 2021-11-25 21:22:19 | 2021-11-25 21:51:33 | 0:29:14 | 0:22:07 | 0:07:07 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525811 |
|
2021-11-25 14:26:04 | 2021-11-25 21:22:20 | 2021-11-25 21:42:54 | 0:20:34 | 0:08:35 | 0:11:59 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} | 1 |
Failure Reason:
"2021-11-25T21:39:08.832889+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525812 |
|
2021-11-25 14:26:04 | 2021-11-25 21:23:20 | 2021-11-25 21:45:19 | 0:21:59 | 0:10:35 | 0:11:24 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} | 2 |
Failure Reason:
"2021-11-25T21:40:06.233103+0000 mgr.y (mgr.4110) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525813 |
|
2021-11-25 14:26:05 | 2021-11-25 21:23:20 | 2021-11-25 21:54:39 | 0:31:19 | 0:24:18 | 0:07:01 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525814 |
|
2021-11-25 14:26:06 | 2021-11-25 21:23:21 | 2021-11-25 21:50:31 | 0:27:10 | 0:18:09 | 0:09:01 | smithi | master | centos | 8.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} tasks/libcephsqlite} | 2 |
Failure Reason:
"2021-11-25T21:41:55.087463+0000 mgr.x (mgr.4105) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525815 |
|
2021-11-25 14:26:07 | 2021-11-25 21:23:31 | 2021-11-25 21:54:57 | 0:31:26 | 0:21:05 | 0:10:21 | smithi | master | centos | 8.stream | rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} | 2 |
| fail | 6525816 |
|
2021-11-25 14:26:08 | 2021-11-25 21:23:41 | 2021-11-25 21:42:53 | 0:19:12 | 0:10:11 | 0:09:01 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T21:41:20.296583+0000 mgr.x (mgr.4102) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525817 |
|
2021-11-25 14:26:09 | 2021-11-25 21:23:42 | 2021-11-25 21:44:57 | 0:21:15 | 0:08:25 | 0:12:50 | smithi | master | centos | 8.3 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/radosbench} | 3 |
Failure Reason:
Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-97dee2d2-4e38-11ec-8c2d-001a4aab830c@mon.a' |
||||||||||||||
| fail | 6525818 |
|
2021-11-25 14:26:10 | 2021-11-25 21:25:43 | 2021-11-25 22:05:43 | 0:40:00 | 0:29:58 | 0:10:02 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T21:42:29.867064+0000 mgr.x (mgr.4110) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525819 |
|
2021-11-25 14:26:11 | 2021-11-25 21:25:53 | 2021-11-25 21:52:57 | 0:27:04 | 0:20:10 | 0:06:54 | smithi | master | rhel | 8.4 | rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T21:50:57.945541+0000 mgr.x (mgr.4108) 50 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525820 |
|
2021-11-25 14:26:12 | 2021-11-25 21:25:53 | 2021-11-25 21:55:23 | 0:29:30 | 0:18:38 | 0:10:52 | smithi | master | centos | 8.3 | rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525821 |
|
2021-11-25 14:26:13 | 2021-11-25 21:26:04 | 2021-11-26 01:00:22 | 3:34:18 | 3:25:11 | 0:09:07 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi184 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525822 |
|
2021-11-25 14:26:14 | 2021-11-25 21:27:04 | 2021-11-25 21:55:03 | 0:27:59 | 0:17:14 | 0:10:45 | smithi | master | rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525823 |
|
2021-11-25 14:26:14 | 2021-11-25 21:27:44 | 2021-11-25 22:47:13 | 1:19:29 | 1:08:48 | 0:10:41 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} | 2 |
Failure Reason:
"2021-11-25T21:46:24.105019+0000 mgr.x (mgr.4107) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525824 |
|
2021-11-25 14:26:15 | 2021-11-25 21:27:55 | 2021-11-25 22:05:09 | 0:37:14 | 0:25:14 | 0:12:00 | smithi | master | ubuntu | 20.04 | rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525825 |
|
2021-11-25 14:26:16 | 2021-11-25 21:29:35 | 2021-11-25 23:09:00 | 1:39:25 | 1:30:22 | 0:09:03 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} | 2 |
Failure Reason:
"2021-11-25T21:48:09.442073+0000 mgr.y (mgr.4099) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525826 |
|
2021-11-25 14:26:17 | 2021-11-25 21:29:56 | 2021-11-25 21:50:04 | 0:20:08 | 0:09:00 | 0:11:08 | smithi | master | centos | 8.3 | rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} | 2 |
| fail | 6525827 |
|
2021-11-25 14:26:18 | 2021-11-25 21:31:38 | 2021-11-25 22:09:04 | 0:37:26 | 0:27:43 | 0:09:43 | smithi | master | centos | 8.stream | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 |
Failure Reason:
"2021-11-25T21:51:17.141611+0000 mgr.x (mgr.4108) 39 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525828 |
|
2021-11-25 14:26:19 | 2021-11-25 21:31:48 | 2021-11-25 22:16:17 | 0:44:29 | 0:32:57 | 0:11:32 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
| fail | 6525829 |
|
2021-11-25 14:26:20 | 2021-11-25 21:32:49 | 2021-11-25 21:53:45 | 0:20:56 | 0:11:21 | 0:09:35 | smithi | master | centos | 8.3 | rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} | 1 |
Failure Reason:
"2021-11-25T21:50:20.640910+0000 mgr.x (mgr.4102) 58 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525830 |
|
2021-11-25 14:26:21 | 2021-11-25 21:32:49 | 2021-11-26 01:02:56 | 3:30:07 | 3:23:29 | 0:06:38 | smithi | master | rhel | 8.4 | rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} | 1 |
| fail | 6525831 |
|
2021-11-25 14:26:21 | 2021-11-25 21:33:39 | 2021-11-25 22:04:09 | 0:30:30 | 0:18:27 | 0:12:03 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/redirect} | 2 |
Failure Reason:
"2021-11-25T21:54:34.316068+0000 mgr.x (mgr.4108) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525832 |
|
2021-11-25 14:26:22 | 2021-11-25 21:33:50 | 2021-11-25 21:55:33 | 0:21:43 | 0:12:14 | 0:09:29 | smithi | master | centos | 8.stream | rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} | 2 |
Failure Reason:
Command failed (workunit test mon/pg_autoscaler.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' |
||||||||||||||
| fail | 6525833 |
|
2021-11-25 14:26:23 | 2021-11-25 21:34:30 | 2021-11-25 22:11:23 | 0:36:53 | 0:26:42 | 0:10:11 | smithi | master | rhel | 8.4 | rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} | 2 |
Failure Reason:
"2021-11-25T22:06:41.912400+0000 mgr.x (mgr.4673) 53 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525834 |
|
2021-11-25 14:26:24 | 2021-11-25 21:37:51 | 2021-11-25 21:59:19 | 0:21:28 | 0:12:17 | 0:09:11 | smithi | master | centos | 8.stream | rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/rados_mon_workunits} | 2 |
Failure Reason:
Command failed (workunit test mon/pool_ops.sh) on smithi060 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh' |
||||||||||||||
| fail | 6525835 |
|
2021-11-25 14:26:25 | 2021-11-25 21:38:32 | 2021-11-25 22:09:46 | 0:31:14 | 0:24:01 | 0:07:13 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} | 2 |
Failure Reason:
"2021-11-25T22:04:28.927087+0000 mgr.y (mgr.4107) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525836 |
|
2021-11-25 14:26:26 | 2021-11-25 21:38:32 | 2021-11-25 22:18:27 | 0:39:55 | 0:32:49 | 0:07:06 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T22:05:02.836767+0000 mgr.y (mgr.4104) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525837 |
|
2021-11-25 14:26:27 | 2021-11-25 21:39:12 | 2021-11-25 22:13:24 | 0:34:12 | 0:23:04 | 0:11:08 | smithi | master | centos | 8.stream | rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8.stream} tasks/progress} | 2 |
Failure Reason:
"2021-11-25T22:00:21.193159+0000 mgr.x (mgr.4716) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525838 |
|
2021-11-25 14:26:28 | 2021-11-25 21:39:53 | 2021-11-25 22:08:41 | 0:28:48 | 0:17:01 | 0:11:47 | smithi | master | centos | 8.2 | rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} | 1 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525839 |
|
2021-11-25 14:26:29 | 2021-11-25 21:41:23 | 2021-11-25 22:25:14 | 0:43:51 | 0:36:50 | 0:07:01 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 |
Failure Reason:
"2021-11-25T22:07:47.076732+0000 mgr.x (mgr.4099) 40 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525840 |
|
2021-11-25 14:26:29 | 2021-11-25 21:42:04 | 2021-11-25 22:06:57 | 0:24:53 | 0:13:52 | 0:11:01 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} | 2 |
Failure Reason:
"2021-11-25T21:59:50.117154+0000 mgr.y (mgr.4101) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525841 |
|
2021-11-25 14:26:30 | 2021-11-25 21:42:44 | 2021-11-25 22:09:58 | 0:27:14 | 0:17:36 | 0:09:38 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525842 |
|
2021-11-25 14:26:31 | 2021-11-25 21:42:55 | 2021-11-25 22:18:28 | 0:35:33 | 0:28:11 | 0:07:22 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} | 2 |
Failure Reason:
"2021-11-25T22:09:09.848124+0000 mgr.y (mgr.4104) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525843 |
|
2021-11-25 14:26:32 | 2021-11-25 21:43:25 | 2021-11-25 22:17:39 | 0:34:14 | 0:22:33 | 0:11:41 | smithi | master | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525844 |
|
2021-11-25 14:26:33 | 2021-11-25 21:44:05 | 2021-11-25 23:58:17 | 2:14:12 | 2:04:29 | 0:09:43 | smithi | master | centos | 8.3 | rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} | 2 |
Failure Reason:
"2021-11-25T22:21:39.826325+0000 mgr.x (mgr.4113) 234 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525845 |
|
2021-11-25 14:26:34 | 2021-11-25 21:45:06 | 2021-11-25 22:17:03 | 0:31:57 | 0:20:30 | 0:11:27 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T22:01:40.069003+0000 mgr.y (mgr.4104) 36 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525846 |
|
2021-11-25 14:26:35 | 2021-11-25 21:45:06 | 2021-11-25 22:03:21 | 0:18:15 | 0:08:04 | 0:10:11 | smithi | master | ubuntu | 20.04 | rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} | 2 |
Failure Reason:
Command failed (workunit test mon/pg_autoscaler.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' |
||||||||||||||
| fail | 6525847 |
|
2021-11-25 14:26:36 | 2021-11-25 21:45:27 | 2021-11-25 22:05:00 | 0:19:33 | 0:10:17 | 0:09:16 | smithi | master | ubuntu | 20.04 | rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} | 1 |
Failure Reason:
"2021-11-25T22:00:52.487664+0000 mgr.x (mgr.4104) 37 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525848 |
|
2021-11-25 14:26:36 | 2021-11-25 21:45:27 | 2021-11-25 22:15:09 | 0:29:42 | 0:22:39 | 0:07:03 | smithi | master | rhel | 8.4 | rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525849 |
|
2021-11-25 14:26:37 | 2021-11-25 21:45:27 | 2021-11-25 22:18:37 | 0:33:10 | 0:23:40 | 0:09:30 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 |
Failure Reason:
"2021-11-25T22:14:09.910475+0000 mgr.y (mgr.4102) 33 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525850 |
|
2021-11-25 14:26:38 | 2021-11-25 21:47:18 | 2021-11-25 22:30:12 | 0:42:54 | 0:33:55 | 0:08:59 | smithi | master | rhel | 8.4 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} | 2 |
Failure Reason:
"2021-11-25T22:15:51.772866+0000 mgr.x (mgr.4102) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525851 |
|
2021-11-25 14:26:39 | 2021-11-25 21:48:59 | 2021-11-25 22:21:16 | 0:32:17 | 0:21:50 | 0:10:27 | smithi | master | ubuntu | 20.04 | rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} | 1 |
Failure Reason:
"2021-11-25T22:05:41.164433+0000 mgr.x (mgr.4100) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525852 |
|
2021-11-25 14:26:40 | 2021-11-25 21:48:59 | 2021-11-25 22:32:39 | 0:43:40 | 0:35:45 | 0:07:55 | smithi | master | rhel | 8.4 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} | 2 |
Failure Reason:
"2021-11-25T22:15:21.603338+0000 mgr.y (mgr.4104) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525853 |
|
2021-11-25 14:26:41 | 2021-11-25 21:49:19 | 2021-11-25 22:23:35 | 0:34:16 | 0:25:35 | 0:08:41 | smithi | master | rhel | 8.4 | rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525854 |
|
2021-11-25 14:26:42 | 2021-11-25 21:50:10 | 2021-11-25 22:20:12 | 0:30:02 | 0:19:08 | 0:10:54 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} | 2 |
Failure Reason:
"2021-11-25T22:06:33.830899+0000 mgr.x (mgr.4100) 31 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525855 |
|
2021-11-25 14:26:42 | 2021-11-25 21:50:40 | 2021-11-26 00:48:22 | 2:57:42 | 2:27:54 | 0:29:48 | smithi | master | rhel | 8.4 | rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} | 1 |
| fail | 6525856 |
|
2021-11-25 14:26:43 | 2021-11-25 21:50:40 | 2021-11-25 22:17:45 | 0:27:05 | 0:17:43 | 0:09:22 | smithi | master | centos | 8.stream | rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525857 |
|
2021-11-25 14:26:44 | 2021-11-25 21:50:41 | 2021-11-25 22:29:07 | 0:38:26 | 0:26:10 | 0:12:16 | smithi | master | ubuntu | 20.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} | 2 |
Failure Reason:
"2021-11-25T22:08:14.670063+0000 mgr.y (mgr.4104) 38 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525858 |
|
2021-11-25 14:26:45 | 2021-11-25 21:51:21 | 2021-11-26 01:15:04 | 3:23:43 | 3:11:50 | 0:11:53 | smithi | master | centos | 8.stream | rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/rados_api_tests} | 2 |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi164 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7660f5736d47d57031adce01cfe693794700d0c1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
| fail | 6525859 |
|
2021-11-25 14:26:46 | 2021-11-25 21:51:32 | 2021-11-25 22:19:15 | 0:27:43 | 0:16:34 | 0:11:09 | smithi | master | rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} | 1 | ||
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525860 |
|
2021-11-25 14:26:47 | 2021-11-25 21:51:42 | 2021-11-25 22:32:07 | 0:40:25 | 0:29:05 | 0:11:20 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} | 2 |
Failure Reason:
"2021-11-25T22:11:30.455467+0000 mgr.y (mgr.4104) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.y: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525861 |
|
2021-11-25 14:26:48 | 2021-11-25 21:53:02 | 2021-11-25 22:20:33 | 0:27:31 | 0:21:27 | 0:06:04 | smithi | master | rhel | 8.4 | rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} | 1 |
Failure Reason:
"2021-11-25T22:20:01.561894+0000 mgr.x (mgr.4101) 44 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525862 |
|
2021-11-25 14:26:49 | 2021-11-25 21:53:53 | 2021-11-25 22:19:14 | 0:25:21 | 0:16:17 | 0:09:04 | smithi | master | centos | 8.stream | rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} | 1 |
| fail | 6525863 |
|
2021-11-25 14:26:50 | 2021-11-25 21:54:33 | 2021-11-25 22:25:47 | 0:31:14 | 0:22:40 | 0:08:34 | smithi | master | centos | 8.2 | rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525864 |
|
2021-11-25 14:26:50 | 2021-11-25 21:54:44 | 2021-11-25 22:32:28 | 0:37:44 | 0:26:28 | 0:11:16 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/snaps-few-objects} | 2 |
Failure Reason:
"2021-11-25T22:14:44.308761+0000 mgr.x (mgr.4105) 43 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| pass | 6525865 |
|
2021-11-25 14:26:51 | 2021-11-25 21:54:54 | 2021-11-25 22:30:20 | 0:35:26 | 0:26:35 | 0:08:51 | smithi | master | centos | 8.stream | rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} | 2 |
| fail | 6525866 |
|
2021-11-25 14:26:52 | 2021-11-25 21:55:04 | 2021-11-25 22:22:32 | 0:27:28 | 0:16:32 | 0:10:56 | smithi | master | centos | 8.stream | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} | 2 |
Failure Reason:
"2021-11-25T22:15:21.436941+0000 mgr.x (mgr.4110) 34 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525867 |
|
2021-11-25 14:26:53 | 2021-11-25 21:55:05 | 2021-11-25 22:24:38 | 0:29:33 | 0:18:22 | 0:11:11 | smithi | master | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 014019fe-4e3d-11ec-8c2d-001a4aab830c -- ceph orch daemon add osd smithi038:vg_nvme/lv_2' |
||||||||||||||
| fail | 6525868 |
|
2021-11-25 14:26:54 | 2021-11-25 21:55:25 | 2021-11-25 22:24:35 | 0:29:10 | 0:20:16 | 0:08:54 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} | 2 |
Failure Reason:
"2021-11-25T22:13:52.238004+0000 mgr.x (mgr.4105) 42 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
| fail | 6525869 |
|
2021-11-25 14:26:55 | 2021-11-25 21:55:36 | 2021-11-25 22:25:59 | 0:30:23 | 0:18:17 | 0:12:06 | smithi | master | ubuntu | 20.04 | rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 6525870 |
|
2021-11-25 14:26:56 | 2021-11-25 21:56:06 | 2021-11-25 22:49:37 | 0:53:31 | 0:44:22 | 0:09:09 | smithi | master | centos | 8.3 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} | 2 |
Failure Reason:
"2021-11-25T22:14:48.605654+0000 mgr.x (mgr.4105) 32 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: '>' not supported between instances of 'int' and 'tuple'" in cluster log |
||||||||||||||
Pulpito