Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6717439 2022-03-03 05:07:32 2022-03-03 10:25:46 2022-03-03 10:49:42 0:23:56 0:14:22 0:09:34 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
Failure Reason:

Cannot create secret

fail 6717440 2022-03-03 05:07:33 2022-03-03 10:26:26 2022-03-03 10:51:42 0:25:16 0:11:54 0:13:22 smithi master rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} 2
Failure Reason:

Command failed on smithi111 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2'

pass 6717441 2022-03-03 05:07:34 2022-03-03 10:27:47 2022-03-03 10:45:10 0:17:23 0:08:38 0:08:45 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} 2
dead 6717442 2022-03-03 05:07:35 2022-03-03 10:27:47 2022-03-03 17:09:40 6:41:53 smithi master ubuntu rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} 2
Failure Reason:

hit max job timeout

pass 6717443 2022-03-03 05:07:36 2022-03-03 10:29:28 2022-03-03 10:49:33 0:20:05 0:09:15 0:10:50 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} 2
fail 6717444 2022-03-03 05:07:36 2022-03-03 10:29:28 2022-03-03 10:40:46 0:11:18 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi066 with status 1: 'sudo yum install -y kernel'

pass 6717445 2022-03-03 05:07:37 2022-03-03 10:32:19 2022-03-03 11:02:40 0:30:21 0:20:24 0:09:57 smithi master ubuntu 20.04 rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} 1
pass 6717446 2022-03-03 05:07:38 2022-03-03 10:32:19 2022-03-03 10:54:15 0:21:56 0:12:20 0:09:36 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} 2
pass 6717447 2022-03-03 05:07:39 2022-03-03 10:32:49 2022-03-03 13:31:30 2:58:41 2:50:36 0:08:05 smithi master centos 8.stream rgw/tools/{centos_latest cluster tasks} 1
pass 6717448 2022-03-03 05:07:39 2022-03-03 10:32:50 2022-03-03 11:10:32 0:37:42 0:27:22 0:10:20 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717449 2022-03-03 05:07:40 2022-03-03 10:33:30 2022-03-03 10:59:55 0:26:25 0:15:50 0:10:35 smithi master ubuntu 20.04 rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} 2
pass 6717450 2022-03-03 05:07:41 2022-03-03 10:34:30 2022-03-03 11:13:21 0:38:51 0:29:20 0:09:31 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717451 2022-03-03 05:07:42 2022-03-03 10:34:51 2022-03-03 10:52:20 0:17:29 0:07:40 0:09:49 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload} 2
pass 6717452 2022-03-03 05:07:43 2022-03-03 10:35:11 2022-03-03 11:14:30 0:39:19 0:26:58 0:12:21 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717453 2022-03-03 05:07:43 2022-03-03 10:37:02 2022-03-03 11:13:58 0:36:56 0:28:05 0:08:51 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717454 2022-03-03 05:07:44 2022-03-03 10:37:22 2022-03-03 10:54:52 0:17:30 0:06:49 0:10:41 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi058 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 6717455 2022-03-03 05:07:45 2022-03-03 10:37:22 2022-03-03 11:15:26 0:38:04 0:27:11 0:10:53 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717456 2022-03-03 05:07:46 2022-03-03 10:38:13 2022-03-03 10:59:29 0:21:16 0:11:05 0:10:11 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} 2
pass 6717457 2022-03-03 05:07:46 2022-03-03 10:38:13 2022-03-03 11:15:25 0:37:12 0:28:35 0:08:37 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717458 2022-03-03 05:07:47 2022-03-03 10:38:24 2022-03-03 10:57:39 0:19:15 0:10:57 0:08:18 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} 2
pass 6717459 2022-03-03 05:07:48 2022-03-03 10:38:24 2022-03-03 11:16:10 0:37:46 0:28:21 0:09:25 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717460 2022-03-03 05:07:49 2022-03-03 10:39:14 2022-03-03 10:57:27 0:18:13 0:08:13 0:10:00 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota} 2
pass 6717461 2022-03-03 05:07:50 2022-03-03 10:40:15 2022-03-03 11:17:41 0:37:26 0:27:01 0:10:25 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717462 2022-03-03 05:07:50 2022-03-03 10:40:35 2022-03-03 11:01:51 0:21:16 0:11:26 0:09:50 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
pass 6717463 2022-03-03 05:07:51 2022-03-03 10:40:35 2022-03-03 10:59:37 0:19:02 0:08:14 0:10:48 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} 2
pass 6717464 2022-03-03 05:07:52 2022-03-03 10:40:56 2022-03-03 11:12:59 0:32:03 0:23:11 0:08:52 smithi master rhel 8.4 rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} 2
fail 6717465 2022-03-03 05:07:53 2022-03-03 10:42:26 2022-03-03 10:51:22 0:08:56 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi162 with status 1: 'sudo yum install -y kernel'

pass 6717466 2022-03-03 05:07:53 2022-03-03 10:43:57 2022-03-03 11:22:11 0:38:14 0:28:36 0:09:38 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717467 2022-03-03 05:07:54 2022-03-03 10:45:17 2022-03-03 11:20:15 0:34:58 0:25:15 0:09:43 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717468 2022-03-03 05:07:55 2022-03-03 10:45:18 2022-03-03 11:02:29 0:17:11 0:07:57 0:09:14 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} 2
pass 6717469 2022-03-03 05:07:56 2022-03-03 10:45:18 2022-03-03 11:23:45 0:38:27 0:28:34 0:09:53 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717470 2022-03-03 05:07:57 2022-03-03 10:46:39 2022-03-03 11:21:33 0:34:54 0:25:30 0:09:24 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717471 2022-03-03 05:07:57 2022-03-03 10:46:39 2022-03-03 11:03:24 0:16:45 0:06:32 0:10:13 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi007 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

dead 6717472 2022-03-03 05:07:58 2022-03-03 10:47:59 2022-03-03 17:28:09 6:40:10 smithi master ubuntu rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} 2
Failure Reason:

hit max job timeout

pass 6717473 2022-03-03 05:07:59 2022-03-03 10:48:00 2022-03-03 11:14:54 0:26:54 0:15:28 0:11:26 smithi master rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} 2
pass 6717474 2022-03-03 05:08:00 2022-03-03 10:48:00 2022-03-03 11:25:23 0:37:23 0:26:24 0:10:59 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717475 2022-03-03 05:08:00 2022-03-03 10:49:41 2022-03-03 11:11:04 0:21:23 0:11:25 0:09:58 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} 2
pass 6717476 2022-03-03 05:08:01 2022-03-03 10:49:51 2022-03-03 11:32:53 0:43:02 0:31:01 0:12:01 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717477 2022-03-03 05:08:02 2022-03-03 10:51:31 2022-03-03 11:29:12 0:37:41 0:27:24 0:10:17 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
dead 6717478 2022-03-03 05:08:03 2022-03-03 10:51:52 2022-03-03 11:05:44 0:13:52 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} 2
Failure Reason:

SSH connection to smithi041 was lost: 'uname -r'

pass 6717479 2022-03-03 05:08:03 2022-03-03 10:52:22 2022-03-03 11:30:20 0:37:58 0:28:38 0:09:20 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717480 2022-03-03 05:08:04 2022-03-03 10:53:23 2022-03-03 11:12:51 0:19:28 0:10:18 0:09:10 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
pass 6717481 2022-03-03 05:08:05 2022-03-03 10:53:23 2022-03-03 11:13:52 0:20:29 0:09:08 0:11:21 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} 2
pass 6717482 2022-03-03 05:08:06 2022-03-03 10:54:23 2022-03-03 11:14:09 0:19:46 0:09:22 0:10:24 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} 2
fail 6717483 2022-03-03 05:08:07 2022-03-03 10:54:54 2022-03-03 11:02:35 0:07:41 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi148 with status 1: 'sudo yum install -y kernel'

pass 6717484 2022-03-03 05:08:07 2022-03-03 10:55:14 2022-03-03 11:31:05 0:35:51 0:26:36 0:09:15 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717485 2022-03-03 05:08:08 2022-03-03 10:56:05 2022-03-03 11:38:40 0:42:35 0:32:29 0:10:06 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717486 2022-03-03 05:08:09 2022-03-03 10:57:35 2022-03-03 11:15:10 0:17:35 0:07:28 0:10:07 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} 2
pass 6717487 2022-03-03 05:08:10 2022-03-03 10:57:45 2022-03-03 11:19:39 0:21:54 0:10:58 0:10:56 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} 2
pass 6717488 2022-03-03 05:08:11 2022-03-03 10:58:16 2022-03-03 11:37:34 0:39:18 0:29:45 0:09:33 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717489 2022-03-03 05:08:11 2022-03-03 10:58:16 2022-03-03 11:37:11 0:38:55 0:28:04 0:10:51 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717490 2022-03-03 05:08:12 2022-03-03 10:59:37 2022-03-03 11:16:55 0:17:18 0:06:54 0:10:24 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi053 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 6717491 2022-03-03 05:08:13 2022-03-03 10:59:37 2022-03-03 11:44:22 0:44:45 0:32:46 0:11:59 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717492 2022-03-03 05:08:14 2022-03-03 10:59:47 2022-03-03 11:21:25 0:21:38 0:10:50 0:10:48 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests} 2
pass 6717493 2022-03-03 05:08:15 2022-03-03 10:59:58 2022-03-03 11:40:28 0:40:30 0:28:57 0:11:33 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717494 2022-03-03 05:08:15 2022-03-03 11:01:18 2022-03-03 11:43:54 0:42:36 0:32:28 0:10:08 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717495 2022-03-03 05:08:16 2022-03-03 11:02:39 2022-03-03 11:20:02 0:17:23 0:07:40 0:09:43 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota} 2
pass 6717496 2022-03-03 05:08:17 2022-03-03 11:02:39 2022-03-03 11:44:32 0:41:53 0:32:24 0:09:29 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717497 2022-03-03 05:08:18 2022-03-03 11:02:49 2022-03-03 11:22:42 0:19:53 0:10:21 0:09:32 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
fail 6717498 2022-03-03 05:08:19 2022-03-03 11:03:30 2022-03-03 11:27:05 0:23:35 0:11:30 0:12:05 smithi master rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} 2
Failure Reason:

Command failed on smithi041 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0'

pass 6717499 2022-03-03 05:08:19 2022-03-03 11:05:50 2022-03-03 11:27:20 0:21:30 0:10:52 0:10:38 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} 2
dead 6717500 2022-03-03 05:08:20 2022-03-03 11:06:01 2022-03-03 17:47:37 6:41:36 smithi master ubuntu rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} 2
Failure Reason:

hit max job timeout

pass 6717501 2022-03-03 05:08:21 2022-03-03 11:07:41 2022-03-03 11:30:05 0:22:24 0:09:45 0:12:39 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} 2
fail 6717502 2022-03-03 05:08:22 2022-03-03 11:10:42 2022-03-03 11:18:04 0:07:22 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi190 with status 1: 'sudo yum install -y kernel'

pass 6717503 2022-03-03 05:08:23 2022-03-03 11:11:12 2022-03-03 11:41:44 0:30:32 0:23:00 0:07:32 smithi master ubuntu 20.04 rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} 1
pass 6717504 2022-03-03 05:08:23 2022-03-03 11:11:12 2022-03-03 11:40:02 0:28:50 0:14:54 0:13:56 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} 2
pass 6717505 2022-03-03 05:08:24 2022-03-03 11:13:03 2022-03-03 11:51:54 0:38:51 0:29:45 0:09:06 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717506 2022-03-03 05:08:25 2022-03-03 11:13:23 2022-03-03 11:39:27 0:26:04 0:16:02 0:10:02 smithi master ubuntu 20.04 rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} 2
pass 6717507 2022-03-03 05:08:26 2022-03-03 11:13:54 2022-03-03 11:52:50 0:38:56 0:29:25 0:09:31 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717508 2022-03-03 05:08:27 2022-03-03 11:14:04 2022-03-03 11:35:44 0:21:40 0:11:22 0:10:18 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload} 2
pass 6717509 2022-03-03 05:08:28 2022-03-03 11:14:15 2022-03-03 11:54:01 0:39:46 0:29:51 0:09:55 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717510 2022-03-03 05:08:28 2022-03-03 11:14:35 2022-03-03 11:55:27 0:40:52 0:28:21 0:12:31 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717511 2022-03-03 05:08:29 2022-03-03 11:14:55 2022-03-03 11:32:45 0:17:50 0:07:20 0:10:30 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi122 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 6717512 2022-03-03 05:08:30 2022-03-03 11:15:16 2022-03-03 11:54:36 0:39:20 0:29:03 0:10:17 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717513 2022-03-03 05:08:31 2022-03-03 11:15:26 2022-03-03 11:37:07 0:21:41 0:12:22 0:09:19 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} 2
pass 6717514 2022-03-03 05:08:31 2022-03-03 11:15:36 2022-03-03 11:53:15 0:37:39 0:28:12 0:09:27 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717515 2022-03-03 05:08:32 2022-03-03 11:16:17 2022-03-03 11:40:04 0:23:47 0:13:34 0:10:13 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} 2
pass 6717516 2022-03-03 05:08:33 2022-03-03 11:16:57 2022-03-03 11:59:07 0:42:10 0:31:00 0:11:10 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717517 2022-03-03 05:08:34 2022-03-03 21:51:52 2022-03-03 22:09:06 0:17:14 0:07:37 0:09:37 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota} 2
pass 6717518 2022-03-03 05:08:35 2022-03-03 21:51:52 2022-03-03 22:26:48 0:34:56 0:25:25 0:09:31 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717519 2022-03-03 05:08:35 2022-03-03 21:51:53 2022-03-03 22:11:13 0:19:20 0:10:36 0:08:44 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
pass 6717520 2022-03-03 05:08:36 2022-03-03 21:51:53 2022-03-03 22:11:19 0:19:26 0:09:19 0:10:07 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} 2
pass 6717521 2022-03-03 05:08:37 2022-03-03 21:51:53 2022-03-03 22:12:27 0:20:34 0:09:42 0:10:52 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} 2
fail 6717522 2022-03-03 05:08:38 2022-03-03 21:52:54 2022-03-03 22:00:36 0:07:42 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi039 with status 1: 'sudo yum install -y kernel'

pass 6717523 2022-03-03 05:08:39 2022-03-03 21:53:14 2022-03-03 22:35:41 0:42:27 0:31:19 0:11:08 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717524 2022-03-03 05:08:40 2022-03-03 21:54:45 2022-03-03 22:30:41 0:35:56 0:26:48 0:09:08 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717525 2022-03-03 05:08:40 2022-03-03 21:55:15 2022-03-03 22:12:48 0:17:33 0:07:28 0:10:05 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} 2
pass 6717526 2022-03-03 05:08:41 2022-03-03 21:55:25 2022-03-03 22:34:51 0:39:26 0:30:23 0:09:03 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717527 2022-03-03 05:08:42 2022-03-03 21:55:26 2022-03-03 22:30:53 0:35:27 0:26:36 0:08:51 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717528 2022-03-03 05:08:43 2022-03-03 21:55:46 2022-03-03 22:13:59 0:18:13 0:06:52 0:11:21 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi023 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

dead 6717529 2022-03-03 05:08:43 2022-03-03 21:55:46 2022-03-04 04:36:14 6:40:28 smithi master ubuntu rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} 2
Failure Reason:

hit max job timeout

pass 6717530 2022-03-03 05:08:44 2022-03-03 21:55:57 2022-03-03 22:24:46 0:28:49 0:17:03 0:11:46 smithi master rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} 2
pass 6717531 2022-03-03 05:08:45 2022-03-03 21:57:17 2022-03-03 22:33:49 0:36:32 0:26:17 0:10:15 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717532 2022-03-03 05:08:46 2022-03-03 21:59:08 2022-03-03 22:18:34 0:19:26 0:10:37 0:08:49 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests} 2
pass 6717533 2022-03-03 05:08:47 2022-03-03 21:59:38 2022-03-03 22:39:55 0:40:17 0:28:48 0:11:29 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717534 2022-03-03 05:08:48 2022-03-03 22:00:39 2022-03-03 22:38:53 0:38:14 0:27:09 0:11:05 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717535 2022-03-03 05:08:48 2022-03-03 22:01:49 2022-03-03 22:19:08 0:17:19 0:07:39 0:09:40 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} 2
pass 6717536 2022-03-03 05:08:49 2022-03-03 22:02:10 2022-03-03 22:41:55 0:39:45 0:30:06 0:09:39 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717537 2022-03-03 05:08:50 2022-03-03 22:03:00 2022-03-03 22:22:35 0:19:35 0:10:35 0:09:00 smithi master rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} 1
pass 6717538 2022-03-03 05:08:51 2022-03-03 22:03:10 2022-03-03 22:20:40 0:17:30 0:08:32 0:08:58 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota} 2
pass 6717539 2022-03-03 05:08:51 2022-03-03 22:03:11 2022-03-03 22:23:54 0:20:43 0:11:53 0:08:50 smithi master centos 8.stream rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} 2
fail 6717540 2022-03-03 05:08:52 2022-03-03 22:03:11 2022-03-03 22:10:28 0:07:17 smithi master centos 8.1 rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} 2
Failure Reason:

Command failed on smithi195 with status 1: 'sudo yum install -y kernel'

pass 6717541 2022-03-03 05:08:53 2022-03-03 22:03:41 2022-03-03 22:38:42 0:35:01 0:26:21 0:08:40 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717542 2022-03-03 05:08:54 2022-03-03 22:03:42 2022-03-03 22:42:47 0:39:05 0:29:15 0:09:50 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717543 2022-03-03 05:08:55 2022-03-03 22:03:42 2022-03-03 22:21:10 0:17:28 0:08:23 0:09:05 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} 2
pass 6717544 2022-03-03 05:08:55 2022-03-03 22:03:52 2022-03-03 22:26:18 0:22:26 0:12:04 0:10:22 smithi master ubuntu rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} 2
pass 6717545 2022-03-03 05:08:56 2022-03-03 22:04:03 2022-03-03 22:43:03 0:39:00 0:29:34 0:09:26 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717546 2022-03-03 05:08:57 2022-03-03 22:04:03 2022-03-03 22:41:55 0:37:52 0:28:36 0:09:16 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6717547 2022-03-03 05:08:58 2022-03-03 22:05:24 2022-03-03 22:22:59 0:17:35 0:06:52 0:10:43 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} 2
Failure Reason:

Command failed on smithi037 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 6717548 2022-03-03 05:08:59 2022-03-03 22:05:34 2022-03-03 22:45:14 0:39:40 0:28:49 0:10:51 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
fail 6717549 2022-03-03 05:08:59 2022-03-03 22:05:55 2022-03-03 22:28:48 0:22:53 0:11:34 0:11:19 smithi master rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests} 2
Failure Reason:

"2022-03-03T22:24:17.207585+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: Degraded data redundancy: 23/12751 objects degraded (0.180%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6717550 2022-03-03 05:09:00 2022-03-03 22:07:05 2022-03-03 22:44:28 0:37:23 0:28:22 0:09:01 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6717551 2022-03-03 05:09:01 2022-03-03 22:07:25 2022-03-03 22:45:07 0:37:42 0:29:00 0:08:42 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6717552 2022-03-03 05:09:02 2022-03-03 22:08:06 2022-03-03 22:26:10 0:18:04 0:07:22 0:10:42 smithi master ubuntu rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota} 2
pass 6717553 2022-03-03 05:09:03 2022-03-03 22:08:46 2022-03-03 22:48:16 0:39:30 0:28:15 0:11:15 smithi master centos 8.stream rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2