Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6298578 2021-07-28 15:35:08 2021-07-28 15:35:53 2021-07-28 16:05:16 0:29:23 0:20:10 0:09:13 smithi master ubuntu 20.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} 1
fail 6298579 2021-07-28 15:35:09 2021-07-28 15:35:53 2021-07-28 15:59:24 0:23:31 0:12:43 0:10:48 smithi master rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} 2
Failure Reason:

Command failed on smithi094 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2'

pass 6298580 2021-07-28 15:35:10 2021-07-28 15:35:53 2021-07-28 15:55:09 0:19:16 0:09:45 0:09:31 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota ubuntu_latest} 2
fail 6298581 2021-07-28 15:35:10 2021-07-28 15:35:54 2021-07-28 20:04:57 4:29:03 4:22:12 0:06:51 smithi master rhel 8.4 rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} 2
Failure Reason:

rgw multisite test failures

pass 6298582 2021-07-28 15:35:11 2021-07-28 15:35:55 2021-07-28 16:18:02 0:42:07 0:31:46 0:10:21 smithi master centos 8.3 rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} 2
pass 6298583 2021-07-28 15:35:12 2021-07-28 15:35:55 2021-07-28 16:00:02 0:24:07 0:11:27 0:12:40 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} 2
pass 6298584 2021-07-28 15:35:13 2021-07-28 15:35:55 2021-07-28 16:19:41 0:43:46 0:28:23 0:15:23 smithi master centos 8.3 rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{centos_8} tasks/{0-install ststests webidentity}} 2
fail 6298585 2021-07-28 15:35:14 2021-07-28 15:35:55 2021-07-28 16:10:04 0:34:09 0:21:27 0:12:42 smithi master ubuntu 20.04 rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} 1
Failure Reason:

Command failed on smithi111 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'"

pass 6298586 2021-07-28 15:35:15 2021-07-28 15:35:58 2021-07-28 16:02:34 0:26:36 0:14:55 0:11:41 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} 2
pass 6298587 2021-07-28 15:35:16 2021-07-28 15:35:58 2021-07-28 18:28:47 2:52:49 2:43:27 0:09:22 smithi master centos 8.3 rgw/tools/{centos_latest cluster tasks} 1
pass 6298588 2021-07-28 15:35:17 2021-07-28 15:35:59 2021-07-28 16:18:11 0:42:12 0:30:49 0:11:23 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
fail 6298589 2021-07-28 15:35:18 2021-07-28 15:35:59 2021-07-28 16:05:01 0:29:02 0:17:34 0:11:28 smithi master ubuntu 20.04 rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} 2
Failure Reason:

Command failed (s3 tests against rgw) on smithi051 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

pass 6298590 2021-07-28 15:35:19 2021-07-28 15:35:59 2021-07-28 17:17:02 1:41:03 1:28:55 0:12:08 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6298591 2021-07-28 15:35:20 2021-07-28 15:35:59 2021-07-28 15:59:55 0:23:56 0:10:29 0:13:27 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload ubuntu_latest} 2
pass 6298592 2021-07-28 15:35:21 2021-07-28 15:36:01 2021-07-28 16:15:48 0:39:47 0:29:58 0:09:49 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298593 2021-07-28 15:35:22 2021-07-28 15:36:01 2021-07-28 16:00:45 0:24:44 0:13:39 0:11:05 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} 2
fail 6298594 2021-07-28 15:35:23 2021-07-28 15:36:01 2021-07-28 17:24:58 1:48:57 1:36:28 0:12:29 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

saw valgrind issues

fail 6298595 2021-07-28 15:35:24 2021-07-28 15:36:01 2021-07-28 15:59:10 0:23:09 0:10:05 0:13:04 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

"2021-07-28T15:55:24.829278+0000 mon.a (mon.0) 298 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6298596 2021-07-28 15:35:24 2021-07-28 15:36:02 2021-07-28 15:57:10 0:21:08 0:12:21 0:08:47 smithi master ubuntu 20.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2021-07-28T15:52:01.355413+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4854 objects degraded (0.041%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6298597 2021-07-28 15:35:25 2021-07-28 15:36:02 2021-07-28 16:00:23 0:24:21 0:12:46 0:11:35 smithi master centos 8.stream rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8.stream}} 2
pass 6298598 2021-07-28 15:35:26 2021-07-28 15:36:02 2021-07-28 16:18:50 0:42:48 0:30:06 0:12:42 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298599 2021-07-28 15:35:27 2021-07-28 15:36:03 2021-07-28 16:03:50 0:27:47 0:14:25 0:13:22 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests ubuntu_latest} 2
fail 6298600 2021-07-28 15:35:28 2021-07-28 15:36:05 2021-07-28 17:20:52 1:44:47 1:31:47 0:13:00 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2021-07-28T15:57:22.837898+0000 mon.a (mon.0) 110 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6298601 2021-07-28 15:35:29 2021-07-28 15:36:05 2021-07-28 16:06:29 0:30:24 0:18:48 0:11:36 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} 2
pass 6298602 2021-07-28 15:35:30 2021-07-28 15:36:05 2021-07-28 16:18:06 0:42:01 0:30:38 0:11:23 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298603 2021-07-28 15:35:31 2021-07-28 15:36:06 2021-07-28 15:58:30 0:22:24 0:09:58 0:12:26 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota ubuntu_latest} 2
fail 6298604 2021-07-28 15:35:32 2021-07-28 15:36:06 2021-07-28 17:13:03 1:36:57 1:23:34 0:13:23 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2021-07-28T15:57:30.981274+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6298605 2021-07-28 15:35:33 2021-07-28 15:36:07 2021-07-28 15:58:24 0:22:17 0:13:36 0:08:41 smithi master centos 8.stream rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8.stream}} 1
pass 6298606 2021-07-28 15:35:34 2021-07-28 15:36:07 2021-07-28 16:00:03 0:23:56 0:10:19 0:13:37 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota ubuntu_latest} 2
pass 6298607 2021-07-28 15:35:35 2021-07-28 15:36:08 2021-07-28 15:59:54 0:23:46 0:12:28 0:11:18 smithi master centos 8.stream rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}} 2
pass 6298608 2021-07-28 15:35:36 2021-07-28 15:36:08 2021-07-28 16:19:13 0:43:05 0:31:11 0:11:54 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298609 2021-07-28 15:35:37 2021-07-28 15:36:08 2021-07-28 16:01:08 0:25:00 0:13:40 0:11:20 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} 2
fail 6298610 2021-07-28 15:35:38 2021-07-28 15:36:08 2021-07-28 18:55:33 3:19:25 3:05:21 0:14:04 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

Command failed on smithi133 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph'

dead 6298611 2021-07-28 15:35:38 2021-07-28 15:36:10 2021-07-28 15:53:28 0:17:18 0:04:26 0:12:52 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest} 2
Failure Reason:

Failure object was: {'smithi012.front.sepia.ceph.com': {'cache_updated': False, 'stdout': '', 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7309 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common'], 'autoclean': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common'], 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1627487011, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7309 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stdout_lines': [], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7309 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time')

pass 6298612 2021-07-28 15:35:39 2021-07-28 15:36:10 2021-07-28 16:20:53 0:44:43 0:31:41 0:13:02 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
fail 6298613 2021-07-28 15:35:40 2021-07-28 15:36:10 2021-07-28 17:14:25 1:38:15 1:25:42 0:12:33 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2021-07-28T15:57:43.912983+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6298614 2021-07-28 15:35:41 2021-07-28 15:36:11 2021-07-28 16:00:05 0:23:54 0:10:11 0:13:43 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest} 2
fail 6298615 2021-07-28 15:35:42 2021-07-28 15:36:11 2021-07-28 16:00:11 0:24:00 0:13:50 0:10:10 smithi master centos 8.3 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed (s3 tests against rgw) on smithi075 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

fail 6298616 2021-07-28 15:35:43 2021-07-28 15:36:11 2021-07-28 16:03:19 0:27:08 0:14:03 0:13:05 smithi master rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} 2
Failure Reason:

Command failed on smithi073 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0'

pass 6298617 2021-07-28 15:35:44 2021-07-28 15:36:11 2021-07-28 16:32:59 0:56:48 0:43:13 0:13:35 smithi master centos 8.3 rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8} tasks/test_multi} 2
pass 6298618 2021-07-28 15:35:45 2021-07-28 15:36:13 2021-07-28 15:59:33 0:23:20 0:11:38 0:11:42 smithi master ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} 2
pass 6298619 2021-07-28 15:35:47 2021-07-28 15:36:13 2021-07-28 16:10:58 0:34:45 0:15:34 0:19:11 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} 2
pass 6298620 2021-07-28 15:35:48 2021-07-28 15:45:44 2021-07-28 16:31:05 0:45:21 0:28:24 0:16:57 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298621 2021-07-28 15:35:49 2021-07-28 15:53:36 2021-07-28 16:16:22 0:22:46 0:11:51 0:10:55 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest} 2
pass 6298622 2021-07-28 15:35:50 2021-07-28 15:54:57 2021-07-28 17:36:16 1:41:19 1:30:42 0:10:37 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6298623 2021-07-28 15:35:51 2021-07-28 15:55:17 2021-07-28 16:34:00 0:38:43 0:26:49 0:11:54 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2021-07-28T16:14:18.981377+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6298624 2021-07-28 15:35:52 2021-07-28 15:57:18 2021-07-28 16:17:00 0:19:42 0:08:30 0:11:12 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest} 2
pass 6298625 2021-07-28 15:35:53 2021-07-28 15:57:38 2021-07-28 16:21:44 0:24:06 0:12:33 0:11:33 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} 2
pass 6298626 2021-07-28 15:35:54 2021-07-28 15:58:39 2021-07-28 17:42:07 1:43:28 1:33:20 0:10:08 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
fail 6298627 2021-07-28 15:35:57 2021-07-28 15:58:59 2021-07-28 16:27:31 0:28:32 0:22:01 0:06:31 smithi master rhel 8.4 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (s3 tests against rgw) on smithi028 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

pass 6298628 2021-07-28 15:35:58 2021-07-28 15:58:59 2021-07-28 16:18:36 0:19:37 0:09:18 0:10:19 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} 2
pass 6298629 2021-07-28 15:35:59 2021-07-28 15:59:19 2021-07-28 16:20:26 0:21:07 0:11:35 0:09:32 smithi master centos 8.stream rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8.stream}} 2
pass 6298630 2021-07-28 15:36:00 2021-07-28 15:59:31 2021-07-28 16:38:30 0:38:59 0:28:36 0:10:23 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298631 2021-07-28 15:36:01 2021-07-28 15:59:41 2021-07-28 17:43:21 1:43:40 1:31:49 0:11:51 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6298632 2021-07-28 15:36:02 2021-07-28 16:00:01 2021-07-28 16:19:46 0:19:45 0:09:05 0:10:40 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} 2
pass 6298633 2021-07-28 15:36:03 2021-07-28 16:00:02 2021-07-28 16:25:44 0:25:42 0:15:50 0:09:52 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} 2
pass 6298634 2021-07-28 15:36:03 2021-07-28 16:00:12 2021-07-28 16:39:49 0:39:37 0:28:56 0:10:41 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
fail 6298635 2021-07-28 15:36:04 2021-07-28 16:00:12 2021-07-28 17:33:36 1:33:24 1:22:19 0:11:05 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

saw valgrind issues

pass 6298636 2021-07-28 15:36:05 2021-07-28 16:00:13 2021-07-28 16:19:55 0:19:42 0:08:31 0:11:11 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed ubuntu_latest} 2
fail 6298637 2021-07-28 15:36:06 2021-07-28 16:00:33 2021-07-28 16:28:55 0:28:22 0:22:06 0:06:16 smithi master rhel 8.4 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (s3 tests against rgw) on smithi059 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'"

pass 6298638 2021-07-28 15:36:08 2021-07-28 16:00:33 2021-07-28 16:21:52 0:21:19 0:12:06 0:09:13 smithi master centos 8.3 rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} 2
pass 6298639 2021-07-28 15:36:09 2021-07-28 16:00:54 2021-07-28 16:40:04 0:39:10 0:29:00 0:10:10 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298640 2021-07-28 15:36:10 2021-07-28 16:00:56 2021-07-28 16:24:29 0:23:33 0:12:56 0:10:37 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests ubuntu_latest} 2
pass 6298641 2021-07-28 15:36:11 2021-07-28 16:01:06 2021-07-28 16:24:43 0:23:37 0:12:23 0:11:14 smithi master ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} 2
pass 6298642 2021-07-28 15:36:12 2021-07-28 16:01:17 2021-07-28 17:34:10 1:32:53 1:21:57 0:10:56 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
pass 6298643 2021-07-28 15:36:14 2021-07-28 16:01:17 2021-07-28 16:40:22 0:39:05 0:29:48 0:09:17 smithi master centos 8.3 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
pass 6298644 2021-07-28 15:36:15 2021-07-28 16:01:17 2021-07-28 16:21:15 0:19:58 0:08:27 0:11:31 smithi master ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota ubuntu_latest} 2
pass 6298645 2021-07-28 15:36:16 2021-07-28 16:01:27 2021-07-28 17:32:04 1:30:37 1:17:00 0:13:37 smithi master centos 8.0 rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2