Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4975401 2020-04-22 15:10:10 2020-04-22 22:03:24 2020-04-22 22:29:24 0:26:00 0:18:41 0:07:19 smithi master rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} 1
pass 4975402 2020-04-22 15:10:11 2020-04-22 22:03:30 2020-04-22 22:35:30 0:32:00 0:24:56 0:07:04 smithi master rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml s3a-hadoop.yaml} 2
pass 4975403 2020-04-22 15:10:12 2020-04-22 22:03:30 2020-04-22 22:21:29 0:17:59 0:10:06 0:07:53 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4975404 2020-04-22 15:10:13 2020-04-22 22:05:13 2020-04-22 22:55:12 0:49:59 0:42:17 0:07:42 smithi master ubuntu rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
fail 4975405 2020-04-22 15:10:13 2020-04-22 22:05:14 2020-04-22 22:15:12 0:09:58 smithi master rhel 8.1 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_8.yaml}} 2
Failure Reason:

Command failed on smithi114 with status 1: 'sudo yum install -y kernel'

pass 4975406 2020-04-22 15:10:14 2020-04-22 22:05:13 2020-04-22 22:31:12 0:25:59 0:19:56 0:06:03 smithi master ubuntu 18.04 rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} 1
pass 4975407 2020-04-22 15:10:15 2020-04-22 22:05:13 2020-04-22 22:27:12 0:21:59 0:13:52 0:08:07 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
pass 4975408 2020-04-22 15:10:16 2020-04-22 22:05:13 2020-04-22 22:37:12 0:31:59 0:23:19 0:08:40 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975409 2020-04-22 15:10:17 2020-04-22 22:05:13 2020-04-22 22:35:12 0:29:59 0:16:41 0:13:18 smithi master ubuntu 18.04 rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} 2
dead 4975410 2020-04-22 15:10:18 2020-04-22 22:07:10 2020-04-22 22:23:10 0:16:00 0:04:14 0:11:46 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

reyer 82 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 \nlab-extras 964 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:22:16.262093', 'end': '2020-04-22 22:22:20.217851', 'delta': '0:00:03.955758', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 2.2 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Base 1.5 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Extras 3.5 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 82 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 ', 'lab-extras 964 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975411 2020-04-22 15:10:18 2020-04-22 22:07:10 2020-04-22 22:25:10 0:18:00 0:09:05 0:08:55 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975412 2020-04-22 15:10:19 2020-04-22 22:07:10 2020-04-22 22:39:10 0:32:00 0:21:41 0:10:19 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975413 2020-04-22 15:10:20 2020-04-22 22:07:14 2020-04-22 22:25:13 0:17:59 0:04:21 0:13:38 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

1.3 kB/s | 2.3 kB 00:01 \nCentOS-8 - Extras 1.6 kB/s | 2.3 kB 00:01 \nExtra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:22:57.647486', 'end': '2020-04-22 22:23:02.114262', 'delta': '0:00:04.466776', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 4.9 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 1.3 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Extras 1.6 kB/s | 2.3 kB 00:01 ', 'Extra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975414 2020-04-22 15:10:21 2020-04-22 22:07:25 2020-04-22 22:25:24 0:17:59 0:09:10 0:08:49 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
pass 4975415 2020-04-22 15:10:22 2020-04-22 22:09:38 2020-04-22 22:51:38 0:42:00 0:27:44 0:14:16 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975416 2020-04-22 15:10:23 2020-04-22 22:11:17 2020-04-22 22:31:15 0:19:58 0:13:03 0:06:55 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
dead 4975417 2020-04-22 15:10:24 2020-04-22 22:11:16 2020-04-22 22:25:15 0:13:59 0:04:11 0:09:48 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

e for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:23:36.688060', 'end': '2020-04-22 22:23:40.443816', 'delta': '0:00:03.755756', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 1.6 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Base 3.6 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 2.5 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975418 2020-04-22 15:10:25 2020-04-22 22:11:17 2020-04-22 22:35:16 0:23:59 0:12:34 0:11:25 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
fail 4975419 2020-04-22 15:10:25 2020-04-22 22:11:17 2020-04-22 22:47:17 0:36:00 0:23:55 0:12:05 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2020-04-22T22:30:10.141418+0000 mon.b (mon.0) 261 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log

pass 4975420 2020-04-22 15:10:26 2020-04-22 22:11:17 2020-04-22 22:29:16 0:17:59 0:09:11 0:08:48 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
dead 4975421 2020-04-22 15:10:27 2020-04-22 22:11:17 2020-04-22 22:29:16 0:17:59 0:04:18 0:13:41 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

4.8 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 5.0 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 \nlab-extras 898 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:27:35.606008', 'end': '2020-04-22 22:27:37.820521', 'delta': '0:00:02.214513', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 4.6 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 4.8 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 5.0 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 ', 'lab-extras 898 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975422 2020-04-22 15:10:28 2020-04-22 22:11:17 2020-04-22 22:31:16 0:19:59 0:09:51 0:10:08 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4975423 2020-04-22 15:10:29 2020-04-22 22:11:17 2020-04-22 22:33:16 0:21:59 0:10:53 0:11:06 smithi master centos 8.1 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}} 2
pass 4975424 2020-04-22 15:10:30 2020-04-22 22:13:05 2020-04-22 22:45:04 0:31:59 0:22:45 0:09:14 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975425 2020-04-22 15:10:31 2020-04-22 22:13:07 2020-04-22 22:27:06 0:13:59 0:04:14 0:09:45 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

4.4 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 4.2 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 27 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 \nlab-extras 851 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:26:31.042022', 'end': '2020-04-22 22:26:34.320169', 'delta': '0:00:03.278147', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 1.6 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Base 4.4 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 4.2 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 27 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 ', 'lab-extras 851 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975426 2020-04-22 15:10:32 2020-04-22 22:13:23 2020-04-22 22:29:22 0:15:59 0:09:26 0:06:33 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975427 2020-04-22 15:10:33 2020-04-22 22:13:24 2020-04-22 22:45:24 0:32:00 0:24:10 0:07:50 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975428 2020-04-22 15:10:34 2020-04-22 22:15:20 2020-04-22 22:31:19 0:15:59 0:04:20 0:11:39 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

1.1 kB/s | 2.3 kB 00:02 \nCentOS-8 - Extras 7.0 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 74 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 118 kB/s | 4.7 kB 00:00 \nlab-extras 862 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:29:02.330628', 'end': '2020-04-22 22:29:11.707282', 'delta': '0:00:09.376654', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 379 B/s | 2.3 kB 00:06 ', 'CentOS-8 - Base 1.1 kB/s | 2.3 kB 00:02 ', 'CentOS-8 - Extras 7.0 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 74 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 118 kB/s | 4.7 kB 00:00 ', 'lab-extras 862 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

fail 4975429 2020-04-22 15:10:34 2020-04-22 22:15:20 2020-04-22 22:31:19 0:15:59 0:08:57 0:07:02 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
Failure Reason:

"2020-04-22T22:28:52.754504+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 4975430 2020-04-22 15:10:35 2020-04-22 22:15:20 2020-04-22 22:35:19 0:19:59 0:12:56 0:07:03 smithi master rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} 1
pass 4975431 2020-04-22 15:10:36 2020-04-22 22:15:20 2020-04-22 22:51:20 0:36:00 0:25:27 0:10:33 smithi master ubuntu rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
pass 4975432 2020-04-22 15:10:37 2020-04-22 22:15:20 2020-04-22 22:41:20 0:26:00 0:17:43 0:08:17 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4975433 2020-04-22 15:10:38 2020-04-22 22:15:20 2020-04-22 22:49:20 0:34:00 0:22:42 0:11:18 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975434 2020-04-22 15:10:39 2020-04-22 22:15:24 2020-04-22 22:43:24 0:28:00 0:13:53 0:14:07 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
dead 4975435 2020-04-22 15:10:40 2020-04-22 22:15:25 2020-04-22 22:29:24 0:13:59 0:04:14 0:09:45 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

reyer 72 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 \nlab-extras 872 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:28:11.466250', 'end': '2020-04-22 22:28:12.983423', 'delta': '0:00:01.517173', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 6.5 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 7.9 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 16 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 ', 'lab-extras 872 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

fail 4975436 2020-04-22 15:10:40 2020-04-22 22:15:25 2020-04-22 22:47:25 0:32:00 0:22:23 0:09:37 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
Failure Reason:

"2020-04-22T22:32:46.604819+0000 mon.a (mon.0) 205 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 4975437 2020-04-22 15:10:41 2020-04-22 22:17:05 2020-04-22 22:33:05 0:16:00 0:08:55 0:07:05 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
dead 4975438 2020-04-22 15:10:42 2020-04-22 22:17:05 2020-04-22 22:35:05 0:18:00 0:04:13 0:13:47 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

944 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:33:21.361116', 'end': '2020-04-22 22:33:25.526712', 'delta': '0:00:04.165596', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 4.7 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 1.0 kB/s | 2.3 kB 00:02 ', 'CentOS-8 - Extras 3.4 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 ', 'lab-extras 944 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975439 2020-04-22 15:10:43 2020-04-22 22:17:06 2020-04-22 22:35:06 0:18:00 0:10:06 0:07:54 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4975440 2020-04-22 15:10:44 2020-04-22 22:17:06 2020-04-22 22:37:06 0:20:00 0:10:58 0:09:02 smithi master centos 8.1 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} 2
pass 4975441 2020-04-22 15:10:45 2020-04-22 22:17:06 2020-04-22 22:55:06 0:38:00 0:21:14 0:16:46 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975442 2020-04-22 15:10:46 2020-04-22 22:17:07 2020-04-22 22:35:06 0:17:59 0:04:13 0:13:46 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

e for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:34:10.913408', 'end': '2020-04-22 22:34:12.810275', 'delta': '0:00:01.896867', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 5.5 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 3.3 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 19 kB/s | 2.3 kB 00:00 ', 'Last metadata expiration check: 0:00:07 ago on Wed 22 Apr 2020 10:34:05 PM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975443 2020-04-22 15:10:47 2020-04-22 22:17:14 2020-04-22 22:39:14 0:22:00 0:08:53 0:13:07 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975444 2020-04-22 15:10:48 2020-04-22 22:17:23 2020-04-22 22:37:22 0:19:59 0:12:20 0:07:39 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4975445 2020-04-22 15:10:49 2020-04-22 22:17:23 2020-04-22 22:51:23 0:34:00 0:23:02 0:10:58 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975446 2020-04-22 15:10:50 2020-04-22 22:19:10 2020-04-22 22:43:10 0:24:00 0:08:28 0:15:32 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

997 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:41:56.791151', 'end': '2020-04-22 22:41:57.924930', 'delta': '0:00:01.133779', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 15 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 14 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 73 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 ', 'lab-extras 997 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975447 2020-04-22 15:10:50 2020-04-22 22:19:10 2020-04-22 22:37:10 0:18:00 0:09:13 0:08:47 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
pass 4975448 2020-04-22 15:10:51 2020-04-22 22:19:10 2020-04-22 22:53:10 0:34:00 0:23:57 0:10:03 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975449 2020-04-22 15:10:52 2020-04-22 22:19:10 2020-04-22 22:39:10 0:20:00 0:12:52 0:07:08 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
dead 4975450 2020-04-22 15:10:53 2020-04-22 22:19:11 2020-04-22 22:41:10 0:21:59 0:06:31 0:15:28 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

14 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 3.2 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 \nlab-extras 863 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:39:08.709168', 'end': '2020-04-22 22:39:10.547299', 'delta': '0:00:01.838131', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 11 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 14 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 3.2 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 ', 'lab-extras 863 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975451 2020-04-22 15:10:54 2020-04-22 22:19:21 2020-04-22 22:53:21 0:34:00 0:22:50 0:11:10 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975452 2020-04-22 15:10:55 2020-04-22 22:19:22 2020-04-22 22:37:21 0:17:59 0:09:16 0:08:43 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
dead 4975453 2020-04-22 15:10:56 2020-04-22 22:19:23 2020-04-22 22:35:22 0:15:59 0:04:21 0:11:38 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

1.1 kB/s | 2.3 kB 00:02 \nCentOS-8 - Extras 16 kB/s | 2.3 kB 00:00 \nLast metadata expiration check: 0:00:09 ago on Wed 22 Apr 2020 10:33:59 PM UTC.', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:34:05.445012', 'end': '2020-04-22 22:34:09.288942', 'delta': '0:00:03.843930', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 2.4 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 1.1 kB/s | 2.3 kB 00:02 ', 'CentOS-8 - Extras 16 kB/s | 2.3 kB 00:00 ', 'Last metadata expiration check: 0:00:09 ago on Wed 22 Apr 2020 10:33:59 PM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975454 2020-04-22 15:10:57 2020-04-22 22:21:07 2020-04-22 22:41:06 0:19:59 0:12:43 0:07:16 smithi master rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} 1
pass 4975455 2020-04-22 15:10:58 2020-04-22 22:21:07 2020-04-22 22:49:07 0:28:00 0:15:25 0:12:35 smithi master rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml s3a-hadoop.yaml} 2
pass 4975456 2020-04-22 15:10:58 2020-04-22 22:21:07 2020-04-22 22:45:07 0:24:00 0:09:34 0:14:26 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4975457 2020-04-22 15:10:59 2020-04-22 22:21:09 2020-04-22 23:15:09 0:54:00 0:43:51 0:10:09 smithi master ubuntu rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} 2
pass 4975458 2020-04-22 15:11:00 2020-04-22 22:21:11 2020-04-22 22:41:10 0:19:59 0:11:17 0:08:42 smithi master centos 8.1 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_8.yaml}} 2
pass 4975459 2020-04-22 15:11:01 2020-04-22 22:21:20 2020-04-22 22:47:20 0:26:00 0:19:48 0:06:12 smithi master ubuntu 18.04 rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} 1
pass 4975460 2020-04-22 15:11:02 2020-04-22 22:21:23 2020-04-22 22:43:23 0:22:00 0:13:40 0:08:20 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} 2
pass 4975461 2020-04-22 15:11:03 2020-04-22 22:21:24 2020-04-22 22:51:23 0:29:59 0:22:17 0:07:42 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
fail 4975462 2020-04-22 15:11:04 2020-04-22 22:21:30 2020-04-22 22:47:30 0:26:00 0:16:46 0:09:14 smithi master ubuntu 18.04 rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} 2
Failure Reason:

"2020-04-22T22:36:23.130525+0000 mon.b (mon.0) 188 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY)" in cluster log

dead 4975463 2020-04-22 15:11:05 2020-04-22 22:23:25 2020-04-22 22:47:25 0:24:00 0:04:11 0:19:49 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

19 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 68 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 \nlab-extras 940 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:36.530397', 'end': '2020-04-22 22:46:37.578463', 'delta': '0:00:01.048066', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 22 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 19 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 68 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 ', 'lab-extras 940 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975464 2020-04-22 15:11:06 2020-04-22 22:23:25 2020-04-22 22:41:25 0:18:00 0:09:30 0:08:30 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975465 2020-04-22 15:11:07 2020-04-22 22:23:25 2020-04-22 23:05:25 0:42:00 0:22:19 0:19:41 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975466 2020-04-22 15:11:07 2020-04-22 22:23:25 2020-04-22 22:47:25 0:24:00 0:04:05 0:19:55 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

he for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:45:34.573718', 'end': '2020-04-22 22:45:35.562110', 'delta': '0:00:00.988392', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 22 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 24 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 ', 'lab-extras 976 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975467 2020-04-22 15:11:08 2020-04-22 22:25:11 2020-04-22 22:43:10 0:17:59 0:08:55 0:09:04 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} 2
fail 4975468 2020-04-22 15:11:09 2020-04-22 22:25:11 2020-04-22 22:43:10 0:17:59 0:04:23 0:13:36 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
Failure Reason:

Command failed on smithi141 with status 1: 'sudo yum -y install ceph'

pass 4975469 2020-04-22 15:11:10 2020-04-22 22:25:11 2020-04-22 22:51:11 0:26:00 0:14:14 0:11:46 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} 2
dead 4975470 2020-04-22 15:11:11 2020-04-22 22:25:14 2020-04-22 22:49:14 0:24:00 0:05:21 0:18:39 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

24 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 \nlab-extras 984 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:48:39.048198', 'end': '2020-04-22 22:48:40.061750', 'delta': '0:00:01.013552', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 26 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 24 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 119 kB/s | 4.7 kB 00:00 ', 'lab-extras 984 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975471 2020-04-22 15:11:12 2020-04-22 22:25:15 2020-04-22 22:49:14 0:23:59 0:12:58 0:11:01 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} 2
pass 4975472 2020-04-22 15:11:13 2020-04-22 22:25:17 2020-04-22 23:03:16 0:37:59 0:25:44 0:12:15 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975473 2020-04-22 15:11:14 2020-04-22 22:25:22 2020-04-22 22:41:21 0:15:59 0:08:51 0:07:08 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} 2
dead 4975474 2020-04-22 15:11:15 2020-04-22 22:25:22 2020-04-22 22:47:22 0:22:00 0:04:13 0:17:47 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

26 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 24 kB/s | 2.3 kB 00:00 \nExtra Packages for Enterprise Linux 146 kB/s | 4.7 kB 00:00 \nlab-extras 955 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:26.845297', 'end': '2020-04-22 22:46:27.811912', 'delta': '0:00:00.966615', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 25 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 26 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 24 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 146 kB/s | 4.7 kB 00:00 ', 'lab-extras 955 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975475 2020-04-22 15:11:16 2020-04-22 22:25:23 2020-04-22 22:43:22 0:17:59 0:10:02 0:07:57 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml} 2
pass 4975476 2020-04-22 15:11:17 2020-04-22 22:25:25 2020-04-22 22:47:25 0:22:00 0:13:38 0:08:22 smithi master rhel 8.1 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}} 2
pass 4975477 2020-04-22 15:11:18 2020-04-22 22:27:23 2020-04-22 23:09:23 0:42:00 0:30:36 0:11:24 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975478 2020-04-22 15:11:19 2020-04-22 22:27:23 2020-04-22 22:47:22 0:19:59 0:04:05 0:15:54 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

he for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:45:35.027606', 'end': '2020-04-22 22:45:35.945008', 'delta': '0:00:00.917402', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 26 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 25 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 26 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 121 kB/s | 4.7 kB 00:00 ', 'lab-extras 1.0 MB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975479 2020-04-22 15:11:19 2020-04-22 22:27:24 2020-04-22 22:45:23 0:17:59 0:09:07 0:08:52 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975480 2020-04-22 15:11:20 2020-04-22 22:29:10 2020-04-22 23:03:09 0:33:59 0:25:38 0:08:21 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975481 2020-04-22 15:11:21 2020-04-22 22:29:17 2020-04-22 22:47:16 0:17:59 0:04:16 0:13:43 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

22 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 24 kB/s | 2.3 kB 00:00 \nExtra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 \nlab-extras 923 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:24.192557', 'end': '2020-04-22 22:46:25.184372', 'delta': '0:00:00.991815', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 20 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 22 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 24 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 ', 'lab-extras 923 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975482 2020-04-22 15:11:22 2020-04-22 22:29:17 2020-04-22 22:51:17 0:22:00 0:09:14 0:12:46 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} 2
pass 4975483 2020-04-22 15:11:23 2020-04-22 22:29:23 2020-04-22 22:49:23 0:20:00 0:12:47 0:07:13 smithi master rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} 1
pass 4975484 2020-04-22 15:11:24 2020-04-22 22:29:24 2020-04-22 23:05:24 0:36:00 0:25:22 0:10:38 smithi master ubuntu rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} 2
pass 4975485 2020-04-22 15:11:25 2020-04-22 22:29:25 2020-04-22 22:55:24 0:25:59 0:17:38 0:08:21 smithi master rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} 2
pass 4975486 2020-04-22 15:11:26 2020-04-22 22:29:25 2020-04-22 23:07:25 0:38:00 0:22:47 0:15:13 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975487 2020-04-22 15:11:27 2020-04-22 22:31:22 2020-04-22 22:51:22 0:20:00 0:13:11 0:06:49 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} 2
dead 4975488 2020-04-22 15:11:28 2020-04-22 22:31:22 2020-04-22 22:47:22 0:16:00 0:04:15 0:11:45 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

15 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 \nlab-extras 976 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:41.303474', 'end': '2020-04-22 22:46:42.393539', 'delta': '0:00:01.090065', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 23 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 15 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 21 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 ', 'lab-extras 976 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975489 2020-04-22 15:11:28 2020-04-22 22:31:23 2020-04-22 23:13:23 0:42:00 0:21:25 0:20:35 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
fail 4975490 2020-04-22 15:11:29 2020-04-22 22:31:23 2020-04-22 23:01:22 0:29:59 0:09:15 0:20:44 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} 2
Failure Reason:

"2020-04-22T22:57:01.292483+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log

dead 4975491 2020-04-22 15:11:30 2020-04-22 22:31:23 2020-04-22 22:59:22 0:27:59 0:04:16 0:23:43 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

145 kB/s | 4.7 kB 00:00 \nlab-extras 931 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:58:37.231549', 'end': '2020-04-22 22:58:38.136840', 'delta': '0:00:00.905291', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 26 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 25 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 ', 'lab-extras 931 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

fail 4975492 2020-04-22 15:11:31 2020-04-22 22:31:22 2020-04-22 22:55:22 0:24:00 0:09:39 0:14:21 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} 2
Failure Reason:

"2020-04-22T22:51:37.101044+0000 mon.a (mon.0) 258 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 4975493 2020-04-22 15:11:32 2020-04-22 22:31:23 2020-04-22 22:51:22 0:19:59 0:10:26 0:09:33 smithi master ubuntu 18.04 rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4975494 2020-04-22 15:11:33 2020-04-22 22:31:23 2020-04-22 23:13:22 0:41:59 0:22:21 0:19:38 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975495 2020-04-22 15:11:34 2020-04-22 22:33:21 2020-04-22 22:47:20 0:13:59 0:04:06 0:09:53 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

24 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 \nExtra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 \nlab-extras 860 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:01.453509', 'end': '2020-04-22 22:46:02.399603', 'delta': '0:00:00.946094', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 24 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 24 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 145 kB/s | 4.7 kB 00:00 ', 'lab-extras 860 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975496 2020-04-22 15:11:35 2020-04-22 22:33:21 2020-04-22 22:51:20 0:17:59 0:09:20 0:08:39 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} 2
pass 4975497 2020-04-22 15:11:36 2020-04-22 22:33:21 2020-04-22 22:55:20 0:21:59 0:12:56 0:09:03 smithi master ubuntu rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} 2
pass 4975498 2020-04-22 15:11:36 2020-04-22 22:33:24 2020-04-22 23:07:24 0:34:00 0:25:21 0:08:39 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
dead 4975499 2020-04-22 15:11:37 2020-04-22 22:33:24 2020-04-22 22:47:24 0:14:00 0:04:05 0:09:55 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

22 kB/s | 2.3 kB 00:00 \nCentOS-8 - Extras 23 kB/s | 2.3 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 \nlab-extras 1.0 MB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:46:41.047214', 'end': '2020-04-22 22:46:42.067445', 'delta': '0:00:01.020231', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 20 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 22 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 23 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 ', 'lab-extras 1.0 MB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975500 2020-04-22 15:11:38 2020-04-22 22:35:20 2020-04-22 22:51:20 0:16:00 0:08:53 0:07:07 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} 2
pass 4975501 2020-04-22 15:11:39 2020-04-22 22:35:20 2020-04-22 23:09:20 0:34:00 0:23:54 0:10:06 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975502 2020-04-22 15:11:40 2020-04-22 22:35:21 2020-04-22 22:57:20 0:21:59 0:14:07 0:07:52 smithi master rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} 2
dead 4975503 2020-04-22 15:11:41 2020-04-22 22:35:21 2020-04-22 22:51:20 0:15:59 0:04:12 0:11:47 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

120 kB/s | 4.7 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:49:17.566037', 'end': '2020-04-22 22:49:18.507037', 'delta': '0:00:00.941000', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 24 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Base 26 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 24 kB/s | 2.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')

pass 4975504 2020-04-22 15:11:42 2020-04-22 22:35:20 2020-04-22 23:11:20 0:36:00 0:24:08 0:11:52 smithi master centos 8.1 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} 2
pass 4975505 2020-04-22 15:11:43 2020-04-22 22:35:21 2020-04-22 22:53:20 0:17:59 0:08:43 0:09:16 smithi master ubuntu rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} 2
dead 4975506 2020-04-22 15:11:43 2020-04-22 22:35:23 2020-04-22 22:59:23 0:24:00 0:06:15 0:17:45 smithi master centos 8.0 rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} 2
Failure Reason:

923 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in <module>\n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-22 22:57:11.231243', 'end': '2020-04-22 22:57:13.240996', 'delta': '0:00:02.009753', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 2.1 kB/s | 2.3 kB 00:01 ', 'CentOS-8 - Base 25 kB/s | 2.3 kB 00:00 ', 'CentOS-8 - Extras 25 kB/s | 2.3 kB 00:00 ', 'Copr repo for ceph-el8 owned by ktdreyer 71 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 144 kB/s | 4.7 kB 00:00 ', 'lab-extras 923 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in <module>', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site-packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base')