Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6540610 2021-12-02 20:33:43 2021-12-03 03:22:12 2021-12-03 03:41:30 0:19:18 0:09:53 0:09:25 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540611 2021-12-02 20:33:44 2021-12-03 03:22:12 2021-12-03 03:47:54 0:25:42 0:13:23 0:12:19 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6540612 2021-12-02 20:33:45 2021-12-03 03:23:43 2021-12-03 04:07:02 0:43:19 0:33:01 0:10:18 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6540613 2021-12-02 20:33:46 2021-12-03 03:23:43 2021-12-03 03:52:06 0:28:23 0:17:17 0:11:06 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 6540614 2021-12-02 20:33:47 2021-12-03 03:24:04 2021-12-03 03:50:40 0:26:36 0:14:32 0:12:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 6540615 2021-12-02 20:33:48 2021-12-03 03:24:44 2021-12-03 04:02:01 0:37:17 0:29:57 0:07:20 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
dead 6540616 2021-12-02 20:33:49 2021-12-03 03:24:44 2021-12-03 03:40:56 0:16:12 0:04:00 0:12:12 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

{'Failure object was': {'smithi039.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6540617 2021-12-02 20:33:50 2021-12-03 03:26:45 2021-12-03 03:54:17 0:27:32 0:16:57 0:10:35 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
pass 6540618 2021-12-02 20:33:51 2021-12-03 03:27:05 2021-12-03 04:08:52 0:41:47 0:34:58 0:06:49 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 6540619 2021-12-02 20:33:52 2021-12-03 03:27:26 2021-12-03 03:52:57 0:25:31 0:15:51 0:09:40 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6540620 2021-12-02 20:33:53 2021-12-03 03:27:26 2021-12-03 04:20:54 0:53:28 0:46:46 0:06:42 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6540621 2021-12-02 20:33:54 2021-12-03 03:27:36 2021-12-03 04:47:14 1:19:38 1:13:22 0:06:16 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/dashboard} 2
pass 6540622 2021-12-02 20:33:55 2021-12-03 03:27:47 2021-12-03 03:52:10 0:24:23 0:12:52 0:11:31 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/crash} 2
pass 6540623 2021-12-02 20:33:56 2021-12-03 03:28:27 2021-12-03 03:47:58 0:19:31 0:10:34 0:08:57 smithi master centos 8.3 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 6540624 2021-12-02 20:33:57 2021-12-03 03:28:48 2021-12-03 03:49:19 0:20:31 0:09:57 0:10:34 smithi master ubuntu 20.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 6540625 2021-12-02 20:33:58 2021-12-03 03:29:38 2021-12-03 04:11:21 0:41:43 0:31:37 0:10:06 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.0} 1
pass 6540626 2021-12-02 20:33:59 2021-12-03 03:29:38 2021-12-03 03:53:16 0:23:38 0:17:09 0:06:29 smithi master centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6540627 2021-12-02 20:34:00 2021-12-03 03:30:09 2021-12-03 03:52:51 0:22:42 0:11:15 0:11:27 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
pass 6540628 2021-12-02 20:34:01 2021-12-03 03:30:09 2021-12-03 05:06:55 1:36:46 1:24:40 0:12:06 smithi master ubuntu 20.04 rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6540629 2021-12-02 20:34:02 2021-12-03 03:30:40 2021-12-03 04:10:50 0:40:10 0:29:37 0:10:33 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
fail 6540630 2021-12-02 20:34:03 2021-12-03 03:31:40 2021-12-03 03:55:17 0:23:37 0:16:15 0:07:22 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi104 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540631 2021-12-02 20:34:04 2021-12-03 04:07:03 1788 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 6540632 2021-12-02 20:34:05 2021-12-03 03:31:51 2021-12-03 04:12:44 0:40:53 0:29:55 0:10:58 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 6540633 2021-12-02 20:34:06 2021-12-03 03:33:31 2021-12-03 04:08:57 0:35:26 0:26:14 0:09:12 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 6540634 2021-12-02 20:34:07 2021-12-03 03:33:52 2021-12-03 03:51:43 0:17:51 0:06:39 0:11:12 smithi master ubuntu 20.04 rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540635 2021-12-02 20:34:08 2021-12-03 03:34:02 2021-12-03 04:09:49 0:35:47 0:28:53 0:06:54 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6540636 2021-12-02 20:34:09 2021-12-03 03:34:23 2021-12-03 03:51:49 0:17:26 0:11:21 0:06:05 smithi master centos 8.stream rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} 2
pass 6540637 2021-12-02 20:34:10 2021-12-03 03:34:23 2021-12-03 04:04:25 0:30:02 0:23:18 0:06:44 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540638 2021-12-02 20:34:11 2021-12-03 03:35:13 2021-12-03 03:58:21 0:23:08 0:13:45 0:09:23 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6540639 2021-12-02 20:34:12 2021-12-03 03:35:24 2021-12-03 04:02:45 0:27:21 0:21:37 0:05:44 smithi master rhel 8.4 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6540640 2021-12-02 20:34:13 2021-12-03 03:35:34 2021-12-03 03:56:06 0:20:32 0:09:28 0:11:04 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6540641 2021-12-02 20:34:14 2021-12-03 03:35:44 2021-12-03 03:57:27 0:21:43 0:11:17 0:10:26 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6540642 2021-12-02 20:34:15 2021-12-03 03:35:45 2021-12-03 04:01:29 0:25:44 0:15:15 0:10:29 smithi master centos 8.2 rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540643 2021-12-02 20:34:16 2021-12-03 03:36:25 2021-12-03 03:55:47 0:19:22 0:12:39 0:06:43 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 6540644 2021-12-02 20:34:18 2021-12-03 03:36:36 2021-12-03 04:07:40 0:31:04 0:22:31 0:08:33 smithi master centos 8.3 rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6540645 2021-12-02 20:34:18 2021-12-03 03:36:36 2021-12-03 03:59:40 0:23:04 0:13:20 0:09:44 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6540646 2021-12-02 20:34:19 2021-12-03 03:36:36 2021-12-03 03:59:52 0:23:16 0:16:28 0:06:48 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 6540647 2021-12-02 20:34:20 2021-12-03 03:36:37 2021-12-03 04:16:14 0:39:37 0:29:02 0:10:35 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6540648 2021-12-02 20:34:21 2021-12-03 03:36:57 2021-12-03 04:06:31 0:29:34 0:23:03 0:06:31 smithi master centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6540649 2021-12-02 20:34:22 2021-12-03 03:37:18 2021-12-03 04:12:42 0:35:24 0:25:06 0:10:18 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6540650 2021-12-02 20:34:23 2021-12-03 03:37:38 2021-12-03 03:59:40 0:22:02 0:11:15 0:10:47 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540651 2021-12-02 20:34:24 2021-12-03 03:37:58 2021-12-03 04:06:11 0:28:13 0:17:44 0:10:29 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 6540652 2021-12-02 20:34:25 2021-12-03 03:38:29 2021-12-03 03:56:10 0:17:41 0:07:27 0:10:14 smithi master rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} 1
pass 6540653 2021-12-02 20:34:26 2021-12-03 03:38:29 2021-12-03 04:04:30 0:26:01 0:18:37 0:07:24 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
pass 6540654 2021-12-02 20:34:27 2021-12-03 03:39:20 2021-12-03 04:16:38 0:37:18 0:25:00 0:12:18 smithi master centos 8.3 rados/singleton/{all/random-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 2
pass 6540655 2021-12-02 20:34:28 2021-12-03 03:39:40 2021-12-03 04:37:08 0:57:28 0:50:32 0:06:56 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6540656 2021-12-02 20:34:29 2021-12-03 03:40:00 2021-12-03 04:12:08 0:32:08 0:21:55 0:10:13 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540657 2021-12-02 20:34:30 2021-12-03 03:40:11 2021-12-03 04:05:40 0:25:29 0:15:17 0:10:12 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/failover} 2
pass 6540658 2021-12-02 20:34:31 2021-12-03 03:40:21 2021-12-03 04:07:34 0:27:13 0:13:47 0:13:26 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6540659 2021-12-02 20:34:32 2021-12-03 03:40:21 2021-12-03 04:16:50 0:36:29 0:24:56 0:11:33 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6540660 2021-12-02 20:34:33 2021-12-03 03:40:52 2021-12-03 03:54:43 0:13:51 0:07:05 0:06:46 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6540661 2021-12-02 20:34:34 2021-12-03 03:40:52 2021-12-03 04:06:31 0:25:39 0:17:49 0:07:50 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 6540662 2021-12-02 20:34:35 2021-12-03 03:41:03 2021-12-03 04:06:50 0:25:47 0:14:01 0:11:46 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6540663 2021-12-02 20:34:36 2021-12-03 03:43:13 2021-12-03 04:14:06 0:30:53 0:25:29 0:05:24 smithi master rhel 8.4 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 6540664 2021-12-02 20:34:37 2021-12-03 03:43:14 2021-12-03 04:02:31 0:19:17 0:06:15 0:13:02 smithi master ubuntu 20.04 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
pass 6540665 2021-12-02 20:34:38 2021-12-03 03:46:34 2021-12-03 04:14:10 0:27:36 0:16:54 0:10:42 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6540666 2021-12-02 20:34:39 2021-12-03 03:46:55 2021-12-03 04:14:42 0:27:47 0:16:39 0:11:08 smithi master centos 8.3 rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 6540667 2021-12-02 20:34:40 2021-12-03 03:47:15 2021-12-03 04:05:00 0:17:45 0:11:09 0:06:36 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi132 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540668 2021-12-02 20:34:41 2021-12-03 03:47:46 2021-12-03 04:09:59 0:22:13 0:10:18 0:11:55 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6540669 2021-12-02 20:34:42 2021-12-03 03:47:46 2021-12-03 04:03:34 0:15:48 0:09:27 0:06:21 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6540670 2021-12-02 20:34:43 2021-12-03 03:47:56 2021-12-03 04:35:33 0:47:37 0:41:33 0:06:04 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} 2
pass 6540671 2021-12-02 20:34:44 2021-12-03 03:48:07 2021-12-03 04:04:00 0:15:53 0:05:59 0:09:54 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540672 2021-12-02 20:34:45 2021-12-03 03:48:07 2021-12-03 04:18:49 0:30:42 0:19:13 0:11:29 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} 1
pass 6540673 2021-12-02 20:34:46 2021-12-03 03:49:07 2021-12-03 04:30:56 0:41:49 0:34:09 0:07:40 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} 2
fail 6540674 2021-12-02 20:34:48 2021-12-03 03:49:28 2021-12-03 04:10:11 0:20:43 0:08:50 0:11:53 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi080 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6540675 2021-12-02 20:34:49 2021-12-03 03:50:48 2021-12-03 05:09:04 1:18:16 1:08:12 0:10:04 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
pass 6540676 2021-12-02 20:34:50 2021-12-03 03:51:49 2021-12-03 04:41:26 0:49:37 0:43:08 0:06:29 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6540677 2021-12-02 20:34:51 2021-12-03 03:51:59 2021-12-03 04:23:38 0:31:39 0:24:26 0:07:13 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540678 2021-12-02 20:34:52 2021-12-03 03:52:10 2021-12-03 04:52:05 0:59:55 0:49:27 0:10:28 smithi master centos 8.3 rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 6540679 2021-12-02 20:34:53 2021-12-03 03:52:20 2021-12-03 04:18:02 0:25:42 0:15:45 0:09:57 smithi master rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} 1
pass 6540680 2021-12-02 20:34:54 2021-12-03 03:52:20 2021-12-03 04:07:57 0:15:37 0:09:22 0:06:15 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6540681 2021-12-02 20:34:55 2021-12-03 03:53:01 2021-12-03 04:39:39 0:46:38 0:34:27 0:12:11 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6540682 2021-12-02 20:34:56 2021-12-03 03:53:11 2021-12-03 04:10:47 0:17:36 0:10:25 0:07:11 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540683 2021-12-02 20:34:57 2021-12-03 03:53:22 2021-12-03 04:40:48 0:47:26 0:40:37 0:06:49 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6540684 2021-12-02 20:34:58 2021-12-03 03:53:22 2021-12-03 04:23:38 0:30:16 0:22:02 0:08:14 smithi master rhel 8.4 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6540685 2021-12-02 20:34:59 2021-12-03 03:53:22 2021-12-03 04:09:27 0:16:05 0:09:28 0:06:37 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6540686 2021-12-02 20:35:00 2021-12-03 03:54:13 2021-12-03 04:13:38 0:19:25 0:13:07 0:06:18 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/rados_stress_watch} 2
pass 6540687 2021-12-02 20:35:01 2021-12-03 03:54:23 2021-12-03 04:28:26 0:34:03 0:26:21 0:07:42 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6540688 2021-12-02 20:35:02 2021-12-03 03:55:23 2021-12-03 04:17:05 0:21:42 0:10:21 0:11:21 smithi master centos 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 2
pass 6540689 2021-12-02 20:35:03 2021-12-03 03:55:54 2021-12-03 04:41:46 0:45:52 0:35:10 0:10:42 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6540690 2021-12-02 20:35:04 2021-12-03 03:56:14 2021-12-03 04:43:23 0:47:09 0:41:09 0:06:00 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
fail 6540691 2021-12-02 20:35:05 2021-12-03 03:56:15 2021-12-03 04:19:22 0:23:07 0:15:17 0:07:50 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi008 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540692 2021-12-02 20:35:06 2021-12-03 03:57:35 2021-12-03 04:40:08 0:42:33 0:31:38 0:10:55 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6540693 2021-12-02 20:35:07 2021-12-03 03:58:26 2021-12-03 04:33:53 0:35:27 0:23:40 0:11:47 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6540694 2021-12-02 20:35:08 2021-12-03 03:59:46 2021-12-03 04:17:12 0:17:26 0:06:36 0:10:50 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540695 2021-12-02 20:35:09 2021-12-03 03:59:47 2021-12-03 04:57:38 0:57:51 0:50:00 0:07:51 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6540696 2021-12-02 20:35:10 2021-12-03 03:59:57 2021-12-03 04:16:56 0:16:59 0:08:03 0:08:56 smithi master centos 8.stream rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
pass 6540697 2021-12-02 20:35:11 2021-12-03 04:01:38 2021-12-03 04:21:48 0:20:10 0:10:18 0:09:52 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6540698 2021-12-02 20:35:12 2021-12-03 04:01:38 2021-12-03 04:34:49 0:33:11 0:25:54 0:07:17 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540699 2021-12-02 20:35:13 2021-12-03 04:01:38 2021-12-03 04:29:32 0:27:54 0:20:03 0:07:51 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 6540700 2021-12-02 20:35:14 2021-12-03 04:01:49 2021-12-03 04:17:50 0:16:01 0:04:43 0:11:18 smithi master rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} 1
pass 6540701 2021-12-02 20:35:15 2021-12-03 04:02:09 2021-12-03 04:15:24 0:13:15 0:06:43 0:06:32 smithi master centos 8.stream rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8.stream}} 1
pass 6540702 2021-12-02 20:35:16 2021-12-03 04:02:09 2021-12-03 04:17:51 0:15:42 0:08:35 0:07:07 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6540703 2021-12-02 20:35:18 2021-12-03 04:02:40 2021-12-03 04:40:09 0:37:29 0:25:05 0:12:24 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 6540704 2021-12-02 20:35:18 2021-12-03 04:03:40 2021-12-03 04:17:12 0:13:32 0:06:35 0:06:57 smithi master centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_with_skews} 2
pass 6540705 2021-12-02 20:35:19 2021-12-03 04:04:01 2021-12-03 04:21:42 0:17:41 0:10:44 0:06:57 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540706 2021-12-02 20:35:21 2021-12-03 04:04:31 2021-12-03 04:23:42 0:19:11 0:09:53 0:09:18 smithi master centos 8.3 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6540707 2021-12-02 20:35:22 2021-12-03 04:04:31 2021-12-03 04:31:47 0:27:16 0:20:20 0:06:56 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6540708 2021-12-02 20:35:23 2021-12-03 04:04:32 2021-12-03 04:43:30 0:38:58 0:32:34 0:06:24 smithi master rhel 8.4 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6540709 2021-12-02 20:35:24 2021-12-03 04:04:32 2021-12-03 04:34:07 0:29:35 0:22:24 0:07:11 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6540710 2021-12-02 20:35:25 2021-12-03 04:05:02 2021-12-03 04:40:31 0:35:29 0:24:33 0:10:56 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6540711 2021-12-02 20:35:26 2021-12-03 04:05:03 2021-12-03 04:35:07 0:30:04 0:18:55 0:11:09 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 6540712 2021-12-02 20:35:27 2021-12-03 04:05:23 2021-12-03 04:49:55 0:44:32 0:34:11 0:10:21 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 6540713 2021-12-02 20:35:28 2021-12-03 04:05:44 2021-12-03 04:31:30 0:25:46 0:19:27 0:06:19 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 6540714 2021-12-02 20:35:29 2021-12-03 04:06:14 2021-12-03 04:30:46 0:24:32 0:12:19 0:12:13 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6540715 2021-12-02 20:35:30 2021-12-03 04:06:34 2021-12-03 04:49:41 0:43:07 0:32:21 0:10:46 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/module_selftest} 2
pass 6540716 2021-12-02 20:35:31 2021-12-03 04:27:15 593 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540717 2021-12-02 20:35:32 2021-12-03 04:07:05 2021-12-03 04:26:47 0:19:42 0:12:39 0:07:03 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 6540718 2021-12-02 20:35:33 2021-12-03 04:07:36 2021-12-03 04:45:23 0:37:47 0:30:09 0:07:38 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
fail 6540719 2021-12-02 20:35:34 2021-12-03 04:07:36 2021-12-03 04:27:03 0:19:27 0:11:26 0:08:01 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi005 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540720 2021-12-02 20:35:35 2021-12-03 04:08:06 2021-12-03 04:29:18 0:21:12 0:11:10 0:10:02 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6540721 2021-12-02 20:35:36 2021-12-03 04:08:07 2021-12-03 05:46:59 1:38:52 1:27:42 0:11:10 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 6540722 2021-12-02 20:35:37 2021-12-03 04:08:57 2021-12-03 05:50:27 1:41:30 1:35:08 0:06:22 smithi master rhel 8.4 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 2
pass 6540723 2021-12-02 20:35:38 2021-12-03 04:08:57 2021-12-03 05:00:57 0:52:00 0:40:49 0:11:11 smithi master ubuntu 20.04 rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6540724 2021-12-02 20:35:39 2021-12-03 04:08:58 2021-12-03 04:29:56 0:20:58 0:09:40 0:11:18 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6540725 2021-12-02 20:35:40 2021-12-03 04:09:58 2021-12-03 04:33:39 0:23:41 0:17:06 0:06:35 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6540726 2021-12-02 20:35:41 2021-12-03 04:10:09 2021-12-03 04:49:22 0:39:13 0:31:49 0:07:24 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6540727 2021-12-02 20:35:42 2021-12-03 04:10:19 2021-12-03 04:31:53 0:21:34 0:10:36 0:10:58 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6540728 2021-12-02 20:35:43 2021-12-03 04:10:20 2021-12-03 04:38:05 0:27:45 0:19:47 0:07:58 smithi master rhel 8.4 rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540729 2021-12-02 20:35:44 2021-12-03 04:10:50 2021-12-03 04:39:59 0:29:09 0:17:10 0:11:59 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6540730 2021-12-02 20:35:45 2021-12-03 04:11:30 2021-12-03 04:47:30 0:36:00 0:28:43 0:07:17 smithi master centos 8.stream rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 2
fail 6540731 2021-12-02 20:35:47 2021-12-03 04:12:11 2021-12-03 04:33:34 0:21:23 0:14:03 0:07:20 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi036 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=85641afe0bfa4aa7ddced29e005c6fbe998b85c0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

fail 6540732 2021-12-02 20:35:47 2021-12-03 04:12:31 2021-12-03 04:29:03 0:16:32 0:05:58 0:10:34 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

[Errno 2] Cannot find file on the remote 'ubuntu@smithi060.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml'

pass 6540733 2021-12-02 20:35:49 2021-12-03 04:12:52 2021-12-03 04:32:03 0:19:11 0:10:02 0:09:09 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6540734 2021-12-02 20:35:50 2021-12-03 04:12:52 2021-12-03 05:52:20 1:39:28 1:32:49 0:06:39 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
fail 6540735 2021-12-02 20:35:51 2021-12-03 04:12:52 2021-12-03 04:33:24 0:20:32 0:08:27 0:12:05 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi035 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6540736 2021-12-02 20:35:52 2021-12-03 04:14:13 2021-12-03 04:52:00 0:37:47 0:28:24 0:09:23 smithi master rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} 1
pass 6540737 2021-12-02 20:35:52 2021-12-03 04:14:13 2021-12-03 04:52:23 0:38:10 0:30:35 0:07:35 smithi master centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6540738 2021-12-02 20:35:54 2021-12-03 04:14:44 2021-12-03 04:46:31 0:31:47 0:19:00 0:12:47 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
fail 6540739 2021-12-02 20:35:55 2021-12-03 04:16:24 2021-12-03 04:35:41 0:19:17 0:11:24 0:07:53 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi053 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540740 2021-12-02 20:35:56 2021-12-03 05:32:18 1949 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540741 2021-12-02 20:35:57 2021-12-03 04:52:45 2021-12-03 07:54:39 3:01:54 2:54:59 0:06:55 smithi master rhel 8.4 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 6540742 2021-12-02 20:35:58 2021-12-03 04:52:45 2021-12-03 05:16:39 0:23:54 0:14:34 0:09:20 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 6540743 2021-12-02 20:35:59 2021-12-03 04:53:36 2021-12-03 05:23:38 0:30:02 0:18:52 0:11:10 smithi master ubuntu 20.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 6540744 2021-12-02 20:36:00 2021-12-03 04:53:56 2021-12-03 05:23:38 0:29:42 0:21:52 0:07:50 smithi master rhel 8.4 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6540745 2021-12-02 20:36:01 2021-12-03 04:54:26 2021-12-03 05:20:42 0:26:16 0:16:08 0:10:08 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6540746 2021-12-02 20:36:02 2021-12-03 04:55:27 2021-12-03 05:23:19 0:27:52 0:18:20 0:09:32 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6540747 2021-12-02 20:36:03 2021-12-03 04:55:37 2021-12-03 05:11:26 0:15:49 0:09:02 0:06:47 smithi master centos 8.stream rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
pass 6540748 2021-12-02 20:36:04 2021-12-03 04:55:58 2021-12-03 05:22:16 0:26:18 0:12:33 0:13:45 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6540749 2021-12-02 20:36:05 2021-12-03 04:57:08 2021-12-03 05:27:28 0:30:20 0:17:17 0:13:03 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 6540750 2021-12-02 20:36:06 2021-12-03 04:57:49 2021-12-03 06:03:15 1:05:26 0:56:25 0:09:01 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6540751 2021-12-02 20:36:07 2021-12-03 04:58:19 2021-12-03 05:37:55 0:39:36 0:33:38 0:05:58 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
pass 6540752 2021-12-02 20:36:08 2021-12-03 04:58:29 2021-12-03 05:28:37 0:30:08 0:19:43 0:10:25 smithi master ubuntu 20.04 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 6540753 2021-12-02 20:36:09 2021-12-03 04:58:40 2021-12-03 05:40:48 0:42:08 0:32:27 0:09:41 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6540754 2021-12-02 20:36:10 2021-12-03 04:58:40 2021-12-03 05:29:52 0:31:12 0:24:19 0:06:53 smithi master rhel 8.4 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6540755 2021-12-02 20:36:11 2021-12-03 04:58:40 2021-12-03 05:24:36 0:25:56 0:18:38 0:07:18 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6540756 2021-12-02 20:36:12 2021-12-03 04:59:21 2021-12-03 05:58:43 0:59:22 0:45:57 0:13:25 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 6540757 2021-12-02 20:36:13 2021-12-03 04:59:31 2021-12-03 05:17:12 0:17:41 0:08:28 0:09:13 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6540758 2021-12-02 20:36:14 2021-12-03 04:59:31 2021-12-03 05:35:11 0:35:40 0:27:55 0:07:45 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} 2
pass 6540759 2021-12-02 20:36:15 2021-12-03 04:59:32 2021-12-03 05:25:55 0:26:23 0:14:00 0:12:23 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540760 2021-12-02 20:36:16 2021-12-03 05:00:42 2021-12-03 05:28:18 0:27:36 0:20:39 0:06:57 smithi master rhel 8.4 rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540761 2021-12-02 20:36:17 2021-12-03 05:01:03 2021-12-03 05:44:09 0:43:06 0:37:21 0:05:45 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6540762 2021-12-02 20:36:18 2021-12-03 05:01:03 2021-12-03 05:30:29 0:29:26 0:14:15 0:15:11 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6540763 2021-12-02 20:36:19 2021-12-03 05:01:13 2021-12-03 05:15:10 0:13:57 0:06:46 0:07:11 smithi master centos 8.stream rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream}} 1
pass 6540764 2021-12-02 20:36:20 2021-12-03 05:02:14 2021-12-03 05:28:05 0:25:51 0:18:56 0:06:55 smithi master centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 6540765 2021-12-02 20:36:21 2021-12-03 05:02:54 2021-12-03 05:43:41 0:40:47 0:29:38 0:11:09 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

"2021-12-03T05:19:51.420542+0000 mon.a (mon.0) 17 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 6540766 2021-12-02 20:36:22 2021-12-03 05:03:15 2021-12-03 05:30:56 0:27:41 0:15:38 0:12:03 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6540767 2021-12-02 20:36:23 2021-12-03 05:03:15 2021-12-03 05:37:16 0:34:01 0:27:28 0:06:33 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 6540768 2021-12-02 20:36:24 2021-12-03 05:03:45 2021-12-03 05:42:47 0:39:02 0:27:33 0:11:29 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6540769 2021-12-02 20:36:25 2021-12-03 05:03:46 2021-12-03 05:27:29 0:23:43 0:13:52 0:09:51 smithi master rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} 1
pass 6540770 2021-12-02 20:36:27 2021-12-03 05:03:56 2021-12-03 05:54:35 0:50:39 0:38:01 0:12:38 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6540771 2021-12-02 20:36:28 2021-12-03 05:05:06 2021-12-03 05:48:43 0:43:37 0:32:28 0:11:09 smithi master centos 8.3 rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6540772 2021-12-02 20:36:29 2021-12-03 05:05:17 2021-12-03 05:32:41 0:27:24 0:21:20 0:06:04 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
fail 6540773 2021-12-02 20:36:30 2021-12-03 05:05:27 2021-12-03 05:28:49 0:23:22 0:15:54 0:07:28 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi041 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540774 2021-12-02 20:36:31 2021-12-03 05:05:38 2021-12-03 05:38:51 0:33:13 0:21:47 0:11:26 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6540775 2021-12-02 20:36:32 2021-12-03 05:05:38 2021-12-03 05:27:06 0:21:28 0:10:08 0:11:20 smithi master centos 8.3 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 6540776 2021-12-02 20:36:33 2021-12-03 05:05:48 2021-12-03 05:29:33 0:23:45 0:14:02 0:09:43 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 6540777 2021-12-02 20:36:34 2021-12-03 05:05:49 2021-12-03 05:36:55 0:31:06 0:24:29 0:06:37 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus} 2
Failure Reason:

Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus)

pass 6540778 2021-12-02 20:36:35 2021-12-03 05:05:59 2021-12-03 05:32:05 0:26:06 0:18:27 0:07:39 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6540779 2021-12-02 20:36:36 2021-12-03 05:06:39 2021-12-03 05:34:27 0:27:48 0:17:53 0:09:55 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540780 2021-12-02 20:36:37 2021-12-03 05:07:00 2021-12-03 07:30:21 2:23:21 2:15:59 0:07:22 smithi master centos 8.stream rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8.stream}} 1
pass 6540781 2021-12-02 20:36:38 2021-12-03 05:07:00 2021-12-03 05:22:32 0:15:32 0:09:18 0:06:14 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6540782 2021-12-02 20:36:39 2021-12-03 05:07:20 2021-12-03 05:32:32 0:25:12 0:18:00 0:07:12 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 6540783 2021-12-02 20:36:41 2021-12-03 05:07:21 2021-12-03 05:42:42 0:35:21 0:29:29 0:05:52 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540784 2021-12-02 20:36:42 2021-12-03 05:07:31 2021-12-03 05:38:59 0:31:28 0:20:46 0:10:42 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
dead 6540785 2021-12-02 20:36:43 2021-12-03 05:07:32 2021-12-03 17:18:45 12:11:13 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 6540786 2021-12-02 20:36:44 2021-12-03 05:07:52 2021-12-03 05:40:28 0:32:36 0:21:55 0:10:41 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
fail 6540787 2021-12-02 20:36:45 2021-12-03 05:08:02 2021-12-03 06:27:27 1:19:25 1:08:38 0:10:47 smithi master ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

2.0 not in backfilling

pass 6540788 2021-12-02 20:36:46 2021-12-03 05:08:03 2021-12-03 05:27:24 0:19:21 0:12:14 0:07:07 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6540789 2021-12-02 20:36:47 2021-12-03 05:08:13 2021-12-03 06:02:20 0:54:07 0:47:45 0:06:22 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6540790 2021-12-02 20:36:48 2021-12-03 05:08:53 2021-12-03 05:38:24 0:29:31 0:20:07 0:09:24 smithi master centos 8.3 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6540791 2021-12-02 20:36:49 2021-12-03 05:09:04 2021-12-03 05:24:55 0:15:51 0:07:08 0:08:43 smithi master centos 8.stream rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_no_skews} 3
pass 6540792 2021-12-02 20:36:50 2021-12-03 05:10:44 2021-12-03 05:43:18 0:32:34 0:22:14 0:10:20 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 6540793 2021-12-02 20:36:51 2021-12-03 05:11:15 2021-12-03 05:50:55 0:39:40 0:32:12 0:07:28 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 6540794 2021-12-02 20:36:52 2021-12-03 05:11:15 2021-12-03 05:30:44 0:19:29 0:08:18 0:11:11 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi003 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

fail 6540795 2021-12-02 20:36:53 2021-12-03 05:13:06 2021-12-03 05:31:22 0:18:16 0:11:15 0:07:01 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi104 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540796 2021-12-02 20:36:54 2021-12-03 05:13:56 2021-12-03 05:35:39 0:21:43 0:10:39 0:11:04 smithi master centos 8.3 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6540797 2021-12-02 20:36:55 2021-12-03 05:14:47 2021-12-03 05:50:30 0:35:43 0:25:40 0:10:03 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 6540798 2021-12-02 20:36:56 2021-12-03 05:15:17 2021-12-03 05:39:09 0:23:52 0:13:15 0:10:37 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6540799 2021-12-02 20:36:57 2021-12-03 05:15:58 2021-12-03 05:39:49 0:23:51 0:12:56 0:10:55 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540800 2021-12-02 20:36:58 2021-12-03 05:16:18 2021-12-03 05:32:18 0:16:00 0:08:58 0:07:02 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/sync workloads/rados_5925} 2
pass 6540801 2021-12-02 20:37:00 2021-12-03 05:16:48 2021-12-03 05:43:06 0:26:18 0:15:53 0:10:25 smithi master centos 8.2 rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540802 2021-12-02 20:37:01 2021-12-03 05:17:39 2021-12-03 05:35:53 0:18:14 0:07:12 0:11:02 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540803 2021-12-02 20:37:02 2021-12-03 05:17:39 2021-12-03 05:56:35 0:38:56 0:30:06 0:08:50 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} 2
pass 6540804 2021-12-02 20:37:03 2021-12-03 05:19:10 2021-12-03 05:49:22 0:30:12 0:22:22 0:07:50 smithi master centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6540805 2021-12-02 20:37:04 2021-12-03 05:20:10 2021-12-03 05:38:06 0:17:56 0:07:39 0:10:17 smithi master rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} 1
pass 6540806 2021-12-02 20:37:05 2021-12-03 05:20:11 2021-12-03 05:34:01 0:13:50 0:07:29 0:06:21 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8.stream} tasks/workunits} 2
pass 6540807 2021-12-02 20:37:06 2021-12-03 05:20:51 2021-12-03 05:45:46 0:24:55 0:12:57 0:11:58 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6540808 2021-12-02 20:37:07 2021-12-03 05:22:22 2021-12-03 05:51:53 0:29:31 0:22:32 0:06:59 smithi master rhel 8.4 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6540809 2021-12-02 20:37:08 2021-12-03 05:22:42 2021-12-03 05:50:33 0:27:51 0:20:43 0:07:08 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6540810 2021-12-02 20:37:09 2021-12-03 05:23:22 2021-12-03 06:06:56 0:43:34 0:36:05 0:07:29 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6540811 2021-12-02 20:37:10 2021-12-03 05:23:43 2021-12-03 06:15:27 0:51:44 0:41:26 0:10:18 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540812 2021-12-02 20:37:11 2021-12-03 05:23:43 2021-12-03 06:29:56 1:06:13 0:54:39 0:11:34 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 6540813 2021-12-02 20:37:12 2021-12-03 05:23:43 2021-12-03 05:55:54 0:32:11 0:25:41 0:06:30 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} 2
pass 6540814 2021-12-02 20:37:13 2021-12-03 05:24:44 2021-12-03 06:06:56 0:42:12 0:31:48 0:10:24 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6540815 2021-12-02 20:37:14 2021-12-03 05:24:54 2021-12-03 05:49:01 0:24:07 0:12:34 0:11:33 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6540816 2021-12-02 20:37:15 2021-12-03 05:25:04 2021-12-03 05:49:17 0:24:13 0:13:44 0:10:29 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6540817 2021-12-02 20:37:16 2021-12-03 05:25:05 2021-12-03 06:00:33 0:35:28 0:24:59 0:10:29 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6540818 2021-12-02 20:37:17 2021-12-03 05:25:25 2021-12-03 05:41:36 0:16:11 0:06:18 0:09:53 smithi master ubuntu 20.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 6540819 2021-12-02 20:37:18 2021-12-03 05:25:56 2021-12-03 05:51:08 0:25:12 0:14:58 0:10:14 smithi master centos 8.3 rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540820 2021-12-02 20:37:19 2021-12-03 05:25:56 2021-12-03 05:54:53 0:28:57 0:22:52 0:06:05 smithi master rhel 8.4 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6540821 2021-12-02 20:37:20 2021-12-03 05:25:56 2021-12-03 06:08:26 0:42:30 0:31:49 0:10:41 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6540822 2021-12-02 20:37:21 2021-12-03 05:27:17 2021-12-03 05:52:38 0:25:21 0:18:22 0:06:59 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6540823 2021-12-02 20:37:23 2021-12-03 05:27:27 2021-12-03 06:04:39 0:37:12 0:30:26 0:06:46 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6540824 2021-12-02 20:37:24 2021-12-03 05:27:27 2021-12-03 06:05:48 0:38:21 0:26:51 0:11:30 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540825 2021-12-02 20:37:25 2021-12-03 05:27:38 2021-12-03 05:51:20 0:23:42 0:13:09 0:10:33 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} 2
pass 6540826 2021-12-02 20:37:26 2021-12-03 05:28:08 2021-12-03 05:43:19 0:15:11 0:09:10 0:06:01 smithi master centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
fail 6540827 2021-12-02 20:37:27 2021-12-03 05:28:08 2021-12-03 05:49:40 0:21:32 0:15:16 0:06:16 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi081 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540828 2021-12-02 20:37:28 2021-12-03 05:28:29 2021-12-03 05:57:50 0:29:21 0:22:31 0:06:50 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6540829 2021-12-02 20:37:29 2021-12-03 05:28:39 2021-12-03 05:54:41 0:26:02 0:15:12 0:10:50 smithi master rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} 1
pass 6540830 2021-12-02 20:37:30 2021-12-03 05:28:59 2021-12-03 05:51:48 0:22:49 0:14:13 0:08:36 smithi master centos 8.3 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 6540831 2021-12-02 20:37:31 2021-12-03 05:29:00 2021-12-03 05:56:43 0:27:43 0:14:24 0:13:19 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6540832 2021-12-02 20:37:32 2021-12-03 05:29:40 2021-12-03 05:50:01 0:20:21 0:09:12 0:11:09 smithi master centos 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 2
pass 6540833 2021-12-02 20:37:33 2021-12-03 05:30:31 2021-12-03 05:46:11 0:15:40 0:09:29 0:06:11 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6540834 2021-12-02 20:37:34 2021-12-03 05:30:51 2021-12-03 06:04:03 0:33:12 0:26:25 0:06:47 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6540835 2021-12-02 20:37:35 2021-12-03 05:30:51 2021-12-03 06:50:42 1:19:51 1:11:37 0:08:14 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} 2
pass 6540836 2021-12-02 20:37:36 2021-12-03 05:31:22 2021-12-03 05:48:50 0:17:28 0:09:42 0:07:46 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8.stream} tasks/crash} 2
pass 6540837 2021-12-02 20:37:37 2021-12-03 05:31:32 2021-12-03 06:12:52 0:41:20 0:30:12 0:11:08 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.0} 1
pass 6540838 2021-12-02 20:37:38 2021-12-03 06:05:25 1465 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6540839 2021-12-02 20:37:39 2021-12-03 05:32:13 2021-12-03 07:10:15 1:38:02 1:31:33 0:06:29 smithi master rhel 8.4 rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6540840 2021-12-02 20:37:40 2021-12-03 05:32:23 2021-12-03 05:49:49 0:17:26 0:10:18 0:07:08 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540841 2021-12-02 20:37:41 2021-12-03 05:32:24 2021-12-03 08:29:57 2:57:33 2:48:17 0:09:16 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
pass 6540842 2021-12-02 20:37:42 2021-12-03 05:32:34 2021-12-03 05:54:06 0:21:32 0:10:15 0:11:17 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540843 2021-12-02 20:37:43 2021-12-03 05:34:05 2021-12-03 06:22:07 0:48:02 0:37:26 0:10:36 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6540844 2021-12-02 20:37:44 2021-12-03 05:34:35 2021-12-03 06:11:21 0:36:46 0:25:25 0:11:21 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
pass 6540845 2021-12-02 20:37:45 2021-12-03 05:35:15 2021-12-03 06:50:46 1:15:31 1:08:39 0:06:52 smithi master rhel 8.4 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6540846 2021-12-02 20:37:46 2021-12-03 05:35:16 2021-12-03 06:43:23 1:08:07 1:00:39 0:07:28 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 6540847 2021-12-02 20:37:47 2021-12-03 05:35:56 2021-12-03 05:56:23 0:20:27 0:09:50 0:10:37 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 6540848 2021-12-02 20:37:48 2021-12-03 05:36:27 2021-12-03 06:00:16 0:23:49 0:15:30 0:08:19 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi031 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540849 2021-12-02 20:37:49 2021-12-03 05:36:57 2021-12-03 06:30:29 0:53:32 0:46:00 0:07:32 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 6540850 2021-12-02 20:37:51 2021-12-03 05:37:18 2021-12-03 06:01:03 0:23:45 0:16:55 0:06:50 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 6540851 2021-12-02 20:37:52 2021-12-03 05:37:48 2021-12-03 06:05:07 0:27:19 0:21:22 0:05:57 smithi master rhel 8.4 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6540852 2021-12-02 20:37:53 2021-12-03 05:37:58 2021-12-03 06:15:23 0:37:25 0:30:14 0:07:11 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6540853 2021-12-02 20:37:54 2021-12-03 05:38:09 2021-12-03 06:10:16 0:32:07 0:25:13 0:06:54 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6540854 2021-12-02 20:37:55 2021-12-03 05:38:59 2021-12-03 06:12:25 0:33:26 0:26:37 0:06:49 smithi master rhel 8.4 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 6540855 2021-12-02 20:37:56 2021-12-03 05:38:59 2021-12-03 06:52:25 1:13:26 1:07:14 0:06:12 smithi master centos 8.stream rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
fail 6540856 2021-12-02 20:37:57 2021-12-03 05:39:10 2021-12-03 06:01:14 0:22:04 0:10:23 0:11:41 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi141 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6540857 2021-12-02 20:37:58 2021-12-03 05:39:50 2021-12-03 06:03:03 0:23:13 0:13:37 0:09:36 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6540858 2021-12-02 20:38:00 2021-12-03 05:39:51 2021-12-03 06:05:57 0:26:06 0:16:04 0:10:02 smithi master centos 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 6540859 2021-12-02 20:38:01 2021-12-03 05:40:31 2021-12-03 06:18:19 0:37:48 0:31:15 0:06:33 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6540860 2021-12-02 20:38:02 2021-12-03 05:40:51 2021-12-03 06:04:38 0:23:47 0:12:51 0:10:56 smithi master centos 8.2 rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 6540861 2021-12-02 20:38:03 2021-12-03 05:41:42 2021-12-03 06:26:08 0:44:26 0:37:30 0:06:56 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6540862 2021-12-02 20:38:04 2021-12-03 05:42:53 2021-12-03 06:26:27 0:43:34 0:31:41 0:11:53 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6540863 2021-12-02 20:38:05 2021-12-03 05:43:13 2021-12-03 06:04:59 0:21:46 0:11:39 0:10:07 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540864 2021-12-02 20:38:06 2021-12-03 05:43:13 2021-12-03 07:02:39 1:19:26 1:06:26 0:13:00 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
pass 6540865 2021-12-02 20:38:07 2021-12-03 05:43:24 2021-12-03 05:59:24 0:16:00 0:04:39 0:11:21 smithi master rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 6540866 2021-12-02 20:38:08 2021-12-03 05:43:24 2021-12-03 06:04:35 0:21:11 0:09:08 0:12:03 smithi master centos 8.3 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6540867 2021-12-02 20:38:09 2021-12-03 05:43:24 2021-12-03 05:59:02 0:15:38 0:08:52 0:06:46 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6540868 2021-12-02 20:38:10 2021-12-03 05:43:45 2021-12-03 06:27:25 0:43:40 0:28:34 0:15:06 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540869 2021-12-02 20:38:11 2021-12-03 05:44:15 2021-12-03 06:05:29 0:21:14 0:12:05 0:09:09 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6540870 2021-12-02 20:38:12 2021-12-03 05:45:56 2021-12-03 07:17:16 1:31:20 1:25:25 0:05:55 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 6540871 2021-12-02 20:38:13 2021-12-03 05:45:56 2021-12-03 06:03:46 0:17:50 0:10:00 0:07:50 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540872 2021-12-02 20:38:14 2021-12-03 05:46:17 2021-12-03 06:14:14 0:27:57 0:14:48 0:13:09 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6540873 2021-12-02 20:38:15 2021-12-03 05:48:48 2021-12-03 06:06:44 0:17:56 0:07:14 0:10:42 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540874 2021-12-02 20:38:16 2021-12-03 05:48:48 2021-12-03 06:13:23 0:24:35 0:13:00 0:11:35 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6540875 2021-12-02 20:38:17 2021-12-03 05:48:58 2021-12-03 06:06:19 0:17:21 0:10:34 0:06:47 smithi master centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 2
pass 6540876 2021-12-02 20:38:18 2021-12-03 05:49:09 2021-12-03 06:41:31 0:52:22 0:44:18 0:08:04 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6540877 2021-12-02 20:38:19 2021-12-03 05:49:19 2021-12-03 07:01:19 1:12:00 1:01:02 0:10:58 smithi master ubuntu 20.04 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540878 2021-12-02 20:38:20 2021-12-03 05:49:30 2021-12-03 06:22:54 0:33:24 0:23:40 0:09:44 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6540879 2021-12-02 20:38:22 2021-12-03 05:49:50 2021-12-03 06:17:05 0:27:15 0:20:17 0:06:58 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 6540880 2021-12-02 20:38:23 2021-12-03 05:49:50 2021-12-03 06:15:35 0:25:45 0:15:17 0:10:28 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} 2
fail 6540881 2021-12-02 20:38:24 2021-12-03 05:50:11 2021-12-03 06:09:58 0:19:47 0:11:40 0:08:07 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi068 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540882 2021-12-02 20:38:25 2021-12-03 05:50:31 2021-12-03 06:14:09 0:23:38 0:13:14 0:10:24 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540883 2021-12-02 20:38:26 2021-12-03 05:50:41 2021-12-03 06:14:26 0:23:45 0:12:42 0:11:03 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 6540884 2021-12-02 20:38:27 2021-12-03 05:51:02 2021-12-03 06:08:27 0:17:25 0:10:26 0:06:59 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 6540885 2021-12-02 20:38:28 2021-12-03 05:51:12 2021-12-03 06:58:38 1:07:26 0:57:18 0:10:08 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 6540886 2021-12-02 20:38:29 2021-12-03 05:51:23 2021-12-03 06:10:34 0:19:11 0:09:03 0:10:08 smithi master centos 8.3 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6540887 2021-12-02 20:38:30 2021-12-03 05:51:23 2021-12-03 07:04:57 1:13:34 1:06:04 0:07:30 smithi master centos 8.stream rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream}} 1
pass 6540888 2021-12-02 20:38:31 2021-12-03 05:51:53 2021-12-03 06:17:49 0:25:56 0:18:32 0:07:24 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6540889 2021-12-02 20:38:32 2021-12-03 05:52:24 2021-12-03 06:19:55 0:27:31 0:20:21 0:07:10 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6540890 2021-12-02 20:38:33 2021-12-03 05:52:44 2021-12-03 06:19:41 0:26:57 0:19:44 0:07:13 smithi master rhel 8.4 rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540891 2021-12-02 20:38:34 2021-12-03 05:54:15 2021-12-03 06:17:39 0:23:24 0:16:53 0:06:31 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 6540892 2021-12-02 20:38:35 2021-12-03 05:54:15 2021-12-03 06:14:59 0:20:44 0:10:03 0:10:41 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6540893 2021-12-02 20:38:36 2021-12-03 05:54:45 2021-12-03 06:28:28 0:33:43 0:24:01 0:09:42 smithi master rados/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} 1
pass 6540894 2021-12-02 20:38:37 2021-12-03 05:54:46 2021-12-03 06:13:07 0:18:21 0:10:18 0:08:03 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 6540895 2021-12-02 20:38:38 2021-12-03 05:55:56 2021-12-03 06:30:53 0:34:57 0:25:48 0:09:09 smithi master centos 8.3 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} 1
pass 6540896 2021-12-02 20:38:39 2021-12-03 05:55:56 2021-12-03 06:15:53 0:19:57 0:10:05 0:09:52 smithi master centos 8.3 rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6540897 2021-12-02 20:38:40 2021-12-03 05:56:27 2021-12-03 06:15:40 0:19:13 0:09:18 0:09:55 smithi master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6540898 2021-12-02 20:38:41 2021-12-03 05:56:37 2021-12-03 06:50:31 0:53:54 0:42:53 0:11:01 smithi master ubuntu 20.04 rados/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6540899 2021-12-02 20:38:42 2021-12-03 05:56:47 2021-12-03 06:30:14 0:33:27 0:26:44 0:06:43 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6540900 2021-12-02 20:38:43 2021-12-03 05:56:48 2021-12-03 06:44:46 0:47:58 0:36:38 0:11:20 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6540901 2021-12-02 20:38:44 2021-12-03 05:57:18 2021-12-03 06:23:28 0:26:10 0:19:08 0:07:02 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 6540902 2021-12-02 20:38:46 2021-12-03 05:57:59 2021-12-03 06:17:59 0:20:00 0:12:15 0:07:45 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 6540903 2021-12-02 20:38:47 2021-12-03 05:58:49 2021-12-03 06:20:46 0:21:57 0:12:30 0:09:27 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
fail 6540904 2021-12-02 20:38:48 2021-12-03 05:59:10 2021-12-03 06:23:00 0:23:50 0:15:29 0:08:21 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi152 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540905 2021-12-02 20:38:49 2021-12-03 05:59:30 2021-12-03 06:41:55 0:42:25 0:30:45 0:11:40 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6540906 2021-12-02 20:38:50 2021-12-03 06:00:20 2021-12-03 06:18:37 0:18:17 0:06:32 0:11:45 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540907 2021-12-02 20:38:51 2021-12-03 06:00:41 2021-12-03 10:32:37 4:31:56 4:22:39 0:09:17 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} 1
pass 6540908 2021-12-02 20:38:52 2021-12-03 06:00:41 2021-12-03 06:36:24 0:35:43 0:26:29 0:09:14 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6540909 2021-12-02 20:38:53 2021-12-03 06:01:12 2021-12-03 06:22:53 0:21:41 0:11:00 0:10:41 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6540910 2021-12-02 20:38:54 2021-12-03 06:01:12 2021-12-03 06:28:53 0:27:41 0:20:16 0:07:25 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540911 2021-12-02 20:38:55 2021-12-03 06:01:22 2021-12-03 06:25:49 0:24:27 0:17:33 0:06:54 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6540912 2021-12-02 20:38:56 2021-12-03 06:02:23 2021-12-03 06:28:15 0:25:52 0:19:20 0:06:32 smithi master rhel 8.4 rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 6540913 2021-12-02 20:38:57 2021-12-03 06:03:03 2021-12-03 06:24:49 0:21:46 0:15:12 0:06:34 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
pass 6540914 2021-12-02 20:38:58 2021-12-03 06:03:24 2021-12-03 06:37:34 0:34:10 0:26:46 0:07:24 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
fail 6540915 2021-12-02 20:38:59 2021-12-03 06:23:31 504 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi086 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6540916 2021-12-02 20:39:00 2021-12-03 06:04:04 2021-12-03 06:31:23 0:27:19 0:19:59 0:07:20 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6540917 2021-12-02 20:39:01 2021-12-03 06:04:25 2021-12-03 06:22:31 0:18:06 0:06:37 0:11:29 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6540918 2021-12-02 20:39:02 2021-12-03 06:04:45 2021-12-03 06:34:18 0:29:33 0:22:22 0:07:11 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6540919 2021-12-02 20:39:03 2021-12-03 06:05:06 2021-12-03 06:36:40 0:31:34 0:24:00 0:07:34 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6540920 2021-12-02 20:39:04 2021-12-03 06:05:16 2021-12-03 06:18:21 0:13:05 0:06:33 0:06:32 smithi master centos 8.stream rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6540921 2021-12-02 20:39:05 2021-12-03 06:05:26 2021-12-03 06:51:05 0:45:39 0:35:47 0:09:52 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6540922 2021-12-02 20:39:06 2021-12-03 06:05:37 2021-12-03 06:28:53 0:23:16 0:10:32 0:12:44 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540923 2021-12-02 20:39:07 2021-12-03 06:06:27 2021-12-03 06:44:07 0:37:40 0:29:37 0:08:03 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
pass 6540924 2021-12-02 20:39:08 2021-12-03 06:06:28 2021-12-03 06:32:26 0:25:58 0:18:55 0:07:03 smithi master centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6540925 2021-12-02 20:39:09 2021-12-03 06:06:58 2021-12-03 06:40:14 0:33:16 0:22:59 0:10:17 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
fail 6540926 2021-12-02 20:39:10 2021-12-03 06:06:58 2021-12-03 12:52:09 6:45:11 6:33:50 0:11:21 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi089 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=85641afe0bfa4aa7ddced29e005c6fbe998b85c0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6540927 2021-12-02 20:39:12 2021-12-03 06:08:29 2021-12-03 06:55:57 0:47:28 0:41:23 0:06:05 smithi master rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} 2
pass 6540928 2021-12-02 20:39:13 2021-12-03 06:08:29 2021-12-03 06:33:54 0:25:25 0:13:43 0:11:42 smithi master rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} 1
pass 6540929 2021-12-02 20:39:14 2021-12-03 06:10:00 2021-12-03 06:59:31 0:49:31 0:42:13 0:07:18 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/module_selftest} 2
pass 6540930 2021-12-02 20:39:15 2021-12-03 06:10:20 2021-12-03 06:37:46 0:27:26 0:21:05 0:06:21 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6540931 2021-12-02 20:39:16 2021-12-03 06:10:20 2021-12-03 06:32:07 0:21:47 0:10:47 0:11:00 smithi master centos 8.3 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 6540932 2021-12-02 20:39:17 2021-12-03 06:10:41 2021-12-03 06:26:06 0:15:25 0:07:58 0:07:27 smithi master centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
fail 6540933 2021-12-02 20:39:18 2021-12-03 06:10:41 2021-12-03 06:31:02 0:20:21 0:11:34 0:08:47 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi027 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540934 2021-12-02 20:39:19 2021-12-03 06:11:32 2021-12-03 06:32:56 0:21:24 0:09:15 0:12:09 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6540935 2021-12-02 20:39:20 2021-12-03 06:12:32 2021-12-03 08:47:57 2:35:25 2:16:02 0:19:23 smithi master centos 8.stream rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{centos_8.stream}} 1
pass 6540936 2021-12-02 20:39:21 2021-12-03 06:12:32 2021-12-03 07:08:55 0:56:23 0:48:05 0:08:18 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6540937 2021-12-02 20:39:22 2021-12-03 06:13:13 2021-12-03 06:47:38 0:34:25 0:22:42 0:11:43 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 6540938 2021-12-02 20:39:23 2021-12-03 06:14:13 2021-12-03 06:39:40 0:25:27 0:14:35 0:10:52 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6540939 2021-12-02 20:39:24 2021-12-03 06:14:14 2021-12-03 06:44:22 0:30:08 0:18:31 0:11:37 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 6540940 2021-12-02 20:39:25 2021-12-03 06:14:24 2021-12-03 06:38:42 0:24:18 0:13:41 0:10:37 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6540941 2021-12-02 20:39:26 2021-12-03 06:14:34 2021-12-03 06:36:01 0:21:27 0:12:35 0:08:52 smithi master centos 8.3 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6540942 2021-12-02 20:39:27 2021-12-03 06:14:35 2021-12-03 07:18:20 1:03:45 0:54:12 0:09:33 smithi master centos 8.3 rados/cephadm/thrash/{0-distro/centos_8.3_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6540943 2021-12-02 20:39:28 2021-12-03 06:15:05 2021-12-03 06:54:38 0:39:33 0:33:07 0:06:26 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
fail 6540944 2021-12-02 20:39:29 2021-12-03 06:15:25 2021-12-03 06:37:02 0:21:37 0:13:48 0:07:49 smithi master centos 8.stream rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=85641afe0bfa4aa7ddced29e005c6fbe998b85c0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

fail 6540945 2021-12-02 20:39:30 2021-12-03 06:15:36 2021-12-03 06:31:32 0:15:56 0:06:09 0:09:47 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

[Errno 2] Cannot find file on the remote 'ubuntu@smithi071.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml'

pass 6540946 2021-12-02 20:39:31 2021-12-03 06:15:46 2021-12-03 06:35:50 0:20:04 0:10:04 0:10:00 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6540947 2021-12-02 20:39:32 2021-12-03 06:15:56 2021-12-03 06:44:29 0:28:33 0:20:18 0:08:15 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 6540948 2021-12-02 20:39:33 2021-12-03 06:17:07 2021-12-03 06:48:59 0:31:52 0:22:25 0:09:27 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} 2
pass 6540949 2021-12-02 20:39:34 2021-12-03 06:17:47 2021-12-03 06:57:34 0:39:47 0:31:32 0:08:15 smithi master centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6540950 2021-12-02 20:39:35 2021-12-03 06:17:58 2021-12-03 07:03:19 0:45:21 0:37:48 0:07:33 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
fail 6540951 2021-12-02 20:39:36 2021-12-03 06:18:08 2021-12-03 06:35:55 0:17:47 0:11:13 0:06:34 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi145 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540952 2021-12-02 20:39:37 2021-12-03 06:18:29 2021-12-03 06:56:42 0:38:13 0:27:39 0:10:34 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6540953 2021-12-02 20:39:39 2021-12-03 06:18:39 2021-12-03 06:41:45 0:23:06 0:11:01 0:12:05 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 6540954 2021-12-02 20:39:40 2021-12-03 06:19:49 2021-12-03 06:45:11 0:25:22 0:15:03 0:10:19 smithi master centos 8.3 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6540955 2021-12-02 20:39:41 2021-12-03 06:20:00 2021-12-03 06:44:01 0:24:01 0:13:38 0:10:23 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6540956 2021-12-02 20:39:42 2021-12-03 06:20:50 2021-12-03 06:37:06 0:16:16 0:08:02 0:08:14 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6540957 2021-12-02 20:39:43 2021-12-03 06:22:11 2021-12-03 09:43:20 3:21:09 3:11:56 0:09:13 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} 1
pass 6540958 2021-12-02 20:39:44 2021-12-03 06:22:11 2021-12-03 06:56:39 0:34:28 0:22:51 0:11:37 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6540959 2021-12-02 20:39:45 2021-12-03 06:22:41 2021-12-03 06:48:02 0:25:21 0:15:52 0:09:29 smithi master centos 8.2 rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 6540960 2021-12-02 20:39:46 2021-12-03 06:23:02 2021-12-03 06:48:28 0:25:26 0:18:13 0:07:13 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8.stream} tasks/progress} 2
pass 6540961 2021-12-02 20:39:47 2021-12-03 06:23:02 2021-12-03 06:42:50 0:19:48 0:09:06 0:10:42 smithi master centos 8.3 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 6540962 2021-12-02 20:39:48 2021-12-03 06:23:32 2021-12-03 06:46:44 0:23:12 0:13:24 0:09:48 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6540963 2021-12-02 20:39:49 2021-12-03 06:23:33 2021-12-03 06:43:14 0:19:41 0:09:44 0:09:57 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6540964 2021-12-02 20:39:50 2021-12-03 06:23:33 2021-12-03 06:48:30 0:24:57 0:18:28 0:06:29 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 6540965 2021-12-02 20:39:51 2021-12-03 06:23:33 2021-12-03 06:52:20 0:28:47 0:21:17 0:07:30 smithi master rhel 8.4 rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6540966 2021-12-02 20:39:52 2021-12-03 06:24:54 2021-12-03 06:57:27 0:32:33 0:24:05 0:08:28 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6540967 2021-12-02 20:39:53 2021-12-03 06:26:15 2021-12-03 06:53:27 0:27:12 0:18:31 0:08:41 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
pass 6540968 2021-12-02 20:39:54 2021-12-03 06:26:15 2021-12-03 06:56:01 0:29:46 0:22:06 0:07:40 smithi master centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6540969 2021-12-02 20:39:55 2021-12-03 06:26:35 2021-12-03 06:44:22 0:17:47 0:09:41 0:08:06 smithi master centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6540970 2021-12-02 20:39:56 2021-12-03 06:27:26 2021-12-03 07:12:42 0:45:16 0:38:42 0:06:34 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6540971 2021-12-02 20:39:57 2021-12-03 06:27:36 2021-12-03 07:01:32 0:33:56 0:26:29 0:07:27 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/sync-many workloads/snaps-few-objects} 2
pass 6540972 2021-12-02 20:39:58 2021-12-03 06:28:17 2021-12-03 06:46:33 0:18:16 0:07:29 0:10:47 smithi master rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} 1
pass 6540973 2021-12-02 20:39:59 2021-12-03 06:28:37 2021-12-03 06:56:37 0:28:00 0:17:20 0:10:40 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6540974 2021-12-02 20:40:00 2021-12-03 06:28:57 2021-12-03 09:26:51 2:57:54 2:25:01 0:32:53 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
pass 6540975 2021-12-02 20:40:01 2021-12-03 06:28:58 2021-12-03 07:02:24 0:33:26 0:26:29 0:06:57 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
fail 6540976 2021-12-02 20:40:02 2021-12-03 06:28:58 2021-12-03 06:49:45 0:20:47 0:08:31 0:12:16 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi022 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6540977 2021-12-02 20:40:03 2021-12-03 06:30:19 2021-12-03 07:23:33 0:53:14 0:46:54 0:06:20 smithi master centos 8.stream rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} 1
pass 6540978 2021-12-02 20:40:05 2021-12-03 06:30:19 2021-12-03 07:00:30 0:30:11 0:22:40 0:07:31 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6540979 2021-12-02 20:40:06 2021-12-03 06:30:59 2021-12-03 07:02:27 0:31:28 0:24:22 0:07:06 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/rados_api_tests} 2
pass 6540980 2021-12-02 20:40:07 2021-12-03 06:31:10 2021-12-03 07:12:41 0:41:31 0:34:54 0:06:37 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6540981 2021-12-02 20:40:08 2021-12-03 06:31:30 2021-12-03 07:14:45 0:43:15 0:36:34 0:06:41 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 6540982 2021-12-02 20:40:09 2021-12-03 06:54:44 883 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6540983 2021-12-02 20:40:10 2021-12-03 06:31:41 2021-12-03 06:56:14 0:24:33 0:13:52 0:10:41 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6540984 2021-12-02 20:40:11 2021-12-03 06:32:31 2021-12-03 06:58:32 0:26:01 0:14:58 0:11:03 smithi master centos 8.3 rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 6540985 2021-12-02 20:40:12 2021-12-03 06:33:02 2021-12-03 07:05:35 0:32:33 0:24:45 0:07:48 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
fail 6540986 2021-12-02 20:40:13 2021-12-03 06:34:22 2021-12-03 06:59:19 0:24:57 0:15:29 0:09:28 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi114 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6540987 2021-12-02 20:40:14 2021-12-03 06:35:53 2021-12-03 07:09:31 0:33:38 0:23:14 0:10:24 smithi master centos 8.3 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6540988 2021-12-02 20:40:15 2021-12-03 06:36:03 2021-12-03 06:53:17 0:17:14 0:10:49 0:06:25 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
dead 6540989 2021-12-02 20:40:16 2021-12-03 06:36:04 2021-12-03 06:47:58 0:11:54 0:05:22 0:06:32 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

{'Failure object was': {'smithi122.front.sepia.ceph.com': {'results': [{'changed': True, 'invocation': {'module_args': {'state': 'present', 'key': 'https://download.ceph.com/keys/release.asc', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'failed': False, 'item': 'https://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://download.ceph.com/keys/release.asc'}, {'changed': True, 'invocation': {'module_args': {'state': 'present', 'key': 'https://download.ceph.com/keys/autobuild.asc', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'failed': False, 'item': 'https://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://download.ceph.com/keys/autobuild.asc'}, {'msg': 'failed to fetch key at https://dist.apache.org/repos/dist/dev/arrow/KEYS , error was: Request failed: <urlopen error [Errno 104] Connection reset by peer>', 'failed': True, 'invocation': {'module_args': {'state': 'present', 'key': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS'}], 'changed': True, 'msg': 'All items completed'}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'https://download.ceph.com/keys/release.asc')"}

fail 6540990 2021-12-02 20:40:17 2021-12-03 06:36:44 2021-12-03 06:57:32 0:20:48 0:09:13 0:11:35 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
Failure Reason:

Test failure: test_standby (tasks.mgr.test_prometheus.TestPrometheus)

pass 6540991 2021-12-02 20:40:19 2021-12-03 06:37:05 2021-12-03 07:05:14 0:28:09 0:20:44 0:07:25 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8.stream}} 2
pass 6540992 2021-12-02 20:40:20 2021-12-03 06:37:35 2021-12-03 07:03:01 0:25:26 0:15:30 0:09:56 smithi master rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} 1
pass 6540993 2021-12-02 20:40:21 2021-12-03 06:37:35 2021-12-03 06:57:37 0:20:02 0:09:50 0:10:12 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6540994 2021-12-02 20:40:22 2021-12-03 06:37:56 2021-12-03 07:08:29 0:30:33 0:22:39 0:07:54 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 6540995 2021-12-02 20:40:23 2021-12-03 06:38:46 2021-12-03 18:50:10 12:11:24 smithi master centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

dead 6540996 2021-12-02 20:40:24 2021-12-03 06:39:47 2021-12-03 06:49:27 0:09:40 0:01:38 0:08:02 smithi master centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

{'Failure object was': {'smithi142.front.sepia.ceph.com': {'results': [{'changed': False, 'invocation': {'module_args': {'state': 'present', 'key': 'https://download.ceph.com/keys/release.asc', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'failed': False, 'item': 'https://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://download.ceph.com/keys/release.asc'}, {'changed': False, 'invocation': {'module_args': {'state': 'present', 'key': 'https://download.ceph.com/keys/autobuild.asc', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'failed': False, 'item': 'https://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://download.ceph.com/keys/autobuild.asc'}, {'msg': 'failed to fetch key at https://dist.apache.org/repos/dist/dev/arrow/KEYS , error was: Request failed: <urlopen error [Errno 104] Connection reset by peer>', 'failed': True, 'invocation': {'module_args': {'state': 'present', 'key': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS', 'validate_certs': False, 'fingerprint': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS', 'ansible_loop_var': 'item', '_ansible_item_label': 'https://dist.apache.org/repos/dist/dev/arrow/KEYS'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'https://download.ceph.com/keys/release.asc')"}

pass 6540997 2021-12-02 20:40:25 2021-12-03 06:40:17 2021-12-03 07:03:43 0:23:26 0:16:16 0:07:10 smithi master centos 8.stream rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream}} 1
pass 6540998 2021-12-02 20:40:26 2021-12-03 06:40:17 2021-12-03 07:14:21 0:34:04 0:21:42 0:12:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6540999 2021-12-02 20:40:27 2021-12-03 06:41:38 2021-12-03 06:56:59 0:15:21 0:08:33 0:06:48 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6541000 2021-12-02 20:40:28 2021-12-03 06:41:48 2021-12-03 06:57:09 0:15:21 0:08:32 0:06:49 smithi master centos 8.stream rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 2
pass 6541001 2021-12-02 20:40:29 2021-12-03 06:41:59 2021-12-03 07:06:08 0:24:09 0:16:14 0:07:55 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6541002 2021-12-02 20:40:30 2021-12-03 06:42:59 2021-12-03 09:57:11 3:14:12 3:02:36 0:11:36 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 6541003 2021-12-02 20:40:31 2021-12-03 06:42:59 2021-12-03 07:00:31 0:17:32 0:11:14 0:06:18 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 6541004 2021-12-02 20:40:32 2021-12-03 06:43:20 2021-12-03 06:59:40 0:16:20 0:08:35 0:07:45 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6541005 2021-12-02 20:40:33 2021-12-03 06:44:10 2021-12-03 06:59:41 0:15:31 0:08:22 0:07:09 smithi master centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 6541006 2021-12-02 20:40:34 2021-12-03 06:44:31 2021-12-03 08:21:59 1:37:28 1:30:36 0:06:52 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

failed to complete snap trimming before timeout

pass 6541007 2021-12-02 20:40:35 2021-12-03 06:44:31 2021-12-03 07:37:45 0:53:14 0:44:18 0:08:56 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} 2
pass 6541008 2021-12-02 20:40:36 2021-12-03 06:44:32 2021-12-03 07:04:34 0:20:02 0:10:15 0:09:47 smithi master centos 8.3 rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6541009 2021-12-02 20:40:37 2021-12-03 06:44:52 2021-12-03 07:40:24 0:55:32 0:48:43 0:06:49 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6541010 2021-12-02 20:40:38 2021-12-03 06:45:12 2021-12-03 07:14:05 0:28:53 0:17:32 0:11:21 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
pass 6541011 2021-12-02 20:40:39 2021-12-03 06:46:53 2021-12-03 07:13:10 0:26:17 0:15:47 0:10:30 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} 2
pass 6541012 2021-12-02 20:40:40 2021-12-03 06:47:43 2021-12-03 07:33:32 0:45:49 0:35:20 0:10:29 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 6541013 2021-12-02 20:40:41 2021-12-03 06:48:04 2021-12-03 07:21:05 0:33:01 0:27:22 0:05:39 smithi master centos 8.stream rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8.stream}} 1
fail 6541014 2021-12-02 20:40:42 2021-12-03 06:48:04 2021-12-03 07:05:31 0:17:27 0:10:57 0:06:30 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi122 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'

pass 6541015 2021-12-02 20:40:44 2021-12-03 06:48:05 2021-12-03 07:30:33 0:42:28 0:31:00 0:11:28 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 6541016 2021-12-02 20:40:45 2021-12-03 06:48:35 2021-12-03 07:02:01 0:13:26 0:06:51 0:06:35 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6541017 2021-12-02 20:40:46 2021-12-03 06:48:35 2021-12-03 07:12:32 0:23:57 0:17:41 0:06:16 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6541018 2021-12-02 20:40:47 2021-12-03 06:49:07 2021-12-03 07:22:51 0:33:44 0:26:49 0:06:55 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6541019 2021-12-02 20:40:48 2021-12-03 06:49:47 2021-12-03 07:07:21 0:17:34 0:07:39 0:09:55 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 6541020 2021-12-02 20:40:49 2021-12-03 06:49:47 2021-12-03 07:05:48 0:16:01 0:08:19 0:07:42 smithi master centos 8.stream rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 2
pass 6541021 2021-12-02 20:40:50 2021-12-03 07:06:44 283 smithi master rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} 1
pass 6541022 2021-12-02 20:40:51 2021-12-03 06:50:48 2021-12-03 07:13:00 0:22:12 0:11:26 0:10:46 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6541023 2021-12-02 20:40:52 2021-12-03 06:50:48 2021-12-03 07:12:38 0:21:50 0:15:13 0:06:37 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 6541024 2021-12-02 20:40:53 2021-12-03 06:51:09 2021-12-03 07:45:43 0:54:34 0:46:27 0:08:07 smithi master rhel 8.4 rados/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6541025 2021-12-02 20:40:54 2021-12-03 06:52:29 2021-12-03 07:32:37 0:40:08 0:28:53 0:11:15 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6541026 2021-12-02 20:40:55 2021-12-03 06:52:30 2021-12-03 07:08:30 0:16:00 0:08:54 0:07:06 smithi master centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6541027 2021-12-02 20:40:56 2021-12-03 06:53:20 2021-12-03 07:31:28 0:38:08 0:28:12 0:09:56 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6541028 2021-12-02 20:40:57 2021-12-03 06:53:31 2021-12-03 07:28:56 0:35:25 0:22:50 0:12:35 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6541029 2021-12-02 20:40:58 2021-12-03 06:54:41 2021-12-03 07:12:07 0:17:26 0:10:05 0:07:21 smithi master centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 6541030 2021-12-02 20:40:59 2021-12-03 06:54:51 2021-12-03 07:17:33 0:22:42 0:12:11 0:10:31 smithi master centos 8.3 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 6541031 2021-12-02 20:41:00 2021-12-03 06:56:02 2021-12-03 07:32:29 0:36:27 0:24:42 0:11:45 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6541032 2021-12-02 20:41:01 2021-12-03 06:56:02 2021-12-03 07:26:33 0:30:31 0:20:05 0:10:26 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6541033 2021-12-02 20:41:02 2021-12-03 06:56:23 2021-12-03 07:22:10 0:25:47 0:18:01 0:07:46 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 6541034 2021-12-02 20:41:03 2021-12-03 06:56:43 2021-12-03 07:16:07 0:19:24 0:08:34 0:10:50 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:85641afe0bfa4aa7ddced29e005c6fbe998b85c0 pull'

pass 6541035 2021-12-02 20:41:04 2021-12-03 06:56:43 2021-12-03 07:46:29 0:49:46 0:41:51 0:07:55 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6541036 2021-12-02 20:41:05 2021-12-03 06:57:04 2021-12-03 07:20:24 0:23:20 0:15:21 0:07:59 smithi master centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi031 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,nofallback'