Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6783018 2022-04-08 23:03:17 2022-04-08 23:29:45 2022-04-08 23:49:31 0:19:46 0:13:36 0:06:10 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
fail 6783019 2022-04-08 23:03:18 2022-04-08 23:30:15 2022-04-09 00:14:36 0:44:21 0:37:13 0:07:08 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-08T23:45:55.888458+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: Degraded data redundancy: 6/2862 objects degraded (0.210%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6783020 2022-04-08 23:03:19 2022-04-08 23:31:36 2022-04-09 00:14:51 0:43:15 0:32:54 0:10:21 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi167 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6783021 2022-04-08 23:03:20 2022-04-08 23:34:36 2022-04-09 00:07:41 0:33:05 0:25:12 0:07:53 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 3
pass 6783022 2022-04-08 23:03:21 2022-04-08 23:35:27 2022-04-09 00:39:49 1:04:22 0:56:52 0:07:30 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783023 2022-04-08 23:03:22 2022-04-08 23:36:17 2022-04-08 23:52:07 0:15:50 0:08:36 0:07:14 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6783024 2022-04-08 23:03:23 2022-04-08 23:36:48 2022-04-09 00:21:37 0:44:49 0:36:37 0:08:12 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783025 2022-04-08 23:03:24 2022-04-08 23:37:38 2022-04-08 23:56:41 0:19:03 0:10:31 0:08:32 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783026 2022-04-08 23:03:25 2022-04-08 23:39:19 2022-04-09 00:33:09 0:53:50 0:46:26 0:07:24 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{centos_8}} 2
pass 6783027 2022-04-08 23:03:26 2022-04-08 23:40:39 2022-04-09 00:41:35 1:00:56 0:48:33 0:12:23 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
pass 6783028 2022-04-08 23:03:27 2022-04-08 23:47:00 2022-04-09 00:15:10 0:28:10 0:20:52 0:07:18 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6783029 2022-04-08 23:03:28 2022-04-08 23:47:11 2022-04-09 00:36:30 0:49:19 0:43:23 0:05:56 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6783030 2022-04-08 23:03:29 2022-04-08 23:47:11 2022-04-09 00:47:23 1:00:12 0:51:44 0:08:28 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
pass 6783031 2022-04-08 23:03:30 2022-04-08 23:47:41 2022-04-09 00:53:20 1:05:39 0:58:23 0:07:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783032 2022-04-08 23:03:31 2022-04-08 23:47:52 2022-04-09 00:25:18 0:37:26 0:29:50 0:07:36 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783033 2022-04-08 23:03:32 2022-04-08 23:48:02 2022-04-09 00:31:52 0:43:50 0:37:21 0:06:29 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 2
pass 6783034 2022-04-08 23:03:33 2022-04-08 23:48:02 2022-04-09 00:44:21 0:56:19 0:48:23 0:07:56 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
pass 6783035 2022-04-08 23:03:34 2022-04-08 23:49:13 2022-04-09 00:52:39 1:03:26 0:55:56 0:07:30 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
pass 6783036 2022-04-08 23:03:35 2022-04-08 23:49:33 2022-04-09 00:28:20 0:38:47 0:29:03 0:09:44 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest}} 2
pass 6783037 2022-04-08 23:03:36 2022-04-08 23:52:04 2022-04-09 00:46:41 0:54:37 0:48:36 0:06:01 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{centos_8}} 2
fail 6783038 2022-04-08 23:03:37 2022-04-08 23:52:04 2022-04-09 00:35:06 0:43:02 0:35:46 0:07:16 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T00:06:43.022408+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: Degraded data redundancy: 1/2154 objects degraded (0.046%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783039 2022-04-08 23:03:38 2022-04-08 23:52:15 2022-04-09 00:49:54 0:57:39 0:49:00 0:08:39 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} 3
pass 6783040 2022-04-08 23:03:39 2022-04-08 23:54:55 2022-04-09 00:28:22 0:33:27 0:26:28 0:06:59 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 3
pass 6783041 2022-04-08 23:03:41 2022-04-08 23:55:16 2022-04-09 00:12:05 0:16:49 0:08:25 0:08:24 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6783042 2022-04-08 23:03:42 2022-04-08 23:56:16 2022-04-09 00:42:21 0:46:05 0:39:01 0:07:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783043 2022-04-08 23:03:43 2022-04-08 23:56:36 2022-04-09 00:49:53 0:53:17 0:47:18 0:05:59 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6783044 2022-04-08 23:03:44 2022-04-08 23:56:47 2022-04-09 00:25:25 0:28:38 0:19:56 0:08:42 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6783045 2022-04-08 23:03:45 2022-04-08 23:57:07 2022-04-09 00:51:52 0:54:45 0:48:53 0:05:52 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
pass 6783046 2022-04-08 23:03:46 2022-04-08 23:57:07 2022-04-09 00:29:29 0:32:22 0:21:32 0:10:50 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783047 2022-04-08 23:03:47 2022-04-09 00:00:28 2022-04-09 00:56:28 0:56:00 0:47:59 0:08:01 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783048 2022-04-08 23:03:48 2022-04-09 00:01:09 2022-04-09 00:28:15 0:27:06 0:21:02 0:06:04 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6783049 2022-04-08 23:03:49 2022-04-09 00:01:09 2022-04-09 00:29:41 0:28:32 0:20:24 0:08:08 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6783050 2022-04-08 23:03:50 2022-04-09 00:02:29 2022-04-09 00:51:46 0:49:17 0:43:25 0:05:52 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6783051 2022-04-08 23:03:51 2022-04-09 00:02:30 2022-04-09 01:05:14 1:02:44 0:50:25 0:12:19 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783052 2022-04-08 23:03:52 2022-04-09 00:07:51 2022-04-09 01:14:54 1:07:03 0:56:40 0:10:23 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
pass 6783053 2022-04-08 23:03:53 2022-04-09 00:11:52 2022-04-09 00:54:15 0:42:23 0:34:57 0:07:26 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783054 2022-04-08 23:03:54 2022-04-09 00:11:52 2022-04-09 00:46:02 0:34:10 0:27:43 0:06:27 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6783055 2022-04-08 23:03:55 2022-04-09 00:12:12 2022-04-09 01:05:43 0:53:31 0:46:04 0:07:27 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783056 2022-04-08 23:03:56 2022-04-09 00:12:13 2022-04-09 01:06:02 0:53:49 0:45:06 0:08:43 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783057 2022-04-08 23:03:57 2022-04-09 00:14:43 2022-04-09 01:17:12 1:02:29 0:55:41 0:06:48 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 6783058 2022-04-08 23:03:59 2022-04-09 00:14:44 2022-04-09 01:10:29 0:55:45 0:47:51 0:07:54 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783059 2022-04-08 23:04:00 2022-04-09 00:14:54 2022-04-09 00:36:54 0:22:00 0:14:56 0:07:04 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
fail 6783060 2022-04-08 23:04:01 2022-04-09 00:15:14 2022-04-09 01:04:32 0:49:18 0:40:32 0:08:46 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T00:32:12.154287+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1856 objects degraded (0.054%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783061 2022-04-08 23:04:02 2022-04-09 00:17:25 2022-04-09 01:22:32 1:05:07 0:57:41 0:07:26 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{centos_8}} 3
pass 6783062 2022-04-08 23:04:03 2022-04-09 00:17:26 2022-04-09 00:54:33 0:37:07 0:26:08 0:10:59 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 3
pass 6783063 2022-04-08 23:04:04 2022-04-09 00:20:46 2022-04-09 01:24:23 1:03:37 0:56:00 0:07:37 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
pass 6783064 2022-04-08 23:04:05 2022-04-09 00:20:47 2022-04-09 01:09:17 0:48:30 0:39:33 0:08:57 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{centos_8}} 2
pass 6783065 2022-04-08 23:04:06 2022-04-09 00:21:47 2022-04-09 00:43:10 0:21:23 0:10:25 0:10:58 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8}} 2
pass 6783066 2022-04-08 23:04:07 2022-04-09 00:25:28 2022-04-09 01:17:00 0:51:32 0:44:53 0:06:39 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783067 2022-04-08 23:04:08 2022-04-09 00:25:28 2022-04-09 00:54:41 0:29:13 0:21:49 0:07:24 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783068 2022-04-08 23:04:09 2022-04-09 00:25:39 2022-04-09 01:23:15 0:57:36 0:48:22 0:09:14 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783069 2022-04-08 23:04:10 2022-04-09 00:27:59 2022-04-09 00:55:25 0:27:26 0:21:21 0:06:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6783070 2022-04-08 23:04:11 2022-04-09 00:28:20 2022-04-09 01:23:47 0:55:27 0:48:10 0:07:17 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
pass 6783071 2022-04-08 23:04:12 2022-04-09 00:28:30 2022-04-09 01:17:31 0:49:01 0:42:54 0:06:07 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{centos_8}} 2
pass 6783072 2022-04-08 23:04:13 2022-04-09 00:28:30 2022-04-09 00:56:38 0:28:08 0:19:53 0:08:15 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6783073 2022-04-08 23:04:14 2022-04-09 00:28:31 2022-04-09 01:18:34 0:50:03 0:43:38 0:06:25 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6783074 2022-04-08 23:04:15 2022-04-09 00:29:21 2022-04-09 01:28:15 0:58:54 0:52:31 0:06:23 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6783075 2022-04-08 23:04:16 2022-04-09 00:29:21 2022-04-09 01:35:01 1:05:40 0:58:48 0:06:52 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783076 2022-04-08 23:04:17 2022-04-09 00:29:32 2022-04-09 01:12:34 0:43:02 0:36:36 0:06:26 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{centos_8}} 2
pass 6783077 2022-04-08 23:04:18 2022-04-09 00:29:42 2022-04-09 01:07:46 0:38:04 0:29:23 0:08:41 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783078 2022-04-08 23:04:19 2022-04-09 00:31:53 2022-04-09 01:08:43 0:36:50 0:28:06 0:08:44 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
pass 6783079 2022-04-08 23:04:20 2022-04-09 00:32:23 2022-04-09 01:34:47 1:02:24 0:55:42 0:06:42 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
fail 6783080 2022-04-08 23:04:21 2022-04-09 00:32:23 2022-04-09 01:31:37 0:59:14 0:52:55 0:06:19 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T01:19:03.689900+0000 mon.a (mon.0) 1458 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6783081 2022-04-08 23:04:22 2022-04-09 00:33:14 2022-04-09 01:19:58 0:46:44 0:38:51 0:07:53 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 2
fail 6783082 2022-04-08 23:04:23 2022-04-09 00:35:14 2022-04-09 01:36:36 1:01:22 0:52:12 0:09:10 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6783083 2022-04-08 23:04:24 2022-04-09 00:36:55 2022-04-09 00:57:00 0:20:05 0:10:07 0:09:58 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
fail 6783084 2022-04-08 23:04:25 2022-04-09 00:39:56 2022-04-09 00:57:59 0:18:03 0:10:54 0:07:09 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
Failure Reason:

Found coredumps on ubuntu@smithi036.front.sepia.ceph.com

pass 6783085 2022-04-08 23:04:26 2022-04-09 00:41:36 2022-04-09 01:34:25 0:52:49 0:45:01 0:07:48 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783086 2022-04-08 23:04:27 2022-04-09 00:42:27 2022-04-09 01:13:00 0:30:33 0:21:40 0:08:53 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6783087 2022-04-08 23:04:28 2022-04-09 00:43:17 2022-04-09 01:39:58 0:56:41 0:48:52 0:07:49 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{ubuntu_latest}} 2
fail 6783088 2022-04-08 23:04:30 2022-04-09 00:44:28 2022-04-09 01:11:31 0:27:03 0:18:52 0:08:11 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T01:00:03.948010+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783089 2022-04-08 23:04:31 2022-04-09 00:46:08 2022-04-09 01:13:30 0:27:22 0:21:30 0:05:52 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
fail 6783090 2022-04-08 23:04:32 2022-04-09 00:46:48 2022-04-09 01:35:09 0:48:21 0:39:45 0:08:36 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T01:02:48.461115+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: Degraded data redundancy: 2/2450 objects degraded (0.082%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783091 2022-04-08 23:04:33 2022-04-09 00:47:29 2022-04-09 01:14:31 0:27:02 0:19:07 0:07:55 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
pass 6783092 2022-04-08 23:04:34 2022-04-09 00:49:20 2022-04-09 01:45:03 0:55:43 0:48:00 0:07:43 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} 3
pass 6783093 2022-04-08 23:04:35 2022-04-09 00:50:00 2022-04-09 01:49:18 0:59:18 0:51:38 0:07:40 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8}} 2
pass 6783094 2022-04-08 23:04:36 2022-04-09 00:50:00 2022-04-09 01:56:22 1:06:22 0:58:47 0:07:35 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} 2
pass 6783095 2022-04-08 23:04:37 2022-04-09 00:51:32 2022-04-09 01:28:37 0:37:05 0:30:01 0:07:04 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783096 2022-04-08 23:04:38 2022-04-09 00:51:42 2022-04-09 01:37:08 0:45:26 0:37:43 0:07:43 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
pass 6783097 2022-04-08 23:04:39 2022-04-09 00:52:03 2022-04-09 01:26:02 0:33:59 0:27:36 0:06:23 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
pass 6783098 2022-04-08 23:04:40 2022-04-09 04:07:23 2022-04-09 04:44:24 0:37:01 0:30:04 0:06:57 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6783099 2022-04-08 23:04:41 2022-04-09 04:07:24 2022-04-09 05:09:28 1:02:04 0:55:04 0:07:00 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6783100 2022-04-08 23:04:42 2022-04-09 04:08:44 2022-04-09 04:44:33 0:35:49 0:27:29 0:08:20 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
fail 6783101 2022-04-08 23:04:43 2022-04-09 04:10:45 2022-04-09 04:58:07 0:47:22 0:41:07 0:06:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-09T04:23:36.409559+0000 mon.a (mon.0) 205 : cluster [WRN] Health check failed: Degraded data redundancy: 6/2044 objects degraded (0.294%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783102 2022-04-08 23:04:44 2022-04-09 04:10:45 2022-04-09 05:10:07 0:59:22 0:50:07 0:09:15 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{centos_8}} 3
pass 6783103 2022-04-08 23:04:45 2022-04-09 04:12:16 2022-04-09 04:43:42 0:31:26 0:24:44 0:06:42 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 3
pass 6783104 2022-04-08 23:04:46 2022-04-09 04:12:26 2022-04-09 05:14:52 1:02:26 0:53:36 0:08:50 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{centos_8}} 2
pass 6783105 2022-04-08 23:04:47 2022-04-09 04:12:57 2022-04-09 04:30:31 0:17:34 0:10:59 0:06:35 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
fail 6783106 2022-04-08 23:04:48 2022-04-09 04:13:07 2022-04-09 04:38:44 0:25:37 0:18:19 0:07:18 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T04:27:06.643700+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783107 2022-04-08 23:04:49 2022-04-09 05:06:58 2800 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 2
pass 6783108 2022-04-08 23:04:50 2022-04-09 04:13:58 2022-04-09 05:09:48 0:55:50 0:48:06 0:07:44 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783109 2022-04-08 23:04:51 2022-04-09 04:14:18 2022-04-09 04:42:38 0:28:20 0:19:24 0:08:56 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
fail 6783110 2022-04-08 23:04:52 2022-04-09 04:16:39 2022-04-09 05:04:02 0:47:23 0:40:18 0:07:05 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-09T04:30:13.555857+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: Degraded data redundancy: 3/2598 objects degraded (0.115%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783111 2022-04-08 23:04:53 2022-04-09 04:16:39 2022-04-09 04:44:53 0:28:14 0:21:06 0:07:08 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
fail 6783112 2022-04-08 23:04:54 2022-04-09 04:17:10 2022-04-09 04:53:20 0:36:10 0:28:20 0:07:50 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6783113 2022-04-08 23:04:55 2022-04-09 04:17:30 2022-04-09 05:18:33 1:01:03 0:55:11 0:05:52 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6783114 2022-04-08 23:04:56 2022-04-09 04:17:40 2022-04-09 04:53:49 0:36:09 0:28:12 0:07:57 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6783115 2022-04-08 23:04:57 2022-04-09 04:18:11 2022-04-09 04:53:38 0:35:27 0:29:02 0:06:25 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783116 2022-04-08 23:04:59 2022-04-09 04:18:31 2022-04-09 05:13:22 0:54:51 0:48:40 0:06:11 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} 2
pass 6783117 2022-04-08 23:05:00 2022-04-09 04:18:51 2022-04-09 05:19:45 1:00:54 0:55:05 0:05:49 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6783118 2022-04-08 23:05:01 2022-04-09 04:18:52 2022-04-09 04:55:10 0:36:18 0:28:42 0:07:36 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6783119 2022-04-08 23:05:02 2022-04-09 04:20:02 2022-04-09 04:41:52 0:21:50 0:13:54 0:07:56 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6783120 2022-04-08 23:05:03 2022-04-09 04:20:33 2022-04-09 05:05:14 0:44:41 0:36:25 0:08:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783121 2022-04-08 23:05:04 2022-04-09 04:21:53 2022-04-09 05:17:27 0:55:34 0:49:27 0:06:07 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{ubuntu_latest}} 3
pass 6783122 2022-04-08 23:05:05 2022-04-09 04:22:04 2022-04-09 04:55:08 0:33:04 0:24:47 0:08:17 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest}} 3
pass 6783123 2022-04-08 23:05:06 2022-04-09 04:23:44 2022-04-09 04:40:58 0:17:14 0:10:28 0:06:46 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6783124 2022-04-08 23:05:07 2022-04-09 04:23:55 2022-04-09 05:11:16 0:47:21 0:41:03 0:06:18 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
pass 6783125 2022-04-08 23:05:08 2022-04-09 04:24:15 2022-04-09 04:42:34 0:18:19 0:10:26 0:07:53 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
fail 6783126 2022-04-08 23:05:09 2022-04-09 04:25:36 2022-04-09 05:20:09 0:54:33 0:46:00 0:08:33 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-09T04:40:11.377961+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: Degraded data redundancy: 1/334 objects degraded (0.299%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783127 2022-04-08 23:05:10 2022-04-09 04:26:46 2022-04-09 04:54:56 0:28:10 0:21:02 0:07:08 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6783128 2022-04-08 23:05:11 2022-04-09 04:27:17 2022-04-09 04:59:33 0:32:16 0:21:45 0:10:31 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6783129 2022-04-08 23:05:12 2022-04-09 04:30:27 2022-04-09 05:23:59 0:53:32 0:47:05 0:06:27 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{centos_8}} 2
pass 6783130 2022-04-08 23:05:13 2022-04-09 04:30:38 2022-04-09 05:16:48 0:46:10 0:37:39 0:08:31 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783131 2022-04-08 23:05:14 2022-04-09 04:32:28 2022-04-09 05:25:11 0:52:43 0:44:38 0:08:05 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} 1
pass 6783132 2022-04-08 23:05:15 2022-04-09 04:34:09 2022-04-09 05:40:08 1:05:59 0:54:11 0:11:48 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
pass 6783133 2022-04-08 23:05:16 2022-04-09 04:38:40 2022-04-09 05:21:45 0:43:05 0:37:07 0:05:58 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{centos_8}} 2
pass 6783134 2022-04-08 23:05:17 2022-04-09 04:38:50 2022-04-09 05:14:37 0:35:47 0:29:13 0:06:34 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783135 2022-04-08 23:05:18 2022-04-09 04:39:30 2022-04-09 05:36:57 0:57:27 0:50:18 0:07:09 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{centos_8}} 2
pass 6783136 2022-04-08 23:05:19 2022-04-09 04:40:01 2022-04-09 05:16:02 0:36:01 0:28:49 0:07:12 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6783137 2022-04-08 23:05:20 2022-04-09 04:41:01 2022-04-09 05:34:52 0:53:51 0:46:15 0:07:36 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783138 2022-04-08 23:05:21 2022-04-09 04:41:22 2022-04-09 05:42:58 1:01:36 0:54:58 0:06:38 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6783139 2022-04-08 23:05:22 2022-04-09 04:41:52 2022-04-09 05:02:53 0:21:01 0:15:22 0:05:39 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6783140 2022-04-08 23:05:23 2022-04-09 04:42:02 2022-04-09 05:36:47 0:54:45 0:45:52 0:08:53 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783141 2022-04-08 23:05:24 2022-04-09 04:42:43 2022-04-09 05:36:31 0:53:48 0:46:54 0:06:54 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{centos_8}} 3
pass 6783142 2022-04-08 23:05:25 2022-04-09 04:43:23 2022-04-09 05:16:33 0:33:10 0:25:37 0:07:33 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 3
pass 6783143 2022-04-08 23:05:26 2022-04-09 04:43:43 2022-04-09 05:02:01 0:18:18 0:10:13 0:08:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
pass 6783144 2022-04-08 23:05:27 2022-04-09 04:44:34 2022-04-09 05:29:36 0:45:02 0:38:31 0:06:31 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} 2
pass 6783145 2022-04-08 23:05:28 2022-04-09 04:44:34 2022-04-09 05:40:49 0:56:15 0:47:53 0:08:22 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
pass 6783146 2022-04-08 23:05:29 2022-04-09 04:44:55 2022-04-09 05:16:12 0:31:17 0:20:03 0:11:14 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
fail 6783147 2022-04-08 23:05:30 2022-04-09 04:48:55 2022-04-09 05:43:08 0:54:13 0:43:15 0:10:58 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'

pass 6783148 2022-04-08 23:05:31 2022-04-09 04:53:26 2022-04-09 05:22:53 0:29:27 0:22:08 0:07:19 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8}} 2
pass 6783149 2022-04-08 23:05:32 2022-04-09 04:53:47 2022-04-09 05:47:11 0:53:24 0:46:38 0:06:46 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6783150 2022-04-08 23:05:33 2022-04-09 04:53:57 2022-04-09 05:21:02 0:27:05 0:19:21 0:07:44 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest}} 2
fail 6783151 2022-04-08 23:05:34 2022-04-09 04:54:57 2022-04-09 05:40:27 0:45:30 0:38:46 0:06:44 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T05:10:17.638690+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: Degraded data redundancy: 9/5898 objects degraded (0.153%), 2 pgs degraded (PG_DEGRADED)" in cluster log

pass 6783152 2022-04-08 23:05:36 2022-04-09 04:55:18 2022-04-09 05:22:39 0:27:21 0:20:29 0:06:52 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
fail 6783153 2022-04-08 23:05:37 2022-04-09 04:55:18 2022-04-09 05:51:25 0:56:07 0:45:50 0:10:17 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 3
Failure Reason:

Found coredumps on ubuntu@smithi081.front.sepia.ceph.com

pass 6783154 2022-04-08 23:05:38 2022-04-09 04:58:09 2022-04-09 05:49:53 0:51:44 0:44:38 0:07:06 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} 1
pass 6783155 2022-04-08 23:05:39 2022-04-09 04:58:09 2022-04-09 05:59:07 1:00:58 0:52:51 0:08:07 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6783156 2022-04-08 23:05:40 2022-04-09 04:59:40 2022-04-09 05:35:54 0:36:14 0:27:15 0:08:59 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6783157 2022-04-08 23:05:41 2022-04-09 05:02:10 2022-04-09 05:57:54 0:55:44 0:48:48 0:06:56 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
pass 6783158 2022-04-08 23:05:42 2022-04-09 05:03:01 2022-04-09 05:57:01 0:54:00 0:47:11 0:06:49 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 2
fail 6783159 2022-04-08 23:05:43 2022-04-09 05:04:11 2022-04-09 06:06:19 1:02:08 0:54:38 0:07:30 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

"2022-04-09T05:47:23.758564+0000 mon.a (mon.0) 1759 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log

pass 6783160 2022-04-08 23:05:44 2022-04-09 05:05:22 2022-04-09 05:41:16 0:35:54 0:29:23 0:06:31 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783161 2022-04-08 23:05:45 2022-04-09 05:06:22 2022-04-09 06:04:11 0:57:49 0:50:00 0:07:49 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{centos_8}} 2
pass 6783162 2022-04-08 23:05:46 2022-04-09 05:07:03 2022-04-09 05:29:10 0:22:07 0:13:30 0:08:37 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
fail 6783163 2022-04-08 23:05:47 2022-04-09 05:09:53 2022-04-09 06:12:13 1:02:20 0:54:55 0:07:25 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6783164 2022-04-08 23:05:48 2022-04-09 05:10:14 2022-04-09 05:42:47 0:32:33 0:25:00 0:07:33 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 3
pass 6783165 2022-04-08 23:05:49 2022-04-09 05:11:24 2022-04-09 06:14:03 1:02:39 0:54:23 0:08:16 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 2
pass 6783166 2022-04-08 23:05:50 2022-04-09 05:13:25 2022-04-09 06:08:23 0:54:58 0:46:06 0:08:52 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783167 2022-04-08 23:05:51 2022-04-09 05:14:45 2022-04-09 05:42:44 0:27:59 0:21:05 0:06:54 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6783168 2022-04-08 23:05:52 2022-04-09 05:14:55 2022-04-09 06:09:28 0:54:33 0:47:45 0:06:48 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783169 2022-04-08 23:05:53 2022-04-09 05:16:06 2022-04-09 05:43:36 0:27:30 0:20:09 0:07:21 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6783170 2022-04-08 23:05:54 2022-04-09 05:16:16 2022-04-09 06:07:58 0:51:42 0:45:52 0:05:50 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783171 2022-04-08 23:05:55 2022-04-09 05:16:37 2022-04-09 05:45:12 0:28:35 0:20:02 0:08:33 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6783172 2022-04-08 23:05:56 2022-04-09 05:16:57 2022-04-09 06:08:27 0:51:30 0:43:42 0:07:48 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} 2
dead 6783173 2022-04-08 23:05:57 2022-04-09 05:17:27 2022-04-09 05:22:45 0:05:18 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 3
Failure Reason:

Error reimaging machines: 'NoneType' object has no attribute '_fields'

pass 6783174 2022-04-08 23:05:58 2022-04-09 05:18:38 2022-04-09 06:09:16 0:50:38 0:45:10 0:05:28 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 1
pass 6783175 2022-04-08 23:05:59 2022-04-09 05:18:38 2022-04-09 06:16:39 0:58:01 0:49:56 0:08:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783176 2022-04-08 23:06:01 2022-04-09 05:19:09 2022-04-09 05:55:11 0:36:02 0:29:28 0:06:34 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6783177 2022-04-08 23:06:02 2022-04-09 05:20:19 2022-04-09 06:06:54 0:46:35 0:38:37 0:07:58 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6783178 2022-04-08 23:06:03 2022-04-09 05:21:10 2022-04-09 05:57:16 0:36:06 0:28:04 0:08:02 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6783179 2022-04-08 23:06:04 2022-04-09 05:21:50 2022-04-09 05:59:40 0:37:50 0:29:42 0:08:08 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6783180 2022-04-08 23:06:05 2022-04-09 05:22:40 2022-04-09 06:23:38 1:00:58 0:54:23 0:06:35 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
pass 6783181 2022-04-08 23:06:06 2022-04-09 05:22:41 2022-04-09 05:57:44 0:35:03 0:29:29 0:05:34 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6783182 2022-04-08 23:06:07 2022-04-09 05:23:01 2022-04-09 06:16:07 0:53:06 0:47:10 0:05:56 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{centos_8}} 2
pass 6783183 2022-04-08 23:06:08 2022-04-09 05:23:01 2022-04-09 05:47:17 0:24:16 0:15:35 0:08:41 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
fail 6783184 2022-04-08 23:06:09 2022-04-09 05:24:02 2022-04-09 06:06:13 0:42:11 0:35:02 0:07:09 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T05:39:59.888611+0000 mon.a (mon.0) 210 : cluster [WRN] Health check failed: Degraded data redundancy: 8/3138 objects degraded (0.255%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6783185 2022-04-08 23:06:10 2022-04-09 05:25:12 2022-04-09 06:01:06 0:35:54 0:25:50 0:10:04 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 3
pass 6783186 2022-04-08 23:06:11 2022-04-09 05:29:43 2022-04-09 06:38:23 1:08:40 0:55:55 0:12:45 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783187 2022-04-08 23:06:12 2022-04-09 05:34:54 2022-04-09 05:53:22 0:18:28 0:10:23 0:08:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6783188 2022-04-08 23:06:13 2022-04-09 05:35:55 2022-04-09 06:21:36 0:45:41 0:39:24 0:06:17 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{centos_8}} 2
pass 6783189 2022-04-08 23:06:14 2022-04-09 05:36:35 2022-04-09 05:51:56 0:15:21 0:08:12 0:07:09 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6783190 2022-04-08 23:06:15 2022-04-09 05:36:36 2022-04-09 06:34:37 0:58:01 0:49:48 0:08:13 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{centos_8}} 2
pass 6783191 2022-04-08 23:06:16 2022-04-09 05:36:56 2022-04-09 06:04:03 0:27:07 0:21:02 0:06:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6783192 2022-04-08 23:06:17 2022-04-09 05:37:06 2022-04-09 06:35:21 0:58:15 0:48:21 0:09:54 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{centos_8}} 2
pass 6783193 2022-04-08 23:06:18 2022-04-09 06:34:22 2844 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783194 2022-04-08 23:06:19 2022-04-09 05:40:37 2022-04-09 06:08:41 0:28:04 0:20:59 0:07:05 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8}} 2
pass 6783195 2022-04-08 23:06:20 2022-04-09 05:40:58 2022-04-09 06:08:13 0:27:15 0:20:53 0:06:22 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
fail 6783196 2022-04-08 23:06:21 2022-04-09 05:41:18 2022-04-09 06:19:56 0:38:38 0:30:22 0:08:16 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69ad68d989715754945f23c59c7f3abe9a8b52dc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6783197 2022-04-08 23:06:22 2022-04-09 05:42:49 2022-04-09 06:33:57 0:51:08 0:44:30 0:06:38 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} 1
pass 6783198 2022-04-08 23:06:23 2022-04-09 05:42:49 2022-04-09 06:43:25 1:00:36 0:52:00 0:08:36 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
pass 6783199 2022-04-08 23:06:24 2022-04-09 05:42:59 2022-04-09 06:46:50 1:03:51 0:57:06 0:06:45 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6783200 2022-04-08 23:06:25 2022-04-09 05:43:10 2022-04-09 06:20:41 0:37:31 0:29:38 0:07:53 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6783201 2022-04-08 23:06:26 2022-04-09 05:43:40 2022-04-09 06:27:37 0:43:57 0:34:10 0:09:47 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6783202 2022-04-08 23:06:27 2022-04-09 05:45:21 2022-04-09 06:21:05 0:35:44 0:27:51 0:07:53 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6783203 2022-04-08 23:06:28 2022-04-09 05:47:21 2022-04-09 06:22:58 0:35:37 0:28:06 0:07:31 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
fail 6783204 2022-04-08 23:06:29 2022-04-09 05:47:22 2022-04-09 06:14:46 0:27:24 0:16:25 0:10:59 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6783205 2022-04-08 23:06:30 2022-04-09 05:51:33 2022-04-09 06:51:44 1:00:11 0:55:05 0:05:06 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} 1
pass 6783206 2022-04-08 23:06:31 2022-04-09 05:51:33 2022-04-09 06:27:04 0:35:31 0:28:22 0:07:09 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
pass 6783207 2022-04-08 23:06:32 2022-04-09 05:52:03 2022-04-09 06:52:57 1:00:54 0:51:48 0:09:06 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{centos_8}} 2