Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6706032 2022-02-25 17:01:24 2022-02-26 18:33:00 2022-02-26 18:57:39 0:24:39 0:14:16 0:10:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6706033 2022-02-25 17:01:25 2022-02-26 18:34:10 2022-02-26 19:31:00 0:56:50 0:46:08 0:10:42 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6706034 2022-02-25 17:01:26 2022-02-26 18:35:31 2022-02-26 19:44:03 1:08:32 0:58:07 0:10:25 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706035 2022-02-25 17:01:27 2022-02-26 18:36:21 2022-02-26 18:58:29 0:22:08 0:11:13 0:10:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706036 2022-02-25 17:01:28 2022-02-26 18:37:12 2022-02-26 18:58:39 0:21:27 0:11:50 0:09:37 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6706037 2022-02-25 17:01:29 2022-02-26 18:37:42 2022-02-26 19:34:26 0:56:44 0:46:31 0:10:13 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706038 2022-02-25 17:01:30 2022-02-26 18:39:13 2022-02-26 19:40:38 1:01:25 0:51:22 0:10:03 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706039 2022-02-25 17:01:32 2022-02-26 18:39:23 2022-02-26 19:10:17 0:30:54 0:21:45 0:09:09 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6706040 2022-02-25 17:01:33 2022-02-26 18:39:23 2022-02-26 19:08:46 0:29:23 0:19:53 0:09:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6706041 2022-02-25 17:01:34 2022-02-26 18:39:24 2022-02-26 19:45:15 1:05:51 0:56:38 0:09:13 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706042 2022-02-25 17:01:35 2022-02-26 18:39:54 2022-02-26 19:44:06 1:04:12 0:54:38 0:09:34 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6706043 2022-02-25 17:01:36 2022-02-26 18:40:55 2022-02-26 18:58:27 0:17:32 0:07:33 0:09:59 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6706044 2022-02-25 17:01:37 2022-02-26 18:40:55 2022-02-26 19:22:20 0:41:25 0:30:23 0:11:02 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6706045 2022-02-25 17:01:38 2022-02-26 18:43:36 2022-02-26 19:32:37 0:49:01 0:36:33 0:12:28 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706046 2022-02-25 17:01:39 2022-02-26 18:44:06 2022-02-26 19:23:34 0:39:28 0:28:01 0:11:27 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706047 2022-02-25 17:01:40 2022-02-26 18:46:17 2022-02-26 19:45:04 0:58:47 0:47:47 0:11:00 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
fail 6706048 2022-02-25 17:01:41 2022-02-26 18:46:57 2022-02-26 19:53:37 1:06:40 0:56:52 0:09:48 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

"2022-02-26T19:43:15.282560+0000 mon.a (mon.0) 2387 : cluster [WRN] Health check failed: Degraded data redundancy: 1/42 objects degraded (2.381%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706049 2022-02-25 17:01:42 2022-02-26 18:48:38 2022-02-26 19:50:32 1:01:54 0:48:58 0:12:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706050 2022-02-25 17:01:43 2022-02-26 18:49:48 2022-02-26 19:14:02 0:24:14 0:14:23 0:09:51 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6706051 2022-02-25 17:01:44 2022-02-26 18:50:18 2022-02-26 19:59:49 1:09:31 1:00:43 0:08:48 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706052 2022-02-25 17:01:45 2022-02-26 18:50:59 2022-02-26 19:13:28 0:22:29 0:11:46 0:10:43 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706053 2022-02-25 17:01:47 2022-02-26 18:52:29 2022-02-26 19:15:37 0:23:08 0:11:25 0:11:43 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6706054 2022-02-25 17:01:48 2022-02-26 18:53:10 2022-02-26 19:44:10 0:51:00 0:42:07 0:08:53 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6706055 2022-02-25 17:01:49 2022-02-26 18:53:10 2022-02-26 19:22:45 0:29:35 0:20:10 0:09:25 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6706056 2022-02-25 17:01:50 2022-02-26 18:53:21 2022-02-26 19:51:07 0:57:46 0:48:11 0:09:35 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706057 2022-02-25 17:01:51 2022-02-26 18:54:11 2022-02-26 19:27:25 0:33:14 0:20:40 0:12:34 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6706058 2022-02-25 17:01:52 2022-02-26 18:55:01 2022-02-26 19:57:19 1:02:18 0:52:47 0:09:31 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706059 2022-02-25 17:01:53 2022-02-26 18:56:22 2022-02-26 19:49:43 0:53:21 0:43:18 0:10:03 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6706060 2022-02-25 17:01:54 2022-02-26 18:56:22 2022-02-26 19:45:20 0:48:58 0:37:23 0:11:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706061 2022-02-25 17:01:55 2022-02-26 18:56:33 2022-02-26 19:34:43 0:38:10 0:27:26 0:10:44 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706062 2022-02-25 17:01:56 2022-02-26 18:57:13 2022-02-26 19:38:49 0:41:36 0:31:09 0:10:27 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6706063 2022-02-25 17:01:57 2022-02-26 18:57:43 2022-02-26 19:54:49 0:57:06 0:48:07 0:08:59 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
fail 6706064 2022-02-25 17:01:58 2022-02-26 18:57:44 2022-02-26 19:34:48 0:37:04 0:27:26 0:09:38 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

Command failed (workunit test rbd/test_rbd_mirror.sh) on smithi057 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 VALGRIND=\'--tool=memcheck --leak-check=full\' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_rbd_mirror.sh'

pass 6706065 2022-02-25 17:02:00 2022-02-26 18:57:44 2022-02-26 19:51:57 0:54:13 0:44:18 0:09:55 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6706066 2022-02-25 17:02:01 2022-02-26 18:57:54 2022-02-26 19:17:04 0:19:10 0:09:47 0:09:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706067 2022-02-25 17:02:02 2022-02-26 18:58:05 2022-02-26 19:18:49 0:20:44 0:11:52 0:08:52 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
fail 6706068 2022-02-25 17:02:03 2022-02-26 18:58:05 2022-02-26 19:27:24 0:29:19 0:18:41 0:10:38 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi201 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6706069 2022-02-25 17:02:04 2022-02-26 18:58:25 2022-02-26 19:29:54 0:31:29 0:21:55 0:09:34 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
fail 6706070 2022-02-25 17:02:05 2022-02-26 18:58:36 2022-02-26 19:15:59 0:17:23 0:07:46 0:09:37 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
fail 6706071 2022-02-25 17:02:06 2022-02-26 18:58:36 2022-02-26 20:04:15 1:05:39 0:55:19 0:10:20 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

"2022-02-26T19:51:26.909706+0000 mon.a (mon.0) 1785 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6706072 2022-02-25 17:02:07 2022-02-26 18:58:46 2022-02-26 19:59:34 1:00:48 0:49:06 0:11:42 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706073 2022-02-25 17:02:08 2022-02-26 19:00:37 2022-02-26 20:02:02 1:01:25 0:51:32 0:09:53 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6706074 2022-02-25 17:02:09 2022-02-26 19:01:17 2022-02-26 20:07:17 1:06:00 0:55:01 0:10:59 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706075 2022-02-25 17:02:10 2022-02-26 19:02:18 2022-02-26 19:56:09 0:53:51 0:43:42 0:10:09 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6706076 2022-02-25 17:02:11 2022-02-26 19:02:38 2022-02-26 19:21:25 0:18:47 0:07:59 0:10:48 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6706077 2022-02-25 17:02:13 2022-02-26 19:03:49 2022-02-26 19:50:30 0:46:41 0:35:31 0:11:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706078 2022-02-25 17:02:14 2022-02-26 19:04:59 2022-02-26 19:45:08 0:40:09 0:29:42 0:10:27 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706079 2022-02-25 17:02:15 2022-02-26 19:05:50 2022-02-26 20:06:43 1:00:53 0:50:21 0:10:32 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706080 2022-02-25 17:02:16 2022-02-26 19:07:20 2022-02-26 19:47:55 0:40:35 0:28:52 0:11:43 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 6706081 2022-02-25 17:02:17 2022-02-26 19:08:41 2022-02-26 20:13:47 1:05:06 0:56:40 0:08:26 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 6706082 2022-02-25 17:02:18 2022-02-26 19:08:51 2022-02-26 19:34:44 0:25:53 0:16:22 0:09:31 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6706083 2022-02-25 17:02:19 2022-02-26 19:09:41 2022-02-26 19:55:26 0:45:45 0:36:11 0:09:34 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
dead 6706084 2022-02-25 17:02:20 2022-02-26 19:10:22 2022-02-26 19:25:06 0:14:44 0:03:46 0:10:58 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
Failure Reason:

{'smithi039.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'upgrade': None}}, 'msg': 'Failed to update apt cache: '}}

fail 6706085 2022-02-25 17:02:21 2022-02-26 19:10:52 2022-02-26 19:40:15 0:29:23 0:18:39 0:10:44 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6706086 2022-02-25 17:02:22 2022-02-26 19:11:03 2022-02-26 20:02:43 0:51:40 0:41:47 0:09:53 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi185 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6706087 2022-02-25 17:02:23 2022-02-26 19:11:13 2022-02-26 20:11:16 1:00:03 0:48:56 0:11:07 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6706088 2022-02-25 17:02:24 2022-02-26 19:12:13 2022-02-26 19:33:50 0:21:37 0:09:44 0:11:53 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6706089 2022-02-25 17:02:25 2022-02-26 19:12:24 2022-02-26 20:12:28 1:00:04 0:49:14 0:10:50 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706090 2022-02-25 17:02:26 2022-02-26 19:13:34 2022-02-26 20:11:05 0:57:31 0:47:08 0:10:23 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 6706091 2022-02-25 17:02:27 2022-02-26 19:13:35 2022-02-26 22:05:33 2:51:58 2:42:05 0:09:53 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_fsx_compare.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_compare.sh'

pass 6706092 2022-02-25 17:02:29 2022-02-26 19:14:05 2022-02-26 20:20:06 1:06:01 0:55:22 0:10:39 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706093 2022-02-25 17:02:30 2022-02-26 19:14:25 2022-02-26 20:09:24 0:54:59 0:46:11 0:08:48 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} 1
pass 6706094 2022-02-25 17:02:31 2022-02-26 19:14:26 2022-02-26 20:16:04 1:01:38 0:52:08 0:09:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6706095 2022-02-25 17:02:32 2022-02-26 19:14:36 2022-02-26 19:56:15 0:41:39 0:29:42 0:11:57 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6706096 2022-02-25 17:02:33 2022-02-26 19:15:47 2022-02-26 20:03:35 0:47:48 0:37:10 0:10:38 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706097 2022-02-25 17:02:34 2022-02-26 19:16:07 2022-02-26 20:14:03 0:57:56 0:48:20 0:09:36 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706098 2022-02-25 17:02:35 2022-02-26 19:16:37 2022-02-26 19:54:08 0:37:31 0:29:08 0:08:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 6706099 2022-02-25 17:02:36 2022-02-26 19:17:08 2022-02-26 20:13:32 0:56:24 0:46:17 0:10:07 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706100 2022-02-25 17:02:37 2022-02-26 19:17:58 2022-02-26 20:22:55 1:04:57 0:55:48 0:09:09 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
fail 6706101 2022-02-25 17:02:38 2022-02-26 19:17:58 2022-02-26 20:20:08 1:02:10 0:50:31 0:11:39 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

"2022-02-26T19:38:39.324522+0000 mon.a (mon.0) 194 : cluster [WRN] Health check failed: Degraded data redundancy: 2/334 objects degraded (0.599%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706102 2022-02-25 17:02:39 2022-02-26 19:18:29 2022-02-26 20:07:33 0:49:04 0:41:02 0:08:02 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6706103 2022-02-25 17:02:40 2022-02-26 19:18:49 2022-02-26 19:37:57 0:19:08 0:08:20 0:10:48 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706104 2022-02-25 17:02:41 2022-02-26 19:20:30 2022-02-26 20:10:42 0:50:12 0:40:21 0:09:51 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
fail 6706105 2022-02-25 17:02:43 2022-02-26 19:21:30 2022-02-26 19:47:44 0:26:14 0:15:05 0:11:09 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6706106 2022-02-25 17:02:44 2022-02-26 19:22:21 2022-02-26 20:19:47 0:57:26 0:48:10 0:09:16 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6706107 2022-02-25 17:02:45 2022-02-26 19:22:51 2022-02-26 19:42:40 0:19:49 0:09:42 0:10:07 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6706108 2022-02-25 17:02:46 2022-02-26 19:23:42 2022-02-26 20:22:43 0:59:01 0:48:26 0:10:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706109 2022-02-25 17:02:47 2022-02-26 19:25:12 2022-02-26 19:58:41 0:33:29 0:22:57 0:10:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6706110 2022-02-25 17:02:48 2022-02-26 19:25:13 2022-02-26 19:56:52 0:31:39 0:20:42 0:10:57 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6706111 2022-02-25 17:02:49 2022-02-26 19:27:23 2022-02-26 20:33:09 1:05:46 0:54:38 0:11:08 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706112 2022-02-25 17:02:50 2022-02-26 19:27:34 2022-02-26 20:20:49 0:53:15 0:43:40 0:09:35 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6706113 2022-02-25 17:02:51 2022-02-26 19:27:34 2022-02-26 20:06:28 0:38:54 0:29:39 0:09:15 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6706114 2022-02-25 17:02:52 2022-02-26 19:27:34 2022-02-26 20:07:30 0:39:56 0:27:17 0:12:39 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
fail 6706115 2022-02-25 17:02:53 2022-02-26 19:29:55 2022-02-26 20:00:14 0:30:19 0:18:57 0:11:22 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

"2022-02-26T19:47:54.082460+0000 mon.a (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706116 2022-02-25 17:02:54 2022-02-26 19:31:05 2022-02-26 20:36:26 1:05:21 0:55:47 0:09:34 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6706117 2022-02-25 17:02:55 2022-02-26 19:31:06 2022-02-26 20:10:59 0:39:53 0:29:52 0:10:01 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6706118 2022-02-25 17:02:56 2022-02-26 19:31:56 2022-02-26 20:34:35 1:02:39 0:50:56 0:11:43 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706119 2022-02-25 17:02:57 2022-02-26 19:32:47 2022-02-26 20:45:15 1:12:28 1:01:46 0:10:42 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706120 2022-02-25 17:02:58 2022-02-26 19:33:57 2022-02-26 19:55:46 0:21:49 0:11:16 0:10:33 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706121 2022-02-25 17:03:00 2022-02-26 19:34:27 2022-02-26 20:04:16 0:29:49 0:19:52 0:09:57 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6706122 2022-02-25 17:03:01 2022-02-26 19:34:28 2022-02-26 20:32:15 0:57:47 0:47:09 0:10:38 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6706123 2022-02-25 17:03:02 2022-02-26 19:34:48 2022-02-26 20:02:20 0:27:32 0:16:40 0:10:52 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
Failure Reason:

"2022-02-26T19:49:59.065984+0000 mon.a (mon.0) 100 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706124 2022-02-25 17:03:03 2022-02-26 19:34:48 2022-02-26 20:08:04 0:33:16 0:20:48 0:12:28 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6706125 2022-02-25 17:03:04 2022-02-26 19:36:09 2022-02-26 20:37:10 1:01:01 0:49:16 0:11:45 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706126 2022-02-25 17:03:05 2022-02-26 19:37:59 2022-02-26 20:09:41 0:31:42 0:21:39 0:10:03 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6706127 2022-02-25 17:03:06 2022-02-26 19:38:50 2022-02-26 20:31:42 0:52:52 0:42:57 0:09:55 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6706128 2022-02-25 17:03:07 2022-02-26 19:40:21 2022-02-26 20:11:49 0:31:28 0:21:57 0:09:31 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6706129 2022-02-25 17:03:08 2022-02-26 19:40:41 2022-02-26 20:34:14 0:53:33 0:43:44 0:09:49 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6706130 2022-02-25 17:03:09 2022-02-26 19:40:41 2022-02-26 20:45:36 1:04:55 0:53:52 0:11:03 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6706131 2022-02-25 17:03:10 2022-02-26 19:42:42 2022-02-26 20:01:29 0:18:47 0:07:43 0:11:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6706132 2022-02-25 17:03:11 2022-02-26 19:44:12 2022-02-26 20:23:41 0:39:29 0:29:35 0:09:54 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6706133 2022-02-25 17:03:12 2022-02-26 19:44:13 2022-02-26 20:31:33 0:47:20 0:37:10 0:10:10 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6706134 2022-02-25 17:03:13 2022-02-26 19:44:13 2022-02-26 20:24:59 0:40:46 0:29:05 0:11:41 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706135 2022-02-25 17:03:14 2022-02-26 19:45:13 2022-02-26 20:40:52 0:55:39 0:46:17 0:09:22 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706136 2022-02-25 17:03:15 2022-02-26 19:45:14 2022-02-26 20:50:20 1:05:06 0:56:02 0:09:04 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6706137 2022-02-25 17:03:17 2022-02-26 19:45:24 2022-02-26 20:25:54 0:40:30 0:30:21 0:10:09 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6706138 2022-02-25 17:03:18 2022-02-26 19:45:25 2022-02-26 20:44:59 0:59:34 0:47:15 0:12:19 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706139 2022-02-25 17:03:19 2022-02-26 19:47:45 2022-02-26 20:12:49 0:25:04 0:16:00 0:09:04 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 6706140 2022-02-25 17:03:20 2022-02-26 19:47:56 2022-02-26 20:34:47 0:46:51 0:36:41 0:10:10 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-02-26T20:08:12.884240+0000 mon.a (mon.0) 237 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1324 objects degraded (0.076%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706141 2022-02-25 17:03:21 2022-02-26 19:49:46 2022-02-26 20:13:07 0:23:21 0:11:02 0:12:19 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6706142 2022-02-25 17:03:22 2022-02-26 19:50:37 2022-02-26 20:40:18 0:49:41 0:40:12 0:09:29 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
fail 6706143 2022-02-25 17:03:23 2022-02-26 19:50:37 2022-02-26 20:08:25 0:17:48 0:07:40 0:10:08 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6706144 2022-02-25 17:03:24 2022-02-26 19:51:07 2022-02-26 20:51:09 1:00:02 0:50:11 0:09:51 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706145 2022-02-25 17:03:25 2022-02-26 19:51:58 2022-02-26 20:24:52 0:32:54 0:22:59 0:09:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
fail 6706146 2022-02-25 17:03:26 2022-02-26 19:54:18 2022-02-26 20:20:28 0:26:10 0:15:04 0:11:06 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
Failure Reason:

"2022-02-26T20:09:16.441333+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706147 2022-02-25 17:03:27 2022-02-26 19:54:59 2022-02-26 20:46:27 0:51:28 0:42:40 0:08:48 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6706148 2022-02-25 17:03:28 2022-02-26 19:55:29 2022-02-26 20:26:46 0:31:17 0:22:15 0:09:02 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6706149 2022-02-25 17:03:29 2022-02-26 19:55:50 2022-02-26 20:57:41 1:01:51 0:52:17 0:09:34 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6706150 2022-02-25 17:03:30 2022-02-26 19:56:10 2022-02-26 20:37:07 0:40:57 0:29:39 0:11:18 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6706151 2022-02-25 17:03:32 2022-02-26 19:56:21 2022-02-26 20:44:31 0:48:10 0:37:56 0:10:14 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706152 2022-02-25 17:03:33 2022-02-26 19:57:01 2022-02-26 20:34:48 0:37:47 0:28:28 0:09:19 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706153 2022-02-25 17:03:34 2022-02-26 19:57:21 2022-02-26 20:56:45 0:59:24 0:49:04 0:10:20 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706154 2022-02-25 17:03:35 2022-02-26 19:57:22 2022-02-26 20:40:29 0:43:07 0:30:54 0:12:13 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
fail 6706155 2022-02-25 17:03:36 2022-02-26 19:58:42 2022-02-26 20:59:14 1:00:32 0:48:23 0:12:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

Found coredumps on ubuntu@smithi119.front.sepia.ceph.com

pass 6706156 2022-02-25 17:03:37 2022-02-26 19:59:43 2022-02-26 21:04:58 1:05:15 0:56:26 0:08:49 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} 1
pass 6706157 2022-02-25 17:03:38 2022-02-26 19:59:53 2022-02-26 20:37:50 0:37:57 0:28:18 0:09:39 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6706158 2022-02-25 17:03:39 2022-02-26 20:00:23 2022-02-26 20:24:39 0:24:16 0:13:59 0:10:17 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6706159 2022-02-25 17:03:40 2022-02-26 20:01:34 2022-02-26 20:55:10 0:53:36 0:44:42 0:08:54 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6706160 2022-02-25 17:03:41 2022-02-26 20:02:04 2022-02-26 20:22:02 0:19:58 0:09:23 0:10:35 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6706161 2022-02-25 17:03:42 2022-02-26 20:02:25 2022-02-26 20:52:10 0:49:45 0:40:21 0:09:24 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
fail 6706162 2022-02-25 17:03:43 2022-02-26 20:02:45 2022-02-26 20:27:13 0:24:28 0:14:15 0:10:13 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi146 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

fail 6706163 2022-02-25 17:03:44 2022-02-26 20:03:36 2022-02-26 20:21:17 0:17:41 0:07:33 0:10:08 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6706164 2022-02-25 17:03:45 2022-02-26 20:03:56 2022-02-26 21:04:04 1:00:08 0:49:41 0:10:27 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706165 2022-02-25 17:03:46 2022-02-26 20:04:16 2022-02-26 20:33:31 0:29:15 0:20:11 0:09:04 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6706166 2022-02-25 17:03:47 2022-02-26 20:04:17 2022-02-26 21:05:46 1:01:29 0:49:08 0:12:21 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706167 2022-02-25 17:03:48 2022-02-26 20:06:37 2022-02-26 21:14:22 1:07:45 0:58:27 0:09:18 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706168 2022-02-25 17:03:49 2022-02-26 20:06:48 2022-02-26 21:01:49 0:55:01 0:45:46 0:09:15 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 1
pass 6706169 2022-02-25 17:03:50 2022-02-26 20:07:18 2022-02-26 21:08:51 1:01:33 0:52:40 0:08:53 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6706170 2022-02-25 17:03:51 2022-02-26 20:07:38 2022-02-26 20:56:58 0:49:20 0:39:07 0:10:13 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6706171 2022-02-25 17:03:52 2022-02-26 20:07:39 2022-02-26 20:45:30 0:37:51 0:28:15 0:09:36 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6706172 2022-02-25 17:03:53 2022-02-26 20:08:09 2022-02-26 21:09:18 1:01:09 0:51:21 0:09:48 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706173 2022-02-25 17:03:54 2022-02-26 20:08:30 2022-02-26 20:50:34 0:42:04 0:31:42 0:10:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6706174 2022-02-25 17:03:55 2022-02-26 20:09:30 2022-02-26 21:14:46 1:05:16 0:56:25 0:08:51 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
pass 6706175 2022-02-25 17:03:56 2022-02-26 20:09:50 2022-02-26 20:49:47 0:39:57 0:28:47 0:11:10 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6706176 2022-02-25 17:03:58 2022-02-26 20:10:11 2022-02-26 20:36:00 0:25:49 0:15:56 0:09:53 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 6706177 2022-02-25 17:03:59 2022-02-26 20:10:51 2022-02-26 21:22:33 1:11:42 1:00:32 0:11:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

Found coredumps on ubuntu@smithi169.front.sepia.ceph.com

pass 6706178 2022-02-25 17:04:00 2022-02-26 20:11:02 2022-02-26 20:32:10 0:21:08 0:11:46 0:09:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6706179 2022-02-25 17:04:01 2022-02-26 20:11:12 2022-02-26 20:28:45 0:17:33 0:08:40 0:08:53 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6706180 2022-02-25 17:04:02 2022-02-26 20:11:22 2022-02-26 20:59:28 0:48:06 0:38:15 0:09:51 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6706181 2022-02-25 17:04:03 2022-02-26 20:11:53 2022-02-26 20:43:32 0:31:39 0:21:44 0:09:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6706182 2022-02-25 17:04:04 2022-02-26 20:12:33 2022-02-26 21:11:50 0:59:17 0:48:58 0:10:19 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6706183 2022-02-25 17:04:05 2022-02-26 20:12:54 2022-02-26 20:33:41 0:20:47 0:09:50 0:10:57 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
fail 6706184 2022-02-25 17:04:06 2022-02-26 20:13:14 2022-02-26 20:46:44 0:33:30 0:22:30 0:11:00 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
Failure Reason:

Found coredumps on ubuntu@smithi167.front.sepia.ceph.com

pass 6706185 2022-02-25 17:04:07 2022-02-26 20:13:34 2022-02-26 21:11:16 0:57:42 0:47:31 0:10:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6706186 2022-02-25 17:04:09 2022-02-26 20:13:55 2022-02-26 20:45:02 0:31:07 0:22:43 0:08:24 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6706187 2022-02-25 17:04:10 2022-02-26 20:14:05 2022-02-26 20:41:28 0:27:23 0:14:55 0:12:28 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi176 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8122fe56dfc5c5edb9b4ddf1231b79ef0701fa66 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6706188 2022-02-25 17:04:11 2022-02-26 20:16:06 2022-02-26 21:25:21 1:09:15 0:56:11 0:13:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6706189 2022-02-25 17:04:12 2022-02-26 20:19:56 2022-02-26 21:14:47 0:54:51 0:46:06 0:08:45 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} 1
fail 6706190 2022-02-25 17:04:13 2022-02-26 20:20:07 2022-02-26 20:38:07 0:18:00 0:07:47 0:10:13 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6706191 2022-02-25 17:04:14 2022-02-26 20:20:17 2022-02-26 20:47:34 0:27:17 0:17:45 0:09:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
Failure Reason:

"2022-02-26T20:37:02.067702+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6706192 2022-02-25 17:04:15 2022-02-26 20:20:38 2022-02-26 21:10:51 0:50:13 0:38:39 0:11:34 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
fail 6706193 2022-02-25 17:04:16 2022-02-26 20:20:58 2022-02-26 20:48:15 0:27:17 0:17:45 0:09:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6706194 2022-02-25 17:04:17 2022-02-26 20:21:18 2022-02-26 21:19:20 0:58:02 0:48:37 0:09:25 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6706195 2022-02-25 17:04:18 2022-02-26 20:22:09 2022-02-26 21:21:55 0:59:46 0:49:18 0:10:28 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6706196 2022-02-25 17:04:19 2022-02-26 20:22:49 2022-02-26 21:27:46 1:04:57 0:55:34 0:09:23 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} 1
pass 6706197 2022-02-25 17:04:20 2022-02-26 20:23:00 2022-02-26 21:01:16 0:38:16 0:27:52 0:10:24 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2