Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6669329 2022-02-08 11:19:37 2022-02-09 03:30:58 2022-02-09 04:05:30 0:34:32 0:28:16 0:06:16 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-ha-workunit} 2
pass 6669330 2022-02-08 11:19:38 2022-02-09 03:30:58 2022-02-09 04:18:12 0:47:14 0:37:16 0:09:58 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6669331 2022-02-08 11:19:39 2022-02-09 03:30:59 2022-02-09 04:47:46 1:16:47 1:10:05 0:06:42 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669332 2022-02-08 11:19:40 2022-02-09 03:30:59 2022-02-09 03:50:11 0:19:12 0:09:24 0:09:48 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6669333 2022-02-08 11:19:41 2022-02-09 03:31:00 2022-02-09 03:58:16 0:27:16 0:20:56 0:06:20 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6669334 2022-02-08 11:19:42 2022-02-09 03:31:00 2022-02-09 04:00:36 0:29:36 0:22:40 0:06:56 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6669335 2022-02-08 11:19:43 2022-02-09 03:31:31 2022-02-09 04:21:16 0:49:45 0:39:53 0:09:52 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6669336 2022-02-08 11:19:44 2022-02-09 03:31:31 2022-02-09 04:10:48 0:39:17 0:33:25 0:05:52 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6669337 2022-02-08 11:19:45 2022-02-09 03:31:51 2022-02-09 04:24:50 0:52:59 0:46:45 0:06:14 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6669338 2022-02-08 11:19:46 2022-02-09 03:32:02 2022-02-09 03:49:32 0:17:30 0:07:14 0:10:16 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6669339 2022-02-08 11:19:47 2022-02-09 03:32:12 2022-02-09 04:31:23 0:59:11 0:52:25 0:06:46 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6669340 2022-02-08 11:19:48 2022-02-09 03:32:23 2022-02-09 04:11:20 0:38:57 0:33:34 0:05:23 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
fail 6669341 2022-02-08 11:19:49 2022-02-09 03:32:33 2022-02-09 03:57:52 0:25:19 0:15:11 0:10:08 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

"2022-02-09T03:46:29.967329+0000 mon.a (mon.0) 91 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6669342 2022-02-08 11:19:50 2022-02-09 03:32:33 2022-02-09 04:02:04 0:29:31 0:20:08 0:09:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6669343 2022-02-08 11:19:51 2022-02-09 03:32:44 2022-02-09 04:20:18 0:47:34 0:40:09 0:07:25 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-02-09T03:46:23.723382+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: Degraded data redundancy: 3/2810 objects degraded (0.107%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6669344 2022-02-08 11:19:52 2022-02-09 03:32:54 2022-02-09 04:01:53 0:28:59 0:20:16 0:08:43 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6669345 2022-02-08 11:19:53 2022-02-09 03:33:44 2022-02-09 04:37:27 1:03:43 0:54:06 0:09:37 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669346 2022-02-08 11:19:54 2022-02-09 03:33:55 2022-02-09 04:37:05 1:03:10 0:57:08 0:06:02 smithi master rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} 1
pass 6669347 2022-02-08 11:19:55 2022-02-09 03:34:25 2022-02-09 04:45:10 1:10:45 1:05:32 0:05:13 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6669348 2022-02-08 11:19:56 2022-02-09 03:34:35 2022-02-09 04:00:10 0:25:35 0:16:26 0:09:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6669349 2022-02-08 11:19:57 2022-02-09 03:34:46 2022-02-09 04:09:13 0:34:27 0:26:13 0:08:14 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6669350 2022-02-08 11:19:58 2022-02-09 03:35:06 2022-02-09 04:32:44 0:57:38 0:49:53 0:07:45 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 6669351 2022-02-08 11:19:59 2022-02-09 03:35:16 2022-02-09 04:13:10 0:37:54 0:28:10 0:09:44 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6669352 2022-02-08 11:20:00 2022-02-09 03:35:37 2022-02-09 04:32:47 0:57:10 0:48:45 0:08:25 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6669353 2022-02-08 11:20:02 2022-02-09 03:35:37 2022-02-09 04:10:40 0:35:03 0:28:49 0:06:14 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
fail 6669354 2022-02-08 11:20:03 2022-02-09 03:35:37 2022-02-09 04:04:53 0:29:16 0:18:54 0:10:22 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi073 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'

pass 6669355 2022-02-08 11:20:04 2022-02-09 03:35:38 2022-02-09 04:38:58 1:03:20 0:57:20 0:06:00 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6669356 2022-02-08 11:20:05 2022-02-09 03:35:38 2022-02-09 04:10:52 0:35:14 0:29:18 0:05:56 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6669357 2022-02-08 11:20:06 2022-02-09 03:35:48 2022-02-09 04:33:19 0:57:31 0:48:03 0:09:28 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6669358 2022-02-08 11:20:07 2022-02-09 03:35:49 2022-02-09 03:56:51 0:21:02 0:14:32 0:06:30 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6669359 2022-02-08 11:20:08 2022-02-09 03:35:49 2022-02-09 04:34:54 0:59:05 0:52:05 0:07:00 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6669360 2022-02-08 11:20:09 2022-02-09 03:35:49 2022-02-09 04:50:59 1:15:10 1:08:37 0:06:33 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669361 2022-02-08 11:20:10 2022-02-09 03:36:00 2022-02-09 04:05:17 0:29:17 0:22:10 0:07:07 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6669362 2022-02-08 11:20:11 2022-02-09 03:36:10 2022-02-09 04:06:30 0:30:20 0:22:45 0:07:35 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6669363 2022-02-08 11:20:12 2022-02-09 03:36:20 2022-02-09 03:54:40 0:18:20 0:08:25 0:09:55 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
fail 6669364 2022-02-08 11:20:13 2022-02-09 03:36:31 2022-02-09 04:27:36 0:51:05 0:45:19 0:05:46 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi133 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6669365 2022-02-08 11:20:14 2022-02-09 03:36:31 2022-02-09 04:17:32 0:41:01 0:34:14 0:06:47 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6669366 2022-02-08 11:20:15 2022-02-09 03:36:31 2022-02-09 04:29:29 0:52:58 0:45:44 0:07:14 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6669367 2022-02-08 11:20:16 2022-02-09 03:36:32 2022-02-09 04:06:01 0:29:29 0:21:47 0:07:42 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6669368 2022-02-08 11:20:17 2022-02-09 03:37:02 2022-02-09 04:46:27 1:09:25 1:02:36 0:06:49 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6669369 2022-02-08 11:20:18 2022-02-09 03:37:13 2022-02-09 04:06:58 0:29:45 0:20:46 0:08:59 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6669370 2022-02-08 11:20:19 2022-02-09 03:37:13 2022-02-09 04:44:52 1:07:39 1:00:27 0:07:12 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6669371 2022-02-08 11:20:20 2022-02-09 03:37:23 2022-02-09 04:05:33 0:28:10 0:20:27 0:07:43 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6669372 2022-02-08 11:20:21 2022-02-09 03:38:14 2022-02-09 04:19:49 0:41:35 0:35:19 0:06:16 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
fail 6669373 2022-02-08 11:20:22 2022-02-09 03:38:54 2022-02-09 04:03:11 0:24:17 0:13:56 0:10:21 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6669374 2022-02-08 11:20:23 2022-02-09 03:39:05 2022-02-09 04:38:22 0:59:17 0:53:28 0:05:49 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669375 2022-02-08 11:20:24 2022-02-09 03:39:25 2022-02-09 04:42:17 1:02:52 0:56:59 0:05:53 smithi master rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} 1
pass 6669376 2022-02-08 11:20:25 2022-02-09 03:39:25 2022-02-09 04:51:02 1:11:37 1:04:30 0:07:07 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6669377 2022-02-08 11:20:26 2022-02-09 03:39:56 2022-02-09 04:07:42 0:27:46 0:20:43 0:07:03 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6669378 2022-02-08 11:20:27 2022-02-09 03:40:36 2022-02-09 04:28:46 0:48:10 0:40:10 0:08:00 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi123 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6669379 2022-02-08 11:20:28 2022-02-09 03:41:47 2022-02-09 04:25:39 0:43:52 0:35:45 0:08:07 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6669380 2022-02-08 11:20:29 2022-02-09 03:42:47 2022-02-09 04:20:33 0:37:46 0:27:47 0:09:59 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6669381 2022-02-08 11:20:30 2022-02-09 03:42:58 2022-02-09 04:55:52 1:12:54 1:05:11 0:07:43 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6669382 2022-02-08 11:20:31 2022-02-09 03:45:09 2022-02-09 04:20:56 0:35:47 0:28:38 0:07:09 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6669383 2022-02-08 11:20:32 2022-02-09 03:45:19 2022-02-09 04:43:24 0:58:05 0:48:49 0:09:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6669384 2022-02-08 11:20:33 2022-02-09 03:46:09 2022-02-09 04:44:59 0:58:50 0:53:30 0:05:20 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6669385 2022-02-08 11:20:34 2022-02-09 03:46:20 2022-02-09 04:21:36 0:35:16 0:28:26 0:06:50 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6669386 2022-02-08 11:20:35 2022-02-09 03:46:40 2022-02-09 04:43:16 0:56:36 0:47:42 0:08:54 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6669387 2022-02-08 11:20:36 2022-02-09 03:48:21 2022-02-09 04:10:37 0:22:16 0:13:57 0:08:19 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6669388 2022-02-08 11:20:37 2022-02-09 03:49:41 2022-02-09 04:46:50 0:57:09 0:50:40 0:06:29 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6669389 2022-02-08 11:20:38 2022-02-09 03:50:12 2022-02-09 04:57:46 1:07:34 0:57:38 0:09:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669390 2022-02-08 11:20:39 2022-02-09 03:50:12 2022-02-09 04:09:23 0:19:11 0:09:08 0:10:03 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6669391 2022-02-08 11:20:40 2022-02-09 03:50:13 2022-02-09 04:09:05 0:18:52 0:07:50 0:11:02 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6669392 2022-02-08 11:20:41 2022-02-09 03:54:13 2022-02-09 04:10:25 0:16:12 0:08:57 0:07:15 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6669393 2022-02-08 11:20:42 2022-02-09 03:54:44 2022-02-09 04:36:44 0:42:00 0:35:15 0:06:45 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6669394 2022-02-08 11:20:43 2022-02-09 03:55:34 2022-02-09 04:25:31 0:29:57 0:20:03 0:09:54 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6669395 2022-02-08 11:20:44 2022-02-09 03:56:15 2022-02-09 04:48:18 0:52:03 0:44:52 0:07:11 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6669396 2022-02-08 11:20:45 2022-02-09 03:56:55 2022-02-09 04:10:51 0:13:56 0:07:14 0:06:42 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
fail 6669397 2022-02-08 11:20:46 2022-02-09 03:57:56 2022-02-09 05:00:08 1:02:12 0:50:46 0:11:26 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

"2022-02-09T04:15:01.192178+0000 mon.a (mon.0) 190 : cluster [WRN] Health check failed: Degraded data redundancy: 1/338 objects degraded (0.296%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6669398 2022-02-08 11:20:48 2022-02-09 03:58:26 2022-02-09 04:23:03 0:24:37 0:15:42 0:08:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
Failure Reason:

"2022-02-09T04:11:32.683396+0000 mon.a (mon.0) 91 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6669399 2022-02-08 11:20:49 2022-02-09 04:00:16 2022-02-09 05:07:53 1:07:37 1:01:05 0:06:32 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6669400 2022-02-08 11:20:50 2022-02-09 04:00:37 2022-02-09 04:30:17 0:29:40 0:20:15 0:09:25 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6669401 2022-02-08 11:20:51 2022-02-09 04:01:57 2022-02-09 04:57:13 0:55:16 0:48:34 0:06:42 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-02-09T04:28:29.395240+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Degraded data redundancy: 7/2150 objects degraded (0.326%), 2 pgs degraded (PG_DEGRADED)" in cluster log

pass 6669402 2022-02-08 11:20:52 2022-02-09 04:02:08 2022-02-09 04:42:53 0:40:45 0:33:25 0:07:20 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6669403 2022-02-08 11:20:53 2022-02-09 04:03:18 2022-02-09 05:18:40 1:15:22 1:07:35 0:07:47 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6669404 2022-02-08 11:20:54 2022-02-09 04:04:49 2022-02-09 05:07:55 1:03:06 0:56:51 0:06:15 smithi master rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} 1
pass 6669405 2022-02-08 11:20:55 2022-02-09 04:04:49 2022-02-09 05:08:35 1:03:46 0:54:13 0:09:33 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6669406 2022-02-08 11:20:56 2022-02-09 04:04:49 2022-02-09 04:22:16 0:17:27 0:07:16 0:10:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6669407 2022-02-08 11:20:57 2022-02-09 04:05:00 2022-02-09 04:41:00 0:36:00 0:25:24 0:10:36 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi155 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40afecf6f1ffe83e8cef1e7e301bae8092e23c50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6669408 2022-02-08 11:20:58 2022-02-09 04:05:20 2022-02-09 04:53:20 0:48:00 0:38:31 0:09:29 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6669409 2022-02-08 11:20:59 2022-02-09 04:05:40 2022-02-09 04:54:22 0:48:42 0:42:55 0:05:47 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6669410 2022-02-08 11:21:00 2022-02-09 04:05:41 2022-02-09 05:03:36 0:57:55 0:47:36 0:10:19 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6669411 2022-02-08 11:21:01 2022-02-09 04:06:11 2022-02-09 04:42:40 0:36:29 0:28:14 0:08:15 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6669412 2022-02-08 11:21:02 2022-02-09 04:06:32 2022-02-09 05:18:15 1:11:43 1:04:29 0:07:14 smithi master rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6669413 2022-02-08 11:21:03 2022-02-09 04:07:02 2022-02-09 05:06:25 0:59:23 0:53:17 0:06:06 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6669414 2022-02-08 11:21:04 2022-02-09 04:07:43 2022-02-09 04:55:57 0:48:14 0:41:38 0:06:36 smithi master rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6669415 2022-02-08 11:21:05 2022-02-09 04:09:13 2022-02-09 05:05:23 0:56:10 0:48:54 0:07:16 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2