Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6718352 2022-03-03 16:04:56 2022-03-03 20:02:19 2022-03-03 20:28:24 0:26:05 0:16:36 0:09:29 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6718353 2022-03-03 16:04:57 2022-03-03 20:03:19 2022-03-03 20:59:20 0:56:01 0:46:29 0:09:32 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6718354 2022-03-03 16:04:58 2022-03-03 20:04:00 2022-03-03 20:24:11 0:20:11 0:09:11 0:11:00 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718355 2022-03-03 16:04:59 2022-03-03 20:04:20 2022-03-03 20:25:38 0:21:18 0:10:02 0:11:16 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718356 2022-03-03 16:05:00 2022-03-03 20:06:41 2022-03-03 20:29:30 0:22:49 0:10:54 0:11:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718357 2022-03-03 16:05:01 2022-03-03 20:08:21 2022-03-03 21:06:43 0:58:22 0:47:26 0:10:56 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6718358 2022-03-03 16:05:02 2022-03-03 20:09:12 2022-03-03 20:29:54 0:20:42 0:09:52 0:10:50 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6718359 2022-03-03 16:05:03 2022-03-03 20:10:12 2022-03-03 21:08:04 0:57:52 0:48:11 0:09:41 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718360 2022-03-03 16:05:04 2022-03-03 20:10:43 2022-03-03 20:44:19 0:33:36 0:22:56 0:10:40 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718361 2022-03-03 16:05:05 2022-03-03 20:11:23 2022-03-03 21:09:32 0:58:09 0:48:08 0:10:01 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718362 2022-03-03 16:05:06 2022-03-03 20:11:43 2022-03-03 20:45:13 0:33:30 0:23:03 0:10:27 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6718363 2022-03-03 16:05:07 2022-03-03 20:12:04 2022-03-03 20:39:17 0:27:13 0:17:38 0:09:35 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-03-03T20:28:37.276848+0000 mon.a (mon.0) 95 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718364 2022-03-03 16:05:08 2022-03-03 20:12:14 2022-03-03 20:54:14 0:42:00 0:29:08 0:12:52 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6718365 2022-03-03 16:05:09 2022-03-03 20:13:25 2022-03-03 21:03:47 0:50:22 0:38:47 0:11:35 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718366 2022-03-03 16:05:10 2022-03-03 20:13:35 2022-03-03 20:52:35 0:39:00 0:30:33 0:08:27 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6718367 2022-03-03 16:05:11 2022-03-03 20:13:35 2022-03-03 21:11:57 0:58:22 0:47:12 0:11:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718368 2022-03-03 16:05:12 2022-03-03 20:14:26 2022-03-03 21:12:24 0:57:58 0:46:47 0:11:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718369 2022-03-03 16:05:13 2022-03-03 20:14:46 2022-03-03 21:22:31 1:07:45 0:57:00 0:10:45 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
fail 6718370 2022-03-03 16:05:14 2022-03-03 20:14:46 2022-03-03 20:33:31 0:18:45 0:09:53 0:08:52 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718371 2022-03-03 16:05:15 2022-03-03 20:15:07 2022-03-03 20:35:00 0:19:53 0:09:05 0:10:48 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718372 2022-03-03 16:05:16 2022-03-03 20:15:37 2022-03-03 21:08:44 0:53:07 0:39:58 0:13:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6718373 2022-03-03 16:05:17 2022-03-03 20:18:58 2022-03-03 20:50:19 0:31:21 0:20:13 0:11:08 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6718374 2022-03-03 16:05:18 2022-03-03 20:20:28 2022-03-03 21:23:05 1:02:37 0:48:17 0:14:20 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718375 2022-03-03 16:05:19 2022-03-03 20:22:39 2022-03-03 21:21:29 0:58:50 0:48:20 0:10:30 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
fail 6718376 2022-03-03 16:05:20 2022-03-03 20:23:30 2022-03-03 20:48:56 0:25:26 0:15:10 0:10:16 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
Failure Reason:

"2022-03-03T20:37:16.461128+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718377 2022-03-03 16:05:21 2022-03-03 20:23:40 2022-03-03 21:23:08 0:59:28 0:48:45 0:10:43 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718378 2022-03-03 16:05:22 2022-03-03 20:23:40 2022-03-03 21:32:13 1:08:33 0:57:22 0:11:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718379 2022-03-03 16:05:23 2022-03-03 20:24:21 2022-03-03 21:17:53 0:53:32 0:43:36 0:09:56 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6718380 2022-03-03 16:05:24 2022-03-03 20:24:31 2022-03-03 20:42:52 0:18:21 0:07:43 0:10:38 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718381 2022-03-03 16:05:25 2022-03-03 20:25:41 2022-03-03 21:03:27 0:37:46 0:28:23 0:09:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
fail 6718382 2022-03-03 16:05:26 2022-03-03 20:25:52 2022-03-03 20:47:30 0:21:38 0:12:19 0:09:19 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=090c8419c748ee700b7ab0cdc033c1586ff3fa0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

pass 6718383 2022-03-03 16:05:27 2022-03-03 20:26:02 2022-03-03 21:05:42 0:39:40 0:30:10 0:09:30 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6718384 2022-03-03 16:05:28 2022-03-03 20:26:33 2022-03-03 21:26:00 0:59:27 0:49:28 0:09:59 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718385 2022-03-03 16:05:29 2022-03-03 20:27:03 2022-03-03 21:31:30 1:04:27 0:56:59 0:07:28 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 6718386 2022-03-03 16:05:30 2022-03-03 20:27:03 2022-03-03 21:27:23 1:00:20 0:49:47 0:10:33 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718387 2022-03-03 16:05:31 2022-03-03 20:28:14 2022-03-03 20:52:14 0:24:00 0:13:55 0:10:05 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6718388 2022-03-03 16:05:32 2022-03-03 20:28:34 2022-03-03 20:49:05 0:20:31 0:09:03 0:11:28 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718389 2022-03-03 16:05:32 2022-03-03 20:29:35 2022-03-03 20:48:30 0:18:55 0:10:10 0:08:45 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718390 2022-03-03 16:05:33 2022-03-03 20:29:35 2022-03-03 20:49:51 0:20:16 0:09:06 0:11:10 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718391 2022-03-03 16:05:34 2022-03-03 20:29:55 2022-03-03 21:20:11 0:50:16 0:38:59 0:11:17 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718392 2022-03-03 16:05:35 2022-03-03 20:31:16 2022-03-03 21:00:40 0:29:24 0:20:05 0:09:19 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6718393 2022-03-03 16:05:36 2022-03-03 20:31:16 2022-03-03 21:27:36 0:56:20 0:46:35 0:09:45 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718394 2022-03-03 16:05:37 2022-03-03 20:31:46 2022-03-03 21:02:28 0:30:42 0:19:43 0:10:59 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718395 2022-03-03 16:05:38 2022-03-03 20:33:37 2022-03-03 21:07:04 0:33:27 0:22:43 0:10:44 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6718396 2022-03-03 16:05:39 2022-03-03 20:34:17 2022-03-03 21:03:28 0:29:11 0:20:27 0:08:44 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6718397 2022-03-03 16:05:40 2022-03-03 20:34:28 2022-03-03 21:40:36 1:06:08 0:55:09 0:10:59 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718398 2022-03-03 16:05:41 2022-03-03 20:35:08 2022-03-03 21:29:19 0:54:11 0:43:36 0:10:35 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6718399 2022-03-03 16:05:42 2022-03-03 20:35:08 2022-03-03 20:53:03 0:17:55 0:08:15 0:09:40 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718400 2022-03-03 16:05:43 2022-03-03 20:35:39 2022-03-03 21:15:23 0:39:44 0:29:59 0:09:45 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
fail 6718401 2022-03-03 16:05:44 2022-03-03 20:36:19 2022-03-03 21:02:16 0:25:57 0:15:08 0:10:49 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
Failure Reason:

"2022-03-03T20:51:05.543510+0000 mon.a (mon.0) 94 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718402 2022-03-03 16:05:45 2022-03-03 20:36:50 2022-03-03 21:42:16 1:05:26 0:55:50 0:09:36 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 6718403 2022-03-03 16:05:46 2022-03-03 20:37:20 2022-03-03 21:17:29 0:40:09 0:29:47 0:10:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
fail 6718404 2022-03-03 16:05:47 2022-03-03 20:38:21 2022-03-03 21:36:12 0:57:51 0:48:05 0:09:46 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

"2022-03-03T20:55:22.661708+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718405 2022-03-03 16:05:48 2022-03-03 20:38:31 2022-03-03 21:47:24 1:08:53 0:56:49 0:12:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718406 2022-03-03 16:05:49 2022-03-03 20:39:21 2022-03-03 21:03:14 0:23:53 0:11:17 0:12:36 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718407 2022-03-03 16:05:50 2022-03-03 20:42:12 2022-03-03 21:01:37 0:19:25 0:09:58 0:09:27 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718408 2022-03-03 16:05:51 2022-03-03 20:42:53 2022-03-03 21:03:52 0:20:59 0:09:07 0:11:52 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718409 2022-03-03 16:05:52 2022-03-03 20:44:23 2022-03-03 21:36:54 0:52:31 0:41:20 0:11:11 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718410 2022-03-03 16:05:53 2022-03-03 20:45:14 2022-03-03 21:18:27 0:33:13 0:22:51 0:10:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6718411 2022-03-03 16:05:54 2022-03-03 20:45:14 2022-03-03 21:38:55 0:53:41 0:44:30 0:09:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718412 2022-03-03 16:05:55 2022-03-03 20:45:24 2022-03-03 21:45:41 1:00:17 0:48:53 0:11:24 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718413 2022-03-03 16:05:56 2022-03-03 20:46:45 2022-03-03 21:17:05 0:30:20 0:19:36 0:10:44 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
fail 6718414 2022-03-03 16:05:57 2022-03-03 20:47:15 2022-03-03 21:10:47 0:23:32 0:12:38 0:10:54 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi135 with status 16: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=090c8419c748ee700b7ab0cdc033c1586ff3fa0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6718415 2022-03-03 16:05:58 2022-03-03 20:47:36 2022-03-03 21:41:51 0:54:15 0:43:32 0:10:43 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6718416 2022-03-03 16:05:59 2022-03-03 20:48:36 2022-03-03 21:50:18 1:01:42 0:51:11 0:10:31 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6718417 2022-03-03 16:06:00 2022-03-03 20:49:06 2022-03-03 21:26:14 0:37:08 0:27:40 0:09:28 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6718418 2022-03-03 16:06:01 2022-03-03 20:49:07 2022-03-03 21:38:46 0:49:39 0:39:01 0:10:38 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718419 2022-03-03 16:06:02 2022-03-03 20:49:27 2022-03-03 21:29:40 0:40:13 0:29:33 0:10:40 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6718420 2022-03-03 16:06:03 2022-03-03 20:49:57 2022-03-03 21:50:21 1:00:24 0:50:05 0:10:19 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718421 2022-03-03 16:06:04 2022-03-03 20:50:28 2022-03-03 21:29:55 0:39:27 0:27:42 0:11:45 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
fail 6718422 2022-03-03 16:06:05 2022-03-03 20:52:18 2022-03-03 21:51:47 0:59:29 0:49:11 0:10:18 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

"2022-03-03T21:11:47.441996+0000 mon.a (mon.0) 189 : cluster [WRN] Health check failed: Degraded data redundancy: 1/338 objects degraded (0.296%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718423 2022-03-03 16:06:06 2022-03-03 20:52:39 2022-03-03 21:56:54 1:04:15 0:56:52 0:07:23 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6718424 2022-03-03 16:06:07 2022-03-03 20:52:39 2022-03-03 21:34:03 0:41:24 0:31:16 0:10:08 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6718425 2022-03-03 16:06:08 2022-03-03 20:53:09 2022-03-03 21:51:43 0:58:34 0:47:19 0:11:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718426 2022-03-03 16:06:09 2022-03-03 20:54:10 2022-03-03 21:21:19 0:27:09 0:14:39 0:12:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6718427 2022-03-03 16:06:10 2022-03-03 20:54:20 2022-03-03 21:48:51 0:54:31 0:42:32 0:11:59 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6718428 2022-03-03 16:06:11 2022-03-03 20:55:21 2022-03-03 22:03:48 1:08:27 0:57:49 0:10:38 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718429 2022-03-03 16:06:12 2022-03-03 20:56:51 2022-03-03 21:18:41 0:21:50 0:08:53 0:12:57 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718430 2022-03-03 16:06:13 2022-03-03 20:59:12 2022-03-03 21:24:48 0:25:36 0:15:11 0:10:25 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6718431 2022-03-03 16:06:14 2022-03-03 20:59:22 2022-03-03 21:32:36 0:33:14 0:23:01 0:10:13 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
fail 6718432 2022-03-03 16:06:15 2022-03-03 20:59:33 2022-03-03 22:01:59 1:02:26 0:51:54 0:10:32 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

"2022-03-03T21:19:23.632537+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 1/338 objects degraded (0.296%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6718433 2022-03-03 16:06:16 2022-03-03 21:00:43 2022-03-03 21:31:46 0:31:03 0:20:20 0:10:43 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718434 2022-03-03 16:06:17 2022-03-03 21:01:44 2022-03-03 21:32:31 0:30:47 0:22:10 0:08:37 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6718435 2022-03-03 16:06:18 2022-03-03 21:01:44 2022-03-03 22:05:31 1:03:47 0:54:36 0:09:11 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718436 2022-03-03 16:06:19 2022-03-03 21:02:24 2022-03-03 21:57:15 0:54:51 0:46:00 0:08:51 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} 1
pass 6718437 2022-03-03 16:06:20 2022-03-03 21:02:25 2022-03-03 22:05:18 1:02:53 0:53:57 0:08:56 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6718438 2022-03-03 16:06:21 2022-03-03 21:02:35 2022-03-03 21:24:18 0:21:43 0:10:09 0:11:34 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718439 2022-03-03 16:06:22 2022-03-03 21:03:15 2022-03-03 21:42:22 0:39:07 0:30:19 0:08:48 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6718440 2022-03-03 16:06:23 2022-03-03 21:03:36 2022-03-03 21:51:12 0:47:36 0:38:21 0:09:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6718441 2022-03-03 16:06:24 2022-03-03 21:03:36 2022-03-03 21:44:47 0:41:11 0:30:58 0:10:13 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6718442 2022-03-03 16:06:25 2022-03-03 21:03:36 2022-03-03 22:03:03 0:59:27 0:49:01 0:10:26 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718443 2022-03-03 16:06:26 2022-03-03 21:03:57 2022-03-03 22:08:45 1:04:48 0:55:35 0:09:13 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6718444 2022-03-03 16:06:27 2022-03-03 21:03:57 2022-03-03 21:28:57 0:25:00 0:13:49 0:11:11 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6718445 2022-03-03 16:06:28 2022-03-03 21:03:57 2022-03-03 22:15:00 1:11:03 0:59:19 0:11:44 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6718446 2022-03-03 16:06:29 2022-03-03 21:05:48 2022-03-03 21:25:03 0:19:15 0:07:37 0:11:38 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6718447 2022-03-03 16:06:30 2022-03-03 21:06:48 2022-03-03 21:54:39 0:47:51 0:37:47 0:10:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=090c8419c748ee700b7ab0cdc033c1586ff3fa0d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

fail 6718448 2022-03-03 16:06:31 2022-03-03 21:07:09 2022-03-03 21:27:02 0:19:53 0:10:13 0:09:40 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6718449 2022-03-03 16:06:32 2022-03-03 21:08:09 2022-03-03 21:42:08 0:33:59 0:22:43 0:11:16 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718450 2022-03-03 16:06:33 2022-03-03 21:08:50 2022-03-03 22:03:59 0:55:09 0:43:01 0:12:08 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6718451 2022-03-03 16:06:34 2022-03-03 21:09:40 2022-03-03 21:41:36 0:31:56 0:22:24 0:09:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6718452 2022-03-03 16:06:35 2022-03-03 21:10:51 2022-03-03 22:04:01 0:53:10 0:43:44 0:09:26 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6718453 2022-03-03 16:06:36 2022-03-03 21:10:51 2022-03-03 21:31:00 0:20:09 0:09:50 0:10:19 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718454 2022-03-03 16:06:37 2022-03-03 21:12:01 2022-03-03 22:11:42 0:59:41 0:50:11 0:09:30 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718455 2022-03-03 16:06:38 2022-03-03 21:12:32 2022-03-03 22:18:23 1:05:51 0:55:06 0:10:45 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6718456 2022-03-03 16:06:39 2022-03-03 21:15:32 2022-03-03 21:55:11 0:39:39 0:27:53 0:11:46 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6718457 2022-03-03 16:06:40 2022-03-03 21:17:13 2022-03-03 22:18:54 1:01:41 0:51:29 0:10:12 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718458 2022-03-03 16:06:41 2022-03-03 21:17:33 2022-03-03 21:43:00 0:25:27 0:16:46 0:08:41 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6718459 2022-03-03 16:06:42 2022-03-03 21:18:04 2022-03-03 22:10:35 0:52:31 0:41:05 0:11:26 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6718460 2022-03-03 16:06:43 2022-03-03 21:18:24 2022-03-03 21:38:02 0:19:38 0:09:07 0:10:31 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718461 2022-03-03 16:06:44 2022-03-03 21:18:34 2022-03-03 21:36:20 0:17:46 0:07:36 0:10:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718462 2022-03-03 16:06:45 2022-03-03 21:18:45 2022-03-03 21:37:34 0:18:49 0:08:17 0:10:32 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718463 2022-03-03 16:06:46 2022-03-03 21:20:15 2022-03-03 22:13:52 0:53:37 0:40:37 0:13:00 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718464 2022-03-03 16:06:47 2022-03-03 21:21:26 2022-03-03 21:53:04 0:31:38 0:22:17 0:09:21 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6718465 2022-03-03 16:06:48 2022-03-03 21:21:36 2022-03-03 22:21:43 1:00:07 0:47:43 0:12:24 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718466 2022-03-03 16:06:49 2022-03-03 21:23:07 2022-03-03 22:22:14 0:59:07 0:49:34 0:09:33 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6718467 2022-03-03 16:06:50 2022-03-03 21:23:17 2022-03-03 22:21:44 0:58:27 0:48:26 0:10:01 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718468 2022-03-03 16:06:51 2022-03-03 21:24:28 2022-03-03 21:55:55 0:31:27 0:21:36 0:09:51 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6718469 2022-03-03 16:06:52 2022-03-03 21:24:58 2022-03-03 22:09:53 0:44:55 0:35:03 0:09:52 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6718470 2022-03-03 16:06:53 2022-03-03 21:24:58 2022-03-03 21:55:17 0:30:19 0:19:21 0:10:58 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6718471 2022-03-03 16:06:54 2022-03-03 21:25:09 2022-03-03 22:19:17 0:54:08 0:43:40 0:10:28 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6718472 2022-03-03 16:06:55 2022-03-03 21:25:09 2022-03-03 22:03:37 0:38:28 0:28:13 0:10:15 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
dead 6718473 2022-03-03 16:06:56 2022-03-03 21:26:09 2022-03-03 21:44:24 0:18:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

dead 6718474 2022-03-03 16:06:57 2022-03-03 21:26:20 2022-03-03 21:40:22 0:14:02 0:03:55 0:10:07 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
Failure Reason:

{'smithi008.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'upgrade': None}}, 'msg': 'Failed to update apt cache: '}}

pass 6718475 2022-03-03 16:06:58 2022-03-03 21:27:10 2022-03-03 22:32:36 1:05:26 0:55:37 0:09:49 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} 1
pass 6718476 2022-03-03 16:06:59 2022-03-03 21:27:30 2022-03-03 22:06:58 0:39:28 0:30:20 0:09:08 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6718477 2022-03-03 16:07:00 2022-03-03 21:27:41 2022-03-03 22:27:25 0:59:44 0:47:37 0:12:07 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 6718478 2022-03-03 16:07:01 2022-03-03 21:29:01 2022-03-03 21:55:43 0:26:42 0:14:42 0:12:00 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
Failure Reason:

"2022-03-03T21:47:19.624514+0000 mon.a (mon.0) 184 : cluster [WRN] Health check failed: Degraded data redundancy: 1/112 objects degraded (0.893%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6718479 2022-03-03 16:07:02 2022-03-03 21:29:22 2022-03-03 22:29:46 1:00:24 0:49:03 0:11:21 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 6718480 2022-03-03 16:07:03 2022-03-03 21:29:42 2022-03-03 21:55:44 0:26:02 0:15:25 0:10:37 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6718481 2022-03-03 16:07:04 2022-03-03 21:30:02 2022-03-03 21:51:48 0:21:46 0:10:35 0:11:11 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718482 2022-03-03 16:07:05 2022-03-03 21:31:03 2022-03-03 21:52:48 0:21:45 0:11:04 0:10:41 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718483 2022-03-03 16:07:06 2022-03-03 21:31:53 2022-03-03 22:23:52 0:51:59 0:42:42 0:09:17 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6718484 2022-03-03 16:07:07 2022-03-03 21:32:24 2022-03-03 22:28:00 0:55:36 0:46:46 0:08:50 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6718485 2022-03-03 16:07:08 2022-03-03 21:32:34 2022-03-03 21:51:43 0:19:09 0:09:47 0:09:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6718486 2022-03-03 16:07:09 2022-03-03 21:32:44 2022-03-03 22:03:33 0:30:49 0:20:14 0:10:35 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718487 2022-03-03 16:07:10 2022-03-03 21:34:05 2022-03-03 22:05:45 0:31:40 0:20:32 0:11:08 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6718488 2022-03-03 16:07:11 2022-03-03 21:36:15 2022-03-03 22:07:23 0:31:08 0:21:34 0:09:34 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6718489 2022-03-03 16:07:12 2022-03-03 21:36:26 2022-03-03 22:31:00 0:54:34 0:46:14 0:08:20 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 1
pass 6718490 2022-03-03 16:07:13 2022-03-03 21:36:26 2022-03-03 22:40:35 1:04:09 0:53:42 0:10:27 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6718491 2022-03-03 16:07:15 2022-03-03 21:36:56 2022-03-03 22:14:07 0:37:11 0:28:12 0:08:59 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
fail 6718492 2022-03-03 16:07:16 2022-03-03 21:36:57 2022-03-03 22:03:02 0:26:05 0:15:30 0:10:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6718493 2022-03-03 16:07:17 2022-03-03 21:37:37 2022-03-03 22:43:18 1:05:41 0:56:14 0:09:27 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
pass 6718494 2022-03-03 16:07:18 2022-03-03 21:38:08 2022-03-03 22:18:40 0:40:32 0:28:54 0:11:38 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6718495 2022-03-03 16:07:19 2022-03-03 21:38:48 2022-03-03 22:38:03 0:59:15 0:49:57 0:09:18 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6718496 2022-03-03 16:07:20 2022-03-03 21:38:58 2022-03-03 22:03:38 0:24:40 0:14:27 0:10:13 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6718497 2022-03-03 16:07:21 2022-03-03 21:40:29 2022-03-03 22:01:41 0:21:12 0:11:58 0:09:14 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6718498 2022-03-03 16:07:22 2022-03-03 21:40:39 2022-03-03 21:59:02 0:18:23 0:07:51 0:10:32 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718499 2022-03-03 16:07:23 2022-03-03 21:41:40 2022-03-03 22:02:53 0:21:13 0:11:41 0:09:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6718500 2022-03-03 16:07:24 2022-03-03 21:42:00 2022-03-03 22:11:50 0:29:50 0:18:58 0:10:52 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
fail 6718501 2022-03-03 16:07:25 2022-03-03 21:42:10 2022-03-03 21:59:30 0:17:20 0:07:07 0:10:13 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6718502 2022-03-03 16:07:26 2022-03-03 21:42:31 2022-03-03 22:14:04 0:31:33 0:23:06 0:08:27 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6718503 2022-03-03 16:07:27 2022-03-03 21:43:01 2022-03-03 22:32:29 0:49:28 0:39:08 0:10:20 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6718504 2022-03-03 16:07:28 2022-03-03 21:43:12 2022-03-03 22:47:28 1:04:16 0:53:45 0:10:31 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6718505 2022-03-03 16:07:29 2022-03-03 21:44:42 2022-03-03 22:38:03 0:53:21 0:43:36 0:09:45 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6718506 2022-03-03 16:07:30 2022-03-03 21:44:42 2022-03-03 22:46:03 1:01:21 0:52:01 0:09:20 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6718507 2022-03-03 16:07:31 2022-03-03 21:44:53 2022-03-03 22:03:02 0:18:09 0:07:10 0:10:59 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6718508 2022-03-03 16:07:32 2022-03-03 21:45:43 2022-03-03 22:28:41 0:42:58 0:31:03 0:11:55 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6718509 2022-03-03 16:07:33 2022-03-03 21:47:34 2022-03-03 22:46:50 0:59:16 0:47:42 0:11:34 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6718510 2022-03-03 16:07:34 2022-03-03 21:48:54 2022-03-03 22:31:41 0:42:47 0:31:58 0:10:49 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6718511 2022-03-03 16:07:35 2022-03-03 21:50:25 2022-03-03 22:55:30 1:05:05 0:55:30 0:09:35 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} 1
pass 6718512 2022-03-03 16:07:36 2022-03-03 21:50:25 2022-03-03 22:28:51 0:38:26 0:28:04 0:10:22 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6718513 2022-03-03 16:07:37 2022-03-03 21:51:16 2022-03-03 22:53:14 1:01:58 0:50:49 0:11:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2