Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6009429 2021-03-29 07:13:54 2021-03-29 17:50:39 2021-03-29 18:09:42 0:19:03 0:10:17 0:08:46 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
fail 6009430 2021-03-29 07:13:55 2021-03-29 17:50:56 2021-03-29 18:40:05 0:49:09 0:39:10 0:09:59 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2021-03-29T18:09:40.152236+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: Degraded data redundancy: 64/4024 objects degraded (1.590%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6009431 2021-03-29 07:13:56 2021-03-29 17:50:57 2021-03-29 18:57:35 1:06:38 0:59:47 0:06:51 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6009432 2021-03-29 07:13:57 2021-03-29 17:50:57 2021-03-29 18:11:49 0:20:52 0:11:34 0:09:18 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_ha.sh) on smithi183 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a26d8e358fa57bb4aac67f2ddfe5db438ae1afe1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\' RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_ha.sh'

pass 6009433 2021-03-29 07:13:58 2021-03-29 17:50:57 2021-03-29 18:31:19 0:40:22 0:30:35 0:09:47 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6009434 2021-03-29 07:14:00 2021-03-29 17:50:58 2021-03-29 18:17:18 0:26:20 0:20:10 0:06:10 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6009435 2021-03-29 07:14:01 2021-03-29 17:50:58 2021-03-29 18:49:29 0:58:31 0:51:23 0:07:08 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009436 2021-03-29 07:14:16 2021-03-29 17:50:58 2021-03-29 18:16:45 0:25:47 0:16:41 0:09:06 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6009437 2021-03-29 07:14:23 2021-03-29 17:50:59 2021-03-29 18:51:16 1:00:17 0:50:12 0:10:05 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009438 2021-03-29 07:14:25 2021-03-29 17:51:00 2021-03-29 18:16:45 0:25:45 0:16:53 0:08:52 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6009439 2021-03-29 07:14:26 2021-03-29 17:51:00 2021-03-29 18:53:28 1:02:28 0:54:30 0:07:58 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

"2021-03-29T18:22:32.594348+0000 mon.a (mon.0) 599 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 31 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log

pass 6009440 2021-03-29 07:14:27 2021-03-29 17:51:01 2021-03-29 18:18:02 0:27:01 0:16:44 0:10:17 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6009441 2021-03-29 07:14:28 2021-03-29 17:51:01 2021-03-29 18:43:01 0:52:00 0:44:55 0:07:05 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6009442 2021-03-29 07:14:36 2021-03-29 17:51:02 2021-03-29 18:55:29 1:04:27 0:53:28 0:10:59 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6009443 2021-03-29 07:14:51 2021-03-29 17:51:02 2021-03-29 18:07:12 0:16:10 0:06:35 0:09:35 smithi master centos 8.3 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi144 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp'

pass 6009444 2021-03-29 07:15:04 2021-03-29 20:23:34 2021-03-29 21:31:08 1:07:34 0:56:56 0:10:38 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009445 2021-03-29 07:15:12 2021-03-29 20:23:54 2021-03-29 20:55:03 0:31:09 0:21:29 0:09:40 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6009446 2021-03-29 07:15:13 2021-03-29 20:24:04 2021-03-29 21:04:34 0:40:30 0:33:13 0:07:17 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 6009447 2021-03-29 07:15:14 2021-03-29 20:25:25 2021-03-29 20:54:33 0:29:08 0:20:28 0:08:40 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6009448 2021-03-29 07:15:15 2021-03-29 20:25:25 2021-03-29 21:22:57 0:57:32 0:47:40 0:09:52 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009449 2021-03-29 07:15:17 2021-03-29 20:25:55 2021-03-29 20:58:55 0:33:00 0:22:04 0:10:56 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6009450 2021-03-29 07:15:18 2021-03-29 20:25:56 2021-03-29 21:26:45 1:00:49 0:49:38 0:11:11 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009451 2021-03-29 07:15:19 2021-03-29 20:26:36 2021-03-29 21:29:50 1:03:14 0:53:31 0:09:43 smithi master centos 8.3 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
pass 6009452 2021-03-29 07:15:20 2021-03-29 20:26:56 2021-03-29 20:57:59 0:31:03 0:25:03 0:06:00 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6009453 2021-03-29 07:15:21 2021-03-29 20:26:57 2021-03-29 21:24:07 0:57:10 0:47:59 0:09:11 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009454 2021-03-29 07:16:12 2021-03-29 20:26:57 2021-03-29 20:48:33 0:21:36 0:10:27 0:11:09 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 6009455 2021-03-29 07:17:23 2021-03-29 20:27:07 2021-03-29 21:19:59 0:52:52 0:44:37 0:08:15 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6009456 2021-03-29 07:19:01 2021-03-29 20:28:58 2021-03-29 21:38:08 1:09:10 0:58:57 0:10:13 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009457 2021-03-29 07:20:19 2021-03-29 20:28:58 2021-03-29 20:55:45 0:26:47 0:15:24 0:11:23 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6009458 2021-03-29 07:20:22 2021-03-29 20:30:59 2021-03-29 21:10:43 0:39:44 0:29:16 0:10:28 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6009459 2021-03-29 07:20:33 2021-03-29 20:30:59 2021-03-29 20:58:30 0:27:31 0:16:53 0:10:38 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6009460 2021-03-29 07:20:34 2021-03-29 20:31:20 2021-03-29 21:28:45 0:57:25 0:47:07 0:10:18 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009461 2021-03-29 07:20:36 2021-03-29 20:31:20 2021-03-29 20:58:29 0:27:09 0:19:57 0:07:12 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6009462 2021-03-29 07:20:37 2021-03-29 20:31:21 2021-03-29 21:32:45 1:01:24 0:54:19 0:07:05 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009463 2021-03-29 07:20:38 2021-03-29 20:31:21 2021-03-29 20:58:47 0:27:26 0:16:27 0:10:59 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6009464 2021-03-29 07:20:39 2021-03-29 20:33:50 2021-03-29 21:35:02 1:01:12 0:51:22 0:09:50 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009465 2021-03-29 07:20:41 2021-03-29 20:33:50 2021-03-29 21:00:03 0:26:13 0:18:58 0:07:15 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6009466 2021-03-29 07:20:43 2021-03-29 20:34:41 2021-03-29 21:31:42 0:57:01 0:51:26 0:05:35 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009467 2021-03-29 07:20:45 2021-03-29 20:34:41 2021-03-29 21:33:41 0:59:00 0:50:19 0:08:41 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6009468 2021-03-29 07:20:46 2021-03-29 20:34:42 2021-03-29 21:25:43 0:51:01 0:44:49 0:06:12 smithi master rhel 8.3 rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} 1
pass 6009469 2021-03-29 07:20:47 2021-03-29 20:34:52 2021-03-29 21:26:07 0:51:15 0:45:39 0:05:36 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6009470 2021-03-29 07:20:48 2021-03-29 20:34:52 2021-03-29 21:07:02 0:32:10 0:25:06 0:07:04 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6009471 2021-03-29 07:20:50 2021-03-29 20:36:03 2021-03-29 21:44:07 1:08:04 0:59:59 0:08:05 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009472 2021-03-29 07:20:51 2021-03-29 20:36:33 2021-03-29 21:08:10 0:31:37 0:20:59 0:10:38 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
fail 6009473 2021-03-29 07:20:52 2021-03-29 20:36:54 2021-03-29 21:24:35 0:47:41 0:36:47 0:10:54 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 6009474 2021-03-29 07:20:55 2021-03-29 20:36:55 2021-03-29 21:08:00 0:31:05 0:21:33 0:09:32 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6009475 2021-03-29 07:20:57 2021-03-29 20:36:55 2021-03-29 21:32:45 0:55:50 0:49:44 0:06:06 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009476 2021-03-29 07:20:59 2021-03-29 20:37:36 2021-03-29 21:41:07 1:03:31 0:53:29 0:10:02 smithi master centos 8.3 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 6009477 2021-03-29 07:21:01 2021-03-29 20:37:46 2021-03-29 21:07:32 0:29:46 0:20:13 0:09:33 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6009478 2021-03-29 07:21:03 2021-03-29 20:37:57 2021-03-29 21:41:07 1:03:10 0:55:50 0:07:20 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009479 2021-03-29 07:21:05 2021-03-29 20:37:57 2021-03-29 20:58:50 0:20:53 0:10:10 0:10:43 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 6009480 2021-03-29 07:21:07 2021-03-29 20:39:48 2021-03-29 21:38:08 0:58:20 0:50:58 0:07:22 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 6009481 2021-03-29 07:21:09 2021-03-29 20:40:48 2021-03-29 21:32:07 0:51:19 0:40:26 0:10:53 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2021-03-29T21:00:26.538024+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Degraded data redundancy: 58/3202 objects degraded (1.811%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6009482 2021-03-29 07:21:11 2021-03-29 20:43:00 2021-03-29 21:09:32 0:26:32 0:14:53 0:11:39 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6009483 2021-03-29 07:21:13 2021-03-29 20:43:53 2021-03-29 21:50:15 1:06:22 0:55:02 0:11:20 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009484 2021-03-29 07:21:14 2021-03-29 20:44:03 2021-03-29 21:09:59 0:25:56 0:15:53 0:10:03 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6009485 2021-03-29 07:21:15 2021-03-29 20:44:54 2021-03-29 21:24:44 0:39:50 0:30:19 0:09:31 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6009486 2021-03-29 07:21:16 2021-03-29 20:44:54 2021-03-29 21:11:49 0:26:55 0:20:46 0:06:09 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6009487 2021-03-29 07:21:18 2021-03-29 20:44:54 2021-03-29 21:41:47 0:56:53 0:50:07 0:06:46 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009488 2021-03-29 07:21:20 2021-03-29 20:44:54 2021-03-29 21:14:18 0:29:24 0:16:31 0:12:53 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6009489 2021-03-29 07:21:22 2021-03-29 20:47:10 2021-03-29 21:49:47 1:02:37 0:51:09 0:11:28 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009490 2021-03-29 07:21:24 2021-03-29 20:47:30 2021-03-29 21:15:34 0:28:04 0:16:39 0:11:25 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6009491 2021-03-29 07:21:26 2021-03-29 20:48:41 2021-03-29 21:46:09 0:57:28 0:51:14 0:06:14 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009492 2021-03-29 07:21:27 2021-03-29 20:49:01 2021-03-29 21:53:08 1:04:07 0:56:46 0:07:21 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6009493 2021-03-29 07:21:29 2021-03-29 20:49:31 2021-03-29 21:41:08 0:51:37 0:41:43 0:09:54 smithi master centos 8.3 rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} 1
pass 6009494 2021-03-29 07:21:31 2021-03-29 20:49:42 2021-03-29 21:39:09 0:49:27 0:40:25 0:09:02 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6009495 2021-03-29 07:21:32 2021-03-29 20:49:42 2021-03-29 21:23:41 0:33:59 0:25:35 0:08:24 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6009496 2021-03-29 07:21:33 2021-03-29 20:51:53 2021-03-29 21:59:08 1:07:15 0:58:09 0:09:06 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009497 2021-03-29 07:21:34 2021-03-29 20:51:53 2021-03-29 21:22:48 0:30:55 0:24:20 0:06:35 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6009498 2021-03-29 07:21:35 2021-03-29 20:51:53 2021-03-29 21:33:08 0:41:15 0:34:53 0:06:22 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 6009499 2021-03-29 07:21:36 2021-03-29 20:52:04 2021-03-29 21:23:41 0:31:37 0:25:11 0:06:26 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6009500 2021-03-29 07:21:37 2021-03-29 20:52:44 2021-03-29 21:51:08 0:58:24 0:47:41 0:10:43 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009501 2021-03-29 07:21:39 2021-03-29 20:53:41 2021-03-29 21:59:10 1:05:29 0:56:23 0:09:06 smithi master centos 8.3 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 6009502 2021-03-29 07:21:40 2021-03-29 20:53:59 2021-03-29 21:25:41 0:31:42 0:20:48 0:10:54 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6009503 2021-03-29 07:21:41 2021-03-29 20:53:59 2021-03-29 21:56:15 1:02:16 0:54:14 0:08:02 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009504 2021-03-29 07:21:43 2021-03-29 20:54:39 2021-03-29 21:13:46 0:19:07 0:10:07 0:09:00 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 6009505 2021-03-29 07:21:45 2021-03-29 20:54:40 2021-03-29 21:54:21 0:59:41 0:53:03 0:06:38 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009506 2021-03-29 07:21:46 2021-03-29 20:55:10 2021-03-29 21:54:15 0:59:05 0:49:18 0:09:47 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009507 2021-03-29 07:21:48 2021-03-29 20:55:10 2021-03-29 21:20:50 0:25:40 0:18:34 0:07:06 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-ha-workunit} 2
pass 6009508 2021-03-29 07:21:49 2021-03-29 20:55:51 2021-03-29 21:45:09 0:49:18 0:37:58 0:11:20 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6009509 2021-03-29 07:21:50 2021-03-29 20:58:01 2021-03-29 21:24:55 0:26:54 0:19:53 0:07:01 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6009510 2021-03-29 07:21:51 2021-03-29 20:58:02 2021-03-29 22:07:58 1:09:56 0:58:54 0:11:02 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009511 2021-03-29 07:21:52 2021-03-29 20:58:32 2021-03-29 21:25:42 0:27:10 0:16:37 0:10:33 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6009512 2021-03-29 07:21:53 2021-03-29 20:58:32 2021-03-29 21:38:26 0:39:54 0:29:02 0:10:52 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6009513 2021-03-29 07:21:54 2021-03-29 20:58:53 2021-03-29 21:24:07 0:25:14 0:14:51 0:10:23 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6009514 2021-03-29 07:21:55 2021-03-29 20:58:53 2021-03-29 21:56:15 0:57:22 0:51:21 0:06:01 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6009515 2021-03-29 07:21:57 2021-03-29 20:58:53 2021-03-29 21:25:53 0:27:00 0:16:49 0:10:11 smithi master centos 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6009516 2021-03-29 07:21:58 2021-03-29 20:59:03 2021-03-29 21:59:48 1:00:45 0:53:48 0:06:57 smithi master rhel 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6009517 2021-03-29 07:21:59 2021-03-29 21:00:04 2021-03-29 22:03:48 1:03:44 0:52:42 0:11:02 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6009518 2021-03-29 07:21:59 2021-03-29 21:00:04 2021-03-29 21:51:48 0:51:44 0:42:09 0:09:35 smithi master centos 8.3 rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} 1
pass 6009519 2021-03-29 07:22:00 2021-03-29 21:00:05 2021-03-29 21:59:48 0:59:43 0:49:00 0:10:43 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6009520 2021-03-29 07:22:01 2021-03-29 21:00:06 2021-03-29 21:32:20 0:32:14 0:24:44 0:07:30 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6009521 2021-03-29 07:22:03 2021-03-29 21:01:06 2021-03-29 21:51:08 0:50:02 0:38:53 0:11:09 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6009522 2021-03-29 07:22:05 2021-03-29 21:03:52 2021-03-29 21:34:07 0:30:15 0:20:27 0:09:48 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6009523 2021-03-29 07:22:06 2021-03-29 21:04:42 2021-03-29 22:14:34 1:09:52 0:58:23 0:11:29 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6009524 2021-03-29 07:22:07 2021-03-29 21:07:04 2021-03-29 21:38:43 0:31:39 0:24:35 0:07:04 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6009525 2021-03-29 07:22:08 2021-03-29 21:07:34 2021-03-29 21:47:08 0:39:34 0:30:10 0:09:24 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6009526 2021-03-29 07:22:10 2021-03-29 21:08:04 2021-03-29 22:11:11 1:03:07 0:54:38 0:08:29 smithi master centos 8.3 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6009527 2021-03-29 07:22:11 2021-03-29 21:08:14 2021-03-29 21:40:32 0:32:18 0:24:49 0:07:29 smithi master rhel 8.3 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6009528 2021-03-29 07:22:12 2021-03-29 21:09:33 2021-03-29 22:07:14 0:57:41 0:47:53 0:09:48 smithi master centos 8.3 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2