Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6784320 2022-04-09 15:53:30 2022-04-09 22:42:43 2022-04-09 23:08:06 0:25:23 0:16:12 0:09:11 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
pass 6784321 2022-04-09 15:53:31 2022-04-09 22:44:53 2022-04-09 23:47:16 1:02:23 0:55:43 0:06:40 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{ubuntu_latest}} 3
pass 6784322 2022-04-09 15:53:32 2022-04-09 22:45:54 2022-04-09 23:01:26 0:15:32 0:09:20 0:06:12 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6784323 2022-04-09 15:53:33 2022-04-09 22:46:14 2022-04-09 23:15:32 0:29:18 0:19:55 0:09:23 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
pass 6784324 2022-04-09 15:53:34 2022-04-09 22:48:05 2022-04-09 23:44:26 0:56:21 0:48:34 0:07:47 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784325 2022-04-09 15:53:35 2022-04-09 22:48:06 2022-04-09 23:15:39 0:27:33 0:21:02 0:06:31 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6784326 2022-04-09 15:53:36 2022-04-09 22:48:56 2022-04-09 23:43:01 0:54:05 0:47:05 0:07:00 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784327 2022-04-09 15:53:37 2022-04-09 22:49:37 2022-04-09 23:17:25 0:27:48 0:21:07 0:06:41 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
fail 6784328 2022-04-09 15:53:38 2022-04-09 22:49:37 2022-04-09 23:45:50 0:56:13 0:39:32 0:16:41 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T23:13:24.342683+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: Degraded data redundancy: 3/2382 objects degraded (0.126%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784329 2022-04-09 15:53:39 2022-04-09 22:58:43 2022-04-09 23:26:25 0:27:42 0:21:27 0:06:15 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6784330 2022-04-09 15:53:40 2022-04-09 22:59:33 2022-04-10 00:00:03 1:00:30 0:52:00 0:08:30 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{ubuntu_latest}} 3
pass 6784331 2022-04-09 15:53:41 2022-04-09 23:00:24 2022-04-10 00:00:05 0:59:41 0:53:26 0:06:15 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
pass 6784332 2022-04-09 15:53:42 2022-04-09 23:00:24 2022-04-09 23:35:34 0:35:10 0:28:42 0:06:28 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
pass 6784333 2022-04-09 15:53:43 2022-04-09 23:00:24 2022-04-09 23:42:53 0:42:29 0:33:56 0:08:33 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784334 2022-04-09 15:53:45 2022-04-09 23:01:35 2022-04-09 23:37:01 0:35:26 0:29:22 0:06:04 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784335 2022-04-09 15:53:46 2022-04-09 23:01:45 2022-04-09 23:37:34 0:35:49 0:28:32 0:07:17 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8}} 2
pass 6784336 2022-04-09 15:53:47 2022-04-09 23:01:45 2022-04-09 23:58:24 0:56:39 0:48:14 0:08:25 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
pass 6784337 2022-04-09 15:53:48 2022-04-09 23:03:16 2022-04-10 00:05:40 1:02:24 0:56:14 0:06:10 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
pass 6784338 2022-04-09 15:53:49 2022-04-09 23:03:16 2022-04-09 23:25:44 0:22:28 0:15:21 0:07:07 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
fail 6784339 2022-04-09 15:53:50 2022-04-09 23:04:07 2022-04-09 23:49:01 0:44:54 0:36:44 0:08:10 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T23:20:37.385860+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: Degraded data redundancy: 2/2504 objects degraded (0.080%), 2 pgs degraded (PG_DEGRADED)" in cluster log

pass 6784340 2022-04-09 15:53:51 2022-04-09 23:05:57 2022-04-10 00:09:36 1:03:39 0:57:22 0:06:17 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{centos_8}} 3
pass 6784341 2022-04-09 15:53:52 2022-04-09 23:06:18 2022-04-09 23:39:31 0:33:13 0:25:26 0:07:47 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 3
pass 6784342 2022-04-09 15:53:53 2022-04-09 23:08:08 2022-04-09 23:25:11 0:17:03 0:10:24 0:06:39 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6784343 2022-04-09 15:53:54 2022-04-09 23:08:09 2022-04-09 23:52:08 0:43:59 0:36:18 0:07:41 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784344 2022-04-09 15:53:55 2022-04-09 23:08:09 2022-04-09 23:26:54 0:18:45 0:08:47 0:09:58 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6784345 2022-04-09 15:53:56 2022-04-09 23:11:20 2022-04-10 00:05:04 0:53:44 0:47:06 0:06:38 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6784346 2022-04-09 15:53:57 2022-04-09 23:12:00 2022-04-10 00:09:09 0:57:09 0:50:52 0:06:17 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
pass 6784347 2022-04-09 15:53:58 2022-04-09 23:12:31 2022-04-09 23:41:25 0:28:54 0:21:48 0:07:06 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6784348 2022-04-09 15:53:59 2022-04-09 23:12:31 2022-04-09 23:42:52 0:30:21 0:21:40 0:08:41 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
fail 6784349 2022-04-09 15:54:00 2022-04-09 23:13:52 2022-04-09 23:56:34 0:42:42 0:34:31 0:08:11 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-09T23:30:45.100193+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: Degraded data redundancy: 1/2362 objects degraded (0.042%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784350 2022-04-09 15:54:01 2022-04-09 23:15:42 2022-04-10 00:05:06 0:49:24 0:43:22 0:06:02 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6784351 2022-04-09 15:54:02 2022-04-09 23:15:42 2022-04-10 00:14:50 0:59:08 0:52:56 0:06:12 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6784352 2022-04-09 15:54:04 2022-04-09 23:15:43 2022-04-10 00:23:15 1:07:32 0:58:36 0:08:56 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
pass 6784353 2022-04-09 15:54:05 2022-04-09 23:17:33 2022-04-09 23:51:59 0:34:26 0:27:40 0:06:46 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
pass 6784354 2022-04-09 15:54:06 2022-04-09 23:18:24 2022-04-09 23:58:07 0:39:43 0:27:13 0:12:30 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6784355 2022-04-09 15:54:07 2022-04-09 23:24:25 2022-04-10 00:18:46 0:54:21 0:46:37 0:07:44 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784356 2022-04-09 15:54:08 2022-04-09 23:24:25 2022-04-10 00:00:56 0:36:31 0:28:10 0:08:21 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6784357 2022-04-09 15:54:09 2022-04-09 23:25:16 2022-04-10 00:27:56 1:02:40 0:55:36 0:07:04 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 6784358 2022-04-09 15:54:10 2022-04-09 23:25:26 2022-04-10 00:01:16 0:35:50 0:28:15 0:07:35 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6784359 2022-04-09 15:54:11 2022-04-09 23:25:46 2022-04-10 00:17:48 0:52:02 0:45:44 0:06:18 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784360 2022-04-09 15:54:12 2022-04-09 23:26:27 2022-04-10 00:24:26 0:57:59 0:50:59 0:07:00 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{centos_8}} 3
pass 6784361 2022-04-09 15:54:13 2022-04-09 23:26:57 2022-04-10 00:29:05 1:02:08 0:55:09 0:06:59 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
pass 6784362 2022-04-09 15:54:14 2022-04-09 23:28:28 2022-04-09 23:44:11 0:15:43 0:09:12 0:06:31 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest}} 2
pass 6784363 2022-04-09 15:54:15 2022-04-09 23:28:58 2022-04-10 00:20:59 0:52:01 0:41:18 0:10:43 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{centos_8}} 2
pass 6784364 2022-04-09 15:54:16 2022-04-09 23:33:19 2022-04-09 23:48:30 0:15:11 0:08:35 0:06:36 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
fail 6784365 2022-04-09 15:54:17 2022-04-09 23:33:19 2022-04-09 23:58:59 0:25:40 0:16:10 0:09:30 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6784366 2022-04-09 15:54:18 2022-04-09 23:35:40 2022-04-10 00:00:25 0:24:45 0:16:44 0:08:01 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6784367 2022-04-09 15:54:19 2022-04-09 23:37:10 2022-04-10 00:29:29 0:52:19 0:45:21 0:06:58 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784368 2022-04-09 15:54:21 2022-04-09 23:37:11 2022-04-10 00:06:47 0:29:36 0:21:34 0:08:02 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6784369 2022-04-09 15:54:22 2022-04-09 23:37:41 2022-04-10 00:21:02 0:43:21 0:37:31 0:05:50 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784370 2022-04-09 15:54:23 2022-04-09 23:37:41 2022-04-10 00:05:43 0:28:02 0:20:19 0:07:43 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6784371 2022-04-09 15:54:24 2022-04-09 23:37:42 2022-04-10 00:31:04 0:53:22 0:45:38 0:07:44 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{ubuntu_latest}} 3
pass 6784372 2022-04-09 15:54:25 2022-04-09 23:39:32 2022-04-10 00:32:24 0:52:52 0:44:46 0:08:06 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} 1
pass 6784373 2022-04-09 15:54:26 2022-04-09 23:41:33 2022-04-10 00:44:16 1:02:43 0:54:38 0:08:05 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6784374 2022-04-09 15:54:27 2022-04-09 23:42:53 2022-04-10 00:48:00 1:05:07 0:58:48 0:06:19 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
pass 6784375 2022-04-09 15:54:28 2022-04-09 23:42:54 2022-04-10 00:26:32 0:43:38 0:36:34 0:07:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784376 2022-04-09 15:54:30 2022-04-09 23:43:04 2022-04-10 00:37:43 0:54:39 0:47:45 0:06:54 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{ubuntu_latest}} 2
fail 6784377 2022-04-09 15:54:31 2022-04-09 23:44:14 2022-04-10 00:40:23 0:56:09 0:48:09 0:08:00 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-09T23:58:26.344341+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: Degraded data redundancy: 2/338 objects degraded (0.592%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784378 2022-04-09 15:54:32 2022-04-09 23:44:36 2022-04-10 00:45:14 1:00:38 0:55:30 0:05:08 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 6784379 2022-04-09 15:54:33 2022-04-09 23:44:37 2022-04-10 00:41:36 0:56:59 0:49:21 0:07:38 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784380 2022-04-09 15:54:34 2022-04-09 23:45:57 2022-04-10 00:10:32 0:24:35 0:15:39 0:08:56 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6784381 2022-04-09 15:54:35 2022-04-09 23:47:18 2022-04-10 00:37:59 0:50:41 0:42:06 0:08:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784382 2022-04-09 15:54:36 2022-04-09 23:48:38 2022-04-10 00:50:37 1:01:59 0:53:56 0:08:03 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 3
pass 6784383 2022-04-09 15:54:37 2022-04-09 23:49:09 2022-04-10 00:23:58 0:34:49 0:25:40 0:09:09 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 3
pass 6784384 2022-04-09 15:54:38 2022-04-09 23:52:09 2022-04-10 00:10:53 0:18:44 0:08:31 0:10:13 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6784385 2022-04-09 15:54:39 2022-04-09 23:55:40 2022-04-10 00:41:50 0:46:10 0:38:46 0:07:24 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784386 2022-04-09 15:54:40 2022-04-09 23:56:41 2022-04-10 00:15:29 0:18:48 0:10:54 0:07:54 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6784387 2022-04-09 15:54:41 2022-04-09 23:58:11 2022-04-10 00:23:56 0:25:45 0:19:20 0:06:25 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6784388 2022-04-09 15:54:42 2022-04-09 23:58:32 2022-04-10 00:53:36 0:55:04 0:48:02 0:07:02 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
pass 6784389 2022-04-09 15:54:43 2022-04-09 23:59:02 2022-04-10 00:26:12 0:27:10 0:19:32 0:07:38 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
pass 6784390 2022-04-09 15:54:44 2022-04-10 00:00:13 2022-04-10 00:49:27 0:49:14 0:43:28 0:05:46 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6784391 2022-04-09 15:54:45 2022-04-10 00:00:13 2022-04-10 00:59:41 0:59:28 0:53:47 0:05:41 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6784392 2022-04-09 15:54:46 2022-04-10 00:00:13 2022-04-10 01:06:00 1:05:47 0:59:36 0:06:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784393 2022-04-09 15:54:47 2022-04-10 00:00:34 2022-04-10 00:46:18 0:45:44 0:38:11 0:07:33 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
pass 6784394 2022-04-09 15:54:49 2022-04-10 00:01:04 2022-04-10 00:56:51 0:55:47 0:49:17 0:06:30 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/filestore-xfs policy/simple supported-random-distro$/{centos_8}} 2
pass 6784395 2022-04-09 15:54:50 2022-04-10 00:01:25 2022-04-10 00:54:44 0:53:19 0:46:44 0:06:35 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6784396 2022-04-09 15:54:51 2022-04-10 00:01:35 2022-04-10 01:03:17 1:01:42 0:55:24 0:06:18 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6784397 2022-04-09 15:54:52 2022-04-10 00:01:35 2022-04-10 00:59:59 0:58:24 0:47:59 0:10:25 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{centos_8}} 2
pass 6784398 2022-04-09 15:54:53 2022-04-10 00:05:06 2022-04-10 01:08:41 1:03:35 0:56:39 0:06:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{ubuntu_latest}} 2
fail 6784399 2022-04-09 15:54:54 2022-04-10 00:05:16 2022-04-10 00:31:38 0:26:22 0:17:51 0:08:31 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-10T00:19:54.106864+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6784400 2022-04-09 15:54:55 2022-04-10 00:05:47 2022-04-10 00:31:57 0:26:10 0:18:15 0:07:55 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-10T00:20:16.419941+0000 mon.a (mon.0) 96 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784401 2022-04-09 15:54:56 2022-04-10 00:06:57 2022-04-10 00:25:59 0:19:02 0:11:03 0:07:59 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784402 2022-04-09 15:54:57 2022-04-10 00:09:18 2022-04-10 01:02:55 0:53:37 0:47:24 0:06:13 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 2
pass 6784403 2022-04-09 15:54:58 2022-04-10 00:09:38 2022-04-10 00:37:01 0:27:23 0:20:14 0:07:09 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
fail 6784404 2022-04-09 15:54:59 2022-04-10 00:09:38 2022-04-10 00:40:11 0:30:33 0:21:47 0:08:46 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9b3739e792ef182b79445b926c7b7da461c05f52 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'

pass 6784405 2022-04-09 15:55:00 2022-04-10 00:10:39 2022-04-10 00:40:05 0:29:26 0:22:02 0:07:24 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6784406 2022-04-09 15:55:01 2022-04-10 00:10:59 2022-04-10 01:14:08 1:03:09 0:52:50 0:10:19 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6784407 2022-04-09 15:55:02 2022-04-10 00:15:00 2022-04-10 01:23:11 1:08:11 1:00:56 0:07:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784408 2022-04-09 15:55:03 2022-04-10 00:15:31 2022-04-10 00:53:12 0:37:41 0:28:17 0:09:24 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
pass 6784409 2022-04-09 15:55:04 2022-04-10 00:17:51 2022-04-10 00:54:40 0:36:49 0:28:25 0:08:24 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8}} 2
pass 6784410 2022-04-09 15:55:05 2022-04-10 00:18:52 2022-04-10 00:55:06 0:36:14 0:27:11 0:09:03 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
fail 6784411 2022-04-09 15:55:07 2022-04-10 00:21:02 2022-04-10 00:42:37 0:21:35 0:15:03 0:06:32 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T00:32:18.760272+0000 mon.a (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784412 2022-04-09 15:55:08 2022-04-10 00:21:12 2022-04-10 01:24:29 1:03:17 0:54:18 0:08:59 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6784413 2022-04-09 15:55:09 2022-04-10 00:23:23 2022-04-10 00:59:19 0:35:56 0:28:41 0:07:15 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784414 2022-04-09 15:55:10 2022-04-10 00:24:03 2022-04-10 00:46:40 0:22:37 0:13:53 0:08:44 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
fail 6784415 2022-04-09 15:55:11 2022-04-10 00:24:04 2022-04-10 01:14:18 0:50:14 0:43:08 0:07:06 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T00:38:15.064125+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: Degraded data redundancy: 3/1424 objects degraded (0.211%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784416 2022-04-09 15:55:12 2022-04-10 00:24:04 2022-04-10 00:42:20 0:18:16 0:10:12 0:08:04 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6784417 2022-04-09 15:55:13 2022-04-10 00:24:35 2022-04-10 01:21:02 0:56:27 0:47:42 0:08:45 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{centos_8}} 2
pass 6784418 2022-04-09 15:55:14 2022-04-10 00:26:05 2022-04-10 00:53:55 0:27:50 0:20:47 0:07:03 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
pass 6784419 2022-04-09 15:55:15 2022-04-10 00:26:15 2022-04-10 00:55:40 0:29:25 0:21:45 0:07:40 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6784420 2022-04-09 15:55:16 2022-04-10 00:26:36 2022-04-10 01:20:39 0:54:03 0:46:49 0:07:14 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784421 2022-04-09 15:55:17 2022-04-10 00:26:46 2022-04-10 00:53:04 0:26:18 0:19:07 0:07:11 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
fail 6784422 2022-04-09 15:55:18 2022-04-10 00:28:07 2022-04-10 01:12:16 0:44:09 0:36:36 0:07:33 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T00:41:52.697632+0000 mon.a (mon.0) 206 : cluster [WRN] Health check failed: Degraded data redundancy: 3/2566 objects degraded (0.117%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784423 2022-04-09 15:55:20 2022-04-10 00:29:07 2022-04-10 01:26:12 0:57:05 0:47:57 0:09:08 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 3
pass 6784424 2022-04-09 15:55:21 2022-04-10 00:31:08 2022-04-10 01:37:29 1:06:21 0:59:04 0:07:17 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784425 2022-04-09 15:55:22 2022-04-10 00:31:08 2022-04-10 01:15:30 0:44:22 0:36:30 0:07:52 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{centos_8}} 2
pass 6784426 2022-04-09 15:55:23 2022-04-10 00:31:48 2022-04-10 01:06:53 0:35:05 0:28:18 0:06:47 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6784427 2022-04-09 15:55:24 2022-04-10 00:31:59 2022-04-10 01:32:02 1:00:03 0:47:56 0:12:07 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 2
pass 6784428 2022-04-09 15:55:25 2022-04-10 00:37:10 2022-04-10 01:38:07 1:00:57 0:54:26 0:06:31 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6784429 2022-04-09 15:55:26 2022-04-10 00:37:10 2022-04-10 01:33:16 0:56:06 0:48:25 0:07:41 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784430 2022-04-09 15:55:27 2022-04-10 00:37:51 2022-04-10 00:59:04 0:21:13 0:14:59 0:06:14 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 2
fail 6784431 2022-04-09 15:55:28 2022-04-10 00:38:01 2022-04-10 01:27:19 0:49:18 0:39:53 0:09:25 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-10T00:54:44.041224+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: Degraded data redundancy: 2/3550 objects degraded (0.056%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784432 2022-04-09 15:55:29 2022-04-10 00:40:12 2022-04-10 01:38:06 0:57:54 0:49:57 0:07:57 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple supported-random-distro$/{ubuntu_latest}} 3
pass 6784433 2022-04-09 15:55:30 2022-04-10 00:40:32 2022-04-10 01:15:08 0:34:36 0:26:43 0:07:53 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 3
pass 6784434 2022-04-09 15:55:31 2022-04-10 00:50:39 2022-04-10 01:08:14 0:17:35 0:08:31 0:09:04 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6784435 2022-04-09 15:55:32 2022-04-10 00:53:09 2022-04-10 01:36:47 0:43:38 0:36:20 0:07:18 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784436 2022-04-09 15:55:34 2022-04-10 00:53:20 2022-04-10 01:08:47 0:15:27 0:08:51 0:06:36 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest}} 2
pass 6784437 2022-04-09 15:55:35 2022-04-10 00:53:40 2022-04-10 01:47:42 0:54:02 0:46:03 0:07:59 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
pass 6784438 2022-04-09 15:55:36 2022-04-10 00:54:01 2022-04-10 01:24:27 0:30:26 0:22:16 0:08:10 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784439 2022-04-09 15:55:37 2022-04-10 00:54:41 2022-04-10 01:22:31 0:27:50 0:20:06 0:07:44 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6784440 2022-04-09 15:55:38 2022-04-10 00:54:51 2022-04-10 01:50:53 0:56:02 0:48:05 0:07:57 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
fail 6784441 2022-04-09 15:55:39 2022-04-10 00:55:12 2022-04-10 01:18:42 0:23:30 0:16:51 0:06:39 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-10T01:08:23.071746+0000 mon.a (mon.0) 99 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784442 2022-04-09 15:55:40 2022-04-10 00:55:42 2022-04-10 01:24:22 0:28:40 0:20:52 0:07:48 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6784443 2022-04-09 15:55:42 2022-04-10 00:56:52 2022-04-10 01:52:14 0:55:22 0:46:43 0:08:39 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{centos_8}} 3
pass 6784444 2022-04-09 15:55:43 2022-04-10 00:59:13 2022-04-10 01:49:05 0:49:52 0:43:25 0:06:27 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6784445 2022-04-09 15:55:44 2022-04-10 00:59:23 2022-04-10 01:59:18 0:59:55 0:53:01 0:06:54 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest}} 2
pass 6784446 2022-04-09 15:55:45 2022-04-10 00:59:44 2022-04-10 02:03:07 1:03:23 0:56:39 0:06:44 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple supported-random-distro$/{centos_8}} 2
pass 6784447 2022-04-09 15:55:46 2022-04-10 01:00:04 2022-04-10 01:38:49 0:38:45 0:28:21 0:10:24 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6784448 2022-04-09 15:55:47 2022-04-10 01:03:05 2022-04-10 01:39:40 0:36:35 0:28:01 0:08:34 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest}} 2
dead 6784449 2022-04-09 15:55:48 2022-04-10 01:03:25 2022-04-10 07:45:40 6:42:15 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-hybrid policy/simple supported-random-distro$/{centos_8}} 2
Failure Reason:

hit max job timeout

pass 6784450 2022-04-09 15:55:50 2022-04-10 01:03:56 2022-04-10 01:39:43 0:35:47 0:27:11 0:08:36 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6784451 2022-04-09 15:55:51 2022-04-10 01:06:06 2022-04-10 02:02:05 0:55:59 0:48:28 0:07:31 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none supported-random-distro$/{centos_8}} 2
pass 6784452 2022-04-09 15:55:52 2022-04-10 01:06:57 2022-04-10 02:08:41 1:01:44 0:55:17 0:06:27 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} 1
pass 6784453 2022-04-09 15:55:53 2022-04-10 01:08:17 2022-04-10 01:45:25 0:37:08 0:29:32 0:07:36 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6784454 2022-04-09 15:55:54 2022-04-10 01:08:48 2022-04-10 02:05:50 0:57:02 0:49:40 0:07:22 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{centos_8}} 2
pass 6784455 2022-04-09 15:55:55 2022-04-10 01:08:48 2022-04-10 01:33:01 0:24:13 0:14:50 0:09:23 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784456 2022-04-09 15:55:57 2022-04-10 01:11:59 2022-04-10 01:58:58 0:46:59 0:40:10 0:06:49 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784457 2022-04-09 15:55:58 2022-04-10 01:11:59 2022-04-10 02:11:46 0:59:47 0:50:41 0:09:06 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{ubuntu_latest}} 3
fail 6784458 2022-04-09 15:55:59 2022-04-10 01:14:00 2022-04-10 01:36:59 0:22:59 0:16:27 0:06:32 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-stress-workunit} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T01:25:14.693509+0000 mon.a (mon.0) 93 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784459 2022-04-09 15:56:00 2022-04-10 01:14:00 2022-04-10 01:29:36 0:15:36 0:08:47 0:06:49 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest}} 2
pass 6784460 2022-04-09 15:56:01 2022-04-10 01:14:10 2022-04-10 02:00:21 0:46:11 0:39:06 0:07:05 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784461 2022-04-09 15:56:02 2022-04-10 01:14:21 2022-04-10 01:32:19 0:17:58 0:10:19 0:07:39 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-bootstrap-workunit} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
fail 6784462 2022-04-09 15:56:03 2022-04-10 01:15:11 2022-04-10 02:11:50 0:56:39 0:48:24 0:08:15 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T01:30:48.630653+0000 osd.0 (osd.0) 3 : cluster [WRN] 1 slow requests (by type [ 'delayed' : 1 ] most affected pool [ 'mirror' : 1 ])" in cluster log

pass 6784463 2022-04-09 15:56:04 2022-04-10 01:15:32 2022-04-10 01:42:56 0:27:24 0:20:52 0:06:32 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6784464 2022-04-09 15:56:06 2022-04-10 01:16:02 2022-04-10 01:41:49 0:25:47 0:19:27 0:06:20 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest}} 2
pass 6784465 2022-04-09 15:56:07 2022-04-10 01:16:02 2022-04-10 02:07:55 0:51:53 0:43:31 0:08:22 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6784466 2022-04-09 15:56:08 2022-04-10 01:18:43 2022-04-10 02:17:10 0:58:27 0:50:32 0:07:55 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8}} 2
pass 6784467 2022-04-09 15:56:09 2022-04-10 01:20:04 2022-04-10 01:55:17 0:35:13 0:28:58 0:06:15 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8}} 2
pass 6784468 2022-04-09 15:56:10 2022-04-10 01:20:04 2022-04-10 02:02:25 0:42:21 0:34:38 0:07:43 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-bitmap policy/none supported-random-distro$/{centos_8}} 2
pass 6784469 2022-04-09 15:56:11 2022-04-10 01:20:44 2022-04-10 01:54:07 0:33:23 0:27:29 0:05:54 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6784470 2022-04-09 15:56:12 2022-04-10 01:21:05 2022-04-10 02:16:17 0:55:12 0:47:42 0:07:30 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784471 2022-04-09 15:56:13 2022-04-10 01:22:35 2022-04-10 01:58:30 0:35:55 0:29:06 0:06:49 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8}} 2
pass 6784472 2022-04-09 15:56:14 2022-04-10 01:23:16 2022-04-10 02:26:01 1:02:45 0:54:39 0:08:06 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
pass 6784473 2022-04-09 15:56:15 2022-04-10 01:24:26 2022-04-10 02:00:20 0:35:54 0:28:02 0:07:52 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-simple} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8}} 2
pass 6784474 2022-04-09 15:56:16 2022-04-10 01:24:37 2022-04-10 01:47:52 0:23:15 0:15:36 0:07:39 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-ha-workunit} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
fail 6784475 2022-04-09 15:56:17 2022-04-10 01:24:37 2022-04-10 01:49:44 0:25:07 0:16:11 0:08:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-fsx-workunit} msgr-failures/few objectstore/bluestore-comp-zstd policy/none supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

"2022-04-10T01:38:02.981457+0000 mon.a (mon.0) 91 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784476 2022-04-09 15:56:18 2022-04-10 01:26:18 2022-04-10 02:00:29 0:34:11 0:25:51 0:08:20 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8}} 3
pass 6784477 2022-04-09 15:56:19 2022-04-10 01:27:28 2022-04-10 01:46:44 0:19:16 0:10:52 0:08:24 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-journal-bootstrap-workunit} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
pass 6784478 2022-04-09 15:56:20 2022-04-10 01:29:39 2022-04-10 02:17:24 0:47:45 0:38:36 0:09:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-stupid policy/simple supported-random-distro$/{ubuntu_latest}} 2
pass 6784479 2022-04-09 15:56:22 2022-04-10 01:32:10 2022-04-10 02:25:51 0:53:41 0:46:48 0:06:53 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} msgr-failures/few objectstore/filestore-xfs policy/none supported-random-distro$/{ubuntu_latest}} 2
pass 6784480 2022-04-09 15:56:23 2022-04-10 01:32:20 2022-04-10 02:28:27 0:56:07 0:49:22 0:06:45 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-bitmap policy/simple supported-random-distro$/{centos_8}} 2
pass 6784481 2022-04-09 15:56:24 2022-04-10 01:33:10 2022-04-10 02:26:29 0:53:19 0:46:14 0:07:05 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none supported-random-distro$/{centos_8}} 2
pass 6784482 2022-04-09 15:56:25 2022-04-10 01:33:21 2022-04-10 02:04:31 0:31:10 0:20:10 0:11:00 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-journaling} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest}} 2
pass 6784483 2022-04-09 15:56:26 2022-04-10 01:36:52 2022-04-10 02:02:06 0:25:14 0:19:40 0:05:34 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-snapshot-workunit-minimum} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest}} 2
pass 6784484 2022-04-09 15:56:27 2022-04-10 01:37:02 2022-04-10 02:39:52 1:02:50 0:53:55 0:08:55 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest}} 2
pass 6784485 2022-04-09 15:56:28 2022-04-10 01:37:32 2022-04-10 02:13:28 0:35:56 0:28:52 0:07:04 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-config-key} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8}} 2
pass 6784486 2022-04-09 15:56:29 2022-04-10 01:38:13 2022-04-10 02:21:24 0:43:11 0:37:15 0:05:56 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit} msgr-failures/few objectstore/bluestore-hybrid policy/none supported-random-distro$/{centos_8}} 2
pass 6784487 2022-04-09 15:56:30 2022-04-10 01:38:13 2022-04-10 02:14:32 0:36:19 0:27:51 0:08:28 smithi master ubuntu 20.04 rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-min-compat-client-octopus} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest}} 2
pass 6784488 2022-04-09 15:56:31 2022-04-10 01:38:53 2022-04-10 02:17:04 0:38:11 0:29:39 0:08:32 smithi master centos 8.stream rbd/mirror/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{mirror-extra} workloads/rbd-mirror-workunit-policy-none} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8}} 2
fail 6784489 2022-04-09 15:56:32 2022-04-10 01:39:44 2022-04-10 02:05:32 0:25:48 0:18:01 0:07:47 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/2-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} msgr-failures/few objectstore/bluestore-stupid policy/none supported-random-distro$/{centos_8}} 2
Failure Reason:

"2022-04-10T01:53:58.405229+0000 mon.a (mon.0) 89 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6784490 2022-04-09 15:56:33 2022-04-10 01:39:44 2022-04-10 02:43:03 1:03:19 0:54:28 0:08:51 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} 1