Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6676404 2022-02-11 10:33:30 2022-02-11 10:56:56 2022-02-11 11:20:09 0:23:13 0:13:32 0:09:41 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 6676405 2022-02-11 10:33:31 2022-02-11 10:56:57 2022-02-11 12:02:18 1:05:21 0:54:28 0:10:53 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

Found coredumps on ubuntu@smithi155.front.sepia.ceph.com

pass 6676406 2022-02-11 10:33:32 2022-02-11 10:56:57 2022-02-11 11:18:21 0:21:24 0:08:47 0:12:37 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6676407 2022-02-11 10:33:33 2022-02-11 10:58:48 2022-02-11 11:16:53 0:18:05 0:07:44 0:10:21 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676408 2022-02-11 10:33:34 2022-02-11 10:58:48 2022-02-11 11:19:00 0:20:12 0:08:30 0:11:42 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676409 2022-02-11 10:33:35 2022-02-11 11:01:49 2022-02-11 11:53:52 0:52:03 0:40:56 0:11:07 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
fail 6676410 2022-02-11 10:33:36 2022-02-11 11:02:59 2022-02-11 11:26:32 0:23:33 0:13:48 0:09:45 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi068 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d9c24494798767914b7df5d93356fed1935d23b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6676411 2022-02-11 10:33:37 2022-02-11 11:03:00 2022-02-11 11:59:34 0:56:34 0:46:52 0:09:42 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676412 2022-02-11 10:33:38 2022-02-11 11:03:10 2022-02-11 11:29:15 0:26:05 0:15:26 0:10:39 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
Failure Reason:

"2022-02-11T11:18:16.026007+0000 mon.a (mon.0) 89 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6676413 2022-02-11 10:33:39 2022-02-11 11:04:30 2022-02-11 12:04:30 1:00:00 0:50:38 0:09:22 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676414 2022-02-11 10:33:40 2022-02-11 11:05:01 2022-02-11 11:35:29 0:30:28 0:20:03 0:10:25 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676415 2022-02-11 10:33:42 2022-02-11 11:05:31 2022-02-11 12:02:16 0:56:45 0:46:14 0:10:31 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676416 2022-02-11 10:33:43 2022-02-11 11:07:12 2022-02-11 11:36:37 0:29:25 0:19:52 0:09:33 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6676417 2022-02-11 10:33:44 2022-02-11 11:07:12 2022-02-11 12:10:57 1:03:45 0:54:08 0:09:37 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6676418 2022-02-11 10:33:45 2022-02-11 11:07:52 2022-02-11 12:07:50 0:59:58 0:43:40 0:16:18 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} 1
pass 6676419 2022-02-11 10:33:46 2022-02-11 11:15:14 2022-02-11 12:16:54 1:01:40 0:49:25 0:12:15 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6676420 2022-02-11 10:33:47 2022-02-11 11:16:54 2022-02-11 11:54:54 0:38:00 0:28:43 0:09:17 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676421 2022-02-11 10:33:48 2022-02-11 11:17:35 2022-02-11 12:04:37 0:47:02 0:38:22 0:08:40 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676422 2022-02-11 10:33:49 2022-02-11 11:17:35 2022-02-11 11:56:00 0:38:25 0:27:35 0:10:50 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676423 2022-02-11 10:33:50 2022-02-11 11:18:25 2022-02-11 12:14:12 0:55:47 0:45:36 0:10:11 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676424 2022-02-11 10:33:51 2022-02-11 11:19:06 2022-02-11 12:19:22 1:00:16 0:49:01 0:11:15 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676425 2022-02-11 10:33:52 2022-02-11 11:20:16 2022-02-11 12:29:16 1:09:00 0:53:23 0:15:37 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
pass 6676426 2022-02-11 10:33:53 2022-02-11 11:26:27 2022-02-11 12:03:32 0:37:05 0:28:39 0:08:26 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676427 2022-02-11 10:33:54 2022-02-11 11:26:27 2022-02-11 11:50:03 0:23:36 0:14:06 0:09:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6676428 2022-02-11 10:33:55 2022-02-11 11:26:38 2022-02-11 12:31:34 1:04:56 0:55:15 0:09:41 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6676429 2022-02-11 10:33:56 2022-02-11 11:28:38 2022-02-11 11:48:04 0:19:26 0:09:11 0:10:15 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6676430 2022-02-11 10:33:57 2022-02-11 11:29:19 2022-02-11 12:19:55 0:50:36 0:40:53 0:09:43 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676431 2022-02-11 10:33:58 2022-02-11 11:31:00 2022-02-11 12:00:23 0:29:23 0:19:45 0:09:38 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6676432 2022-02-11 10:33:59 2022-02-11 11:31:10 2022-02-11 12:33:00 1:01:50 0:50:46 0:11:04 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676433 2022-02-11 10:34:00 2022-02-11 11:31:20 2022-02-11 12:01:49 0:30:29 0:20:25 0:10:04 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676434 2022-02-11 10:34:01 2022-02-11 11:32:51 2022-02-11 12:02:48 0:29:57 0:19:52 0:10:05 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6676435 2022-02-11 10:34:02 2022-02-11 11:33:01 2022-02-11 12:18:16 0:45:15 0:35:05 0:10:10 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6676436 2022-02-11 10:34:03 2022-02-11 11:33:12 2022-02-11 12:02:41 0:29:29 0:19:36 0:09:53 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
fail 6676437 2022-02-11 10:34:04 2022-02-11 11:33:42 2022-02-11 12:38:50 1:05:08 0:54:20 0:10:48 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

Found coredumps on ubuntu@smithi065.front.sepia.ceph.com

pass 6676438 2022-02-11 10:34:05 2022-02-11 11:33:42 2022-02-11 12:27:22 0:53:40 0:43:12 0:10:28 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6676439 2022-02-11 10:34:06 2022-02-11 11:33:42 2022-02-11 12:38:14 1:04:32 0:53:54 0:10:38 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6676440 2022-02-11 10:34:07 2022-02-11 11:34:03 2022-02-11 11:51:35 0:17:32 0:07:30 0:10:02 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676441 2022-02-11 10:34:08 2022-02-11 11:34:14 2022-02-11 12:15:01 0:40:47 0:28:34 0:12:13 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676442 2022-02-11 10:34:09 2022-02-11 11:34:14 2022-02-11 12:23:16 0:49:02 0:37:36 0:11:26 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676443 2022-02-11 10:34:10 2022-02-11 11:35:34 2022-02-11 12:12:41 0:37:07 0:27:45 0:09:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676444 2022-02-11 10:34:11 2022-02-11 11:35:45 2022-02-11 12:31:32 0:55:47 0:45:17 0:10:30 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676445 2022-02-11 10:34:12 2022-02-11 11:36:35 2022-02-11 12:15:56 0:39:21 0:28:55 0:10:26 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676446 2022-02-11 10:34:13 2022-02-11 11:36:46 2022-02-11 12:34:10 0:57:24 0:47:55 0:09:29 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676447 2022-02-11 10:34:14 2022-02-11 11:36:46 2022-02-11 12:39:42 1:02:56 0:54:20 0:08:36 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 6676448 2022-02-11 10:34:15 2022-02-11 11:36:46 2022-02-11 12:14:44 0:37:58 0:28:23 0:09:35 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676449 2022-02-11 10:34:16 2022-02-11 11:37:07 2022-02-11 12:32:23 0:55:16 0:46:52 0:08:24 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 6676450 2022-02-11 10:34:17 2022-02-11 11:37:27 2022-02-11 12:42:33 1:05:06 0:55:28 0:09:38 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

Found coredumps on ubuntu@smithi173.front.sepia.ceph.com

pass 6676451 2022-02-11 10:34:18 2022-02-11 11:37:27 2022-02-11 11:54:37 0:17:10 0:08:55 0:08:15 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6676452 2022-02-11 10:34:19 2022-02-11 11:37:38 2022-02-11 11:55:06 0:17:28 0:07:26 0:10:02 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676453 2022-02-11 10:34:20 2022-02-11 11:37:38 2022-02-11 11:57:28 0:19:50 0:09:09 0:10:41 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676454 2022-02-11 10:34:22 2022-02-11 11:38:28 2022-02-11 12:25:33 0:47:05 0:37:39 0:09:26 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
fail 6676455 2022-02-11 10:34:23 2022-02-11 11:38:29 2022-02-11 12:01:36 0:23:07 0:14:06 0:09:01 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi170 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d9c24494798767914b7df5d93356fed1935d23b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6676456 2022-02-11 10:34:24 2022-02-11 11:38:39 2022-02-11 12:34:11 0:55:32 0:45:17 0:10:15 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676457 2022-02-11 10:34:25 2022-02-11 11:39:09 2022-02-11 11:57:49 0:18:40 0:07:07 0:11:33 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6676458 2022-02-11 10:34:26 2022-02-11 11:39:10 2022-02-11 12:35:11 0:56:01 0:45:45 0:10:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676459 2022-02-11 10:34:27 2022-02-11 11:39:40 2022-02-11 12:09:56 0:30:16 0:20:13 0:10:03 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6676460 2022-02-11 10:34:28 2022-02-11 11:39:41 2022-02-11 12:46:39 1:06:58 0:55:08 0:11:50 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6676461 2022-02-11 10:34:29 2022-02-11 11:41:11 2022-02-11 11:58:20 0:17:09 0:07:33 0:09:36 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676462 2022-02-11 10:34:30 2022-02-11 11:41:52 2022-02-11 12:19:32 0:37:40 0:28:09 0:09:31 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676463 2022-02-11 10:34:31 2022-02-11 11:42:12 2022-02-11 12:20:32 0:38:20 0:28:35 0:09:45 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676464 2022-02-11 10:34:32 2022-02-11 11:43:22 2022-02-11 12:43:16 0:59:54 0:50:10 0:09:44 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676465 2022-02-11 10:34:33 2022-02-11 11:43:33 2022-02-11 12:47:14 1:03:41 0:52:55 0:10:46 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 6676466 2022-02-11 10:34:34 2022-02-11 11:44:03 2022-02-11 12:21:55 0:37:52 0:28:05 0:09:47 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676467 2022-02-11 10:34:35 2022-02-11 11:44:04 2022-02-11 12:41:34 0:57:30 0:46:55 0:10:35 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676468 2022-02-11 10:34:36 2022-02-11 11:44:14 2022-02-11 12:07:51 0:23:37 0:14:13 0:09:24 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 6676469 2022-02-11 10:34:37 2022-02-11 11:44:45 2022-02-11 12:10:59 0:26:14 0:15:35 0:10:39 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

No module named 'tasks.rbd_fsx'

pass 6676470 2022-02-11 10:34:38 2022-02-11 11:45:25 2022-02-11 12:50:36 1:05:11 0:55:11 0:10:00 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6676471 2022-02-11 10:34:39 2022-02-11 11:45:35 2022-02-11 12:03:13 0:17:38 0:06:52 0:10:46 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6676472 2022-02-11 10:34:40 2022-02-11 11:45:46 2022-02-11 12:02:50 0:17:04 0:07:54 0:09:10 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

No module named 'tasks.workunit'

fail 6676473 2022-02-11 10:34:40 2022-02-11 11:45:56 2022-02-11 12:03:28 0:17:32 0:06:57 0:10:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

No module named 'tasks.rbd_mirror'

pass 6676474 2022-02-11 10:34:41 2022-02-11 11:46:17 2022-02-11 12:17:36 0:31:19 0:19:38 0:11:41 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6676475 2022-02-11 10:34:42 2022-02-11 11:48:07 2022-02-11 12:36:13 0:48:06 0:39:02 0:09:04 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6676476 2022-02-11 10:34:43 2022-02-11 11:49:18 2022-02-11 12:19:20 0:30:02 0:20:17 0:09:45 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6676477 2022-02-11 10:34:44 2022-02-11 11:49:48 2022-02-11 12:40:49 0:51:01 0:43:18 0:07:43 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6676478 2022-02-11 10:34:45 2022-02-11 11:49:49 2022-02-11 12:03:21 0:13:32 0:04:15 0:09:17 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
Failure Reason:

Command failed on smithi037 with status 1: 'sudo yum -y install cephfs-java'

pass 6676479 2022-02-11 10:34:46 2022-02-11 11:50:09 2022-02-11 12:27:43 0:37:34 0:28:28 0:09:06 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6676480 2022-02-11 10:34:47 2022-02-11 11:50:29 2022-02-11 12:28:56 0:38:27 0:27:37 0:10:50 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676481 2022-02-11 10:34:48 2022-02-11 11:51:40 2022-02-11 12:29:25 0:37:45 0:28:06 0:09:39 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676482 2022-02-11 10:34:49 2022-02-11 11:51:50 2022-02-11 12:52:19 1:00:29 0:49:47 0:10:42 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676483 2022-02-11 10:34:50 2022-02-11 11:53:31 2022-02-11 12:56:57 1:03:26 0:53:26 0:10:00 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 6676484 2022-02-11 10:34:51 2022-02-11 11:54:01 2022-02-11 12:31:38 0:37:37 0:27:38 0:09:59 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676485 2022-02-11 10:34:52 2022-02-11 11:54:42 2022-02-11 12:49:57 0:55:15 0:45:32 0:09:43 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676486 2022-02-11 10:34:53 2022-02-11 11:55:02 2022-02-11 12:18:28 0:23:26 0:14:04 0:09:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 6676487 2022-02-11 10:34:54 2022-02-11 11:55:12 2022-02-11 12:10:31 0:15:19 0:05:34 0:09:45 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

No module named 'tasks'

pass 6676488 2022-02-11 10:34:55 2022-02-11 11:55:33 2022-02-11 13:05:43 1:10:10 0:59:00 0:11:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6676489 2022-02-11 10:34:56 2022-02-11 11:56:03 2022-02-11 12:14:52 0:18:49 0:07:00 0:11:49 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676490 2022-02-11 10:34:57 2022-02-11 11:57:34 2022-02-11 12:18:21 0:20:47 0:08:52 0:11:55 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676491 2022-02-11 10:34:58 2022-02-11 11:57:54 2022-02-11 12:26:46 0:28:52 0:20:03 0:08:49 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6676492 2022-02-11 10:34:59 2022-02-11 11:58:25 2022-02-11 12:54:42 0:56:17 0:45:54 0:10:23 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676493 2022-02-11 10:35:00 2022-02-11 11:58:25 2022-02-11 13:00:38 1:02:13 0:52:12 0:10:01 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676494 2022-02-11 10:35:01 2022-02-11 11:59:35 2022-02-11 12:29:35 0:30:00 0:20:22 0:09:38 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
fail 6676495 2022-02-11 10:35:02 2022-02-11 12:00:26 2022-02-11 12:46:32 0:46:06 0:36:03 0:10:03 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-02-11T12:17:33.456232+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1630 objects degraded (0.061%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6676496 2022-02-11 10:35:03 2022-02-11 12:01:46 2022-02-11 12:55:14 0:53:28 0:43:35 0:09:53 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6676497 2022-02-11 10:35:04 2022-02-11 12:01:47 2022-02-11 12:18:50 0:17:03 0:07:31 0:09:32 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676498 2022-02-11 10:35:05 2022-02-11 12:01:57 2022-02-11 12:39:21 0:37:24 0:27:40 0:09:44 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 6676499 2022-02-11 10:35:06 2022-02-11 12:02:17 2022-02-11 12:39:38 0:37:21 0:27:45 0:09:36 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676500 2022-02-11 10:35:07 2022-02-11 12:02:28 2022-02-11 13:02:11 0:59:43 0:49:27 0:10:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676501 2022-02-11 10:35:08 2022-02-11 12:02:48 2022-02-11 13:05:35 1:02:47 0:54:15 0:08:32 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 6676502 2022-02-11 10:35:09 2022-02-11 12:02:48 2022-02-11 12:42:40 0:39:52 0:29:13 0:10:39 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676503 2022-02-11 10:35:10 2022-02-11 12:02:49 2022-02-11 12:59:40 0:56:51 0:49:11 0:07:40 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676504 2022-02-11 10:35:11 2022-02-11 12:02:59 2022-02-11 12:54:42 0:51:43 0:42:49 0:08:54 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6676505 2022-02-11 10:35:12 2022-02-11 12:03:19 2022-02-11 13:12:24 1:09:05 1:00:31 0:08:34 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6676506 2022-02-11 10:35:13 2022-02-11 12:03:30 2022-02-11 12:20:55 0:17:25 0:07:25 0:10:00 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676507 2022-02-11 10:35:14 2022-02-11 12:03:30 2022-02-11 12:23:09 0:19:39 0:08:54 0:10:45 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676508 2022-02-11 10:35:15 2022-02-11 12:03:40 2022-02-11 12:53:30 0:49:50 0:39:44 0:10:06 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676509 2022-02-11 10:35:16 2022-02-11 12:04:31 2022-02-11 13:01:47 0:57:16 0:48:18 0:08:58 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676510 2022-02-11 10:35:17 2022-02-11 12:04:41 2022-02-11 12:24:40 0:19:59 0:07:33 0:12:26 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6676511 2022-02-11 10:35:18 2022-02-11 12:07:52 2022-02-11 13:08:36 1:00:44 0:50:03 0:10:41 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676512 2022-02-11 10:35:19 2022-02-11 12:07:52 2022-02-11 12:41:45 0:33:53 0:20:56 0:12:57 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676513 2022-02-11 10:35:20 2022-02-11 12:10:03 2022-02-11 13:05:51 0:55:48 0:46:17 0:09:31 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676514 2022-02-11 10:35:21 2022-02-11 12:10:33 2022-02-11 12:52:06 0:41:33 0:32:56 0:08:37 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
fail 6676515 2022-02-11 10:35:22 2022-02-11 12:11:04 2022-02-11 12:34:21 0:23:17 0:13:50 0:09:27 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi181 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d9c24494798767914b7df5d93356fed1935d23b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6676516 2022-02-11 10:35:23 2022-02-11 12:11:04 2022-02-11 13:18:15 1:07:11 0:55:42 0:11:29 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6676517 2022-02-11 10:35:24 2022-02-11 12:22:00 2022-02-11 12:48:12 0:26:12 0:16:28 0:09:44 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6676518 2022-02-11 10:35:25 2022-02-11 12:23:10 2022-02-11 13:01:23 0:38:13 0:28:12 0:10:01 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676519 2022-02-11 10:35:26 2022-02-11 12:23:21 2022-02-11 13:09:28 0:46:07 0:36:07 0:10:00 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676520 2022-02-11 10:35:27 2022-02-11 12:24:41 2022-02-11 13:02:55 0:38:14 0:27:45 0:10:29 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676521 2022-02-11 10:35:28 2022-02-11 12:25:42 2022-02-11 13:21:21 0:55:39 0:45:54 0:09:45 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676522 2022-02-11 10:35:29 2022-02-11 12:26:52 2022-02-11 13:04:51 0:37:59 0:27:52 0:10:07 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676523 2022-02-11 10:35:30 2022-02-11 12:27:53 2022-02-11 13:31:04 1:03:11 0:53:48 0:09:23 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/rbd_mirror} 1
pass 6676524 2022-02-11 10:35:31 2022-02-11 12:27:53 2022-02-11 13:08:32 0:40:39 0:29:59 0:10:40 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676525 2022-02-11 10:35:32 2022-02-11 12:29:03 2022-02-11 13:21:07 0:52:04 0:40:40 0:11:24 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6676526 2022-02-11 10:35:33 2022-02-11 12:29:34 2022-02-11 12:49:22 0:19:48 0:08:56 0:10:52 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6676527 2022-02-11 10:35:34 2022-02-11 12:29:44 2022-02-11 12:48:52 0:19:08 0:07:52 0:11:16 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
fail 6676528 2022-02-11 10:35:35 2022-02-11 12:31:35 2022-02-11 12:55:09 0:23:34 0:14:04 0:09:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_snapshot.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9d9c24494798767914b7df5d93356fed1935d23b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_CONFIG_KEY=1 RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_snapshot.sh'

pass 6676529 2022-02-11 10:35:36 2022-02-11 12:31:45 2022-02-11 13:26:41 0:54:56 0:45:44 0:09:12 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676530 2022-02-11 10:35:37 2022-02-11 12:31:45 2022-02-11 12:49:19 0:17:34 0:07:48 0:09:46 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6676531 2022-02-11 10:35:38 2022-02-11 12:32:26 2022-02-11 13:32:22 0:59:56 0:50:40 0:09:16 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676532 2022-02-11 10:35:39 2022-02-11 12:33:06 2022-02-11 13:03:22 0:30:16 0:20:26 0:09:50 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676533 2022-02-11 10:35:41 2022-02-11 12:34:17 2022-02-11 13:29:45 0:55:28 0:45:19 0:10:09 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676534 2022-02-11 10:35:42 2022-02-11 12:34:17 2022-02-11 13:03:37 0:29:20 0:19:32 0:09:48 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 6676535 2022-02-11 10:35:43 2022-02-11 12:34:28 2022-02-11 13:22:22 0:47:54 0:37:07 0:10:47 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-02-11T12:51:49.551056+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3008 objects degraded (0.033%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6676536 2022-02-11 10:35:44 2022-02-11 12:35:18 2022-02-11 13:39:15 1:03:57 0:53:20 0:10:37 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6676537 2022-02-11 10:35:45 2022-02-11 12:36:19 2022-02-11 13:29:23 0:53:04 0:43:09 0:09:55 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} 1
pass 6676538 2022-02-11 10:35:46 2022-02-11 12:36:19 2022-02-11 13:17:30 0:41:11 0:28:45 0:12:26 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676539 2022-02-11 10:35:47 2022-02-11 12:37:59 2022-02-11 13:24:24 0:46:25 0:35:45 0:10:40 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6676540 2022-02-11 10:35:48 2022-02-11 12:38:20 2022-02-11 13:15:47 0:37:27 0:27:02 0:10:25 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676541 2022-02-11 10:35:49 2022-02-11 12:38:40 2022-02-11 13:33:58 0:55:18 0:46:41 0:08:37 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676542 2022-02-11 10:35:50 2022-02-11 12:39:01 2022-02-11 13:16:41 0:37:40 0:28:40 0:09:00 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676543 2022-02-11 10:35:51 2022-02-11 12:39:31 2022-02-11 13:40:09 1:00:38 0:49:17 0:11:21 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676544 2022-02-11 10:35:52 2022-02-11 12:39:41 2022-02-11 13:42:00 1:02:19 0:54:13 0:08:06 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} 1
pass 6676545 2022-02-11 10:35:53 2022-02-11 12:39:42 2022-02-11 13:15:24 0:35:42 0:26:37 0:09:05 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676546 2022-02-11 10:35:54 2022-02-11 12:39:42 2022-02-11 13:04:06 0:24:24 0:13:49 0:10:35 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6676547 2022-02-11 10:35:55 2022-02-11 12:39:52 2022-02-11 13:28:54 0:49:02 0:39:15 0:09:47 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 6676548 2022-02-11 10:35:56 2022-02-11 12:39:53 2022-02-11 13:47:22 1:07:29 0:55:36 0:11:53 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6676549 2022-02-11 10:35:57 2022-02-11 12:41:43 2022-02-11 13:01:35 0:19:52 0:09:35 0:10:17 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
fail 6676550 2022-02-11 10:35:58 2022-02-11 12:41:54 2022-02-11 13:00:30 0:18:36 0:07:29 0:11:07 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676551 2022-02-11 10:35:59 2022-02-11 12:42:44 2022-02-11 13:02:01 0:19:17 0:08:47 0:10:30 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676552 2022-02-11 10:36:00 2022-02-11 12:42:45 2022-02-11 13:33:09 0:50:24 0:39:44 0:10:40 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 6676553 2022-02-11 10:36:01 2022-02-11 12:43:25 2022-02-11 13:41:15 0:57:50 0:47:40 0:10:10 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676554 2022-02-11 10:36:02 2022-02-11 12:43:55 2022-02-11 13:01:17 0:17:22 0:07:50 0:09:32 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6676555 2022-02-11 10:36:03 2022-02-11 12:44:06 2022-02-11 13:45:33 1:01:27 0:51:31 0:09:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676556 2022-02-11 10:36:04 2022-02-11 12:44:06 2022-02-11 13:14:03 0:29:57 0:20:18 0:09:39 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676557 2022-02-11 10:36:05 2022-02-11 12:44:36 2022-02-11 13:40:08 0:55:32 0:46:43 0:08:49 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676558 2022-02-11 10:36:06 2022-02-11 12:44:37 2022-02-11 13:14:23 0:29:46 0:19:44 0:10:02 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6676559 2022-02-11 10:36:07 2022-02-11 12:44:47 2022-02-11 13:34:13 0:49:26 0:39:31 0:09:55 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6676560 2022-02-11 10:36:08 2022-02-11 12:44:57 2022-02-11 13:14:27 0:29:30 0:19:44 0:09:46 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6676561 2022-02-11 10:36:09 2022-02-11 12:45:18 2022-02-11 13:37:50 0:52:32 0:44:04 0:08:28 smithi master centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 1
pass 6676562 2022-02-11 10:36:10 2022-02-11 12:45:18 2022-02-11 13:45:28 1:00:10 0:50:07 0:10:03 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
fail 6676563 2022-02-11 10:36:11 2022-02-11 12:46:39 2022-02-11 13:04:12 0:17:33 0:07:20 0:10:13 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676564 2022-02-11 10:36:12 2022-02-11 12:46:49 2022-02-11 13:25:08 0:38:19 0:27:37 0:10:42 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6676565 2022-02-11 10:36:13 2022-02-11 12:46:59 2022-02-11 13:25:38 0:38:39 0:27:42 0:10:57 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6676566 2022-02-11 10:36:14 2022-02-11 12:48:20 2022-02-11 13:45:31 0:57:11 0:49:02 0:08:09 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
pass 6676567 2022-02-11 10:36:15 2022-02-11 12:49:00 2022-02-11 13:48:31 0:59:31 0:50:43 0:08:48 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676568 2022-02-11 10:36:16 2022-02-11 12:49:21 2022-02-11 13:52:36 1:03:15 0:54:11 0:09:04 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
pass 6676569 2022-02-11 10:36:17 2022-02-11 12:49:21 2022-02-11 13:29:14 0:39:53 0:28:45 0:11:08 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676570 2022-02-11 10:36:18 2022-02-11 12:49:31 2022-02-11 13:49:25 0:59:54 0:49:29 0:10:25 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676571 2022-02-11 10:36:19 2022-02-11 12:50:02 2022-02-11 13:13:44 0:23:42 0:14:00 0:09:42 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 6676572 2022-02-11 10:36:20 2022-02-11 12:50:42 2022-02-11 13:59:15 1:08:33 0:57:58 0:10:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6676573 2022-02-11 10:36:21 2022-02-11 12:51:43 2022-02-11 13:09:11 0:17:28 0:07:33 0:09:55 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676574 2022-02-11 10:36:22 2022-02-11 12:52:03 2022-02-11 13:11:33 0:19:30 0:08:57 0:10:33 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6676575 2022-02-11 10:36:23 2022-02-11 12:52:13 2022-02-11 13:19:32 0:27:19 0:19:06 0:08:13 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6676576 2022-02-11 10:36:24 2022-02-11 12:52:24 2022-02-11 13:48:30 0:56:06 0:45:22 0:10:44 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6676577 2022-02-11 10:36:25 2022-02-11 12:53:34 2022-02-11 13:11:47 0:18:13 0:07:54 0:10:19 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff-multipeer} 2
pass 6676578 2022-02-11 10:36:26 2022-02-11 12:54:05 2022-02-11 13:57:00 1:02:55 0:52:20 0:10:35 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676579 2022-02-11 10:36:27 2022-02-11 12:54:45 2022-02-11 13:24:14 0:29:29 0:19:22 0:10:07 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6676580 2022-02-11 10:36:28 2022-02-11 12:54:45 2022-02-11 13:52:44 0:57:59 0:47:46 0:10:13 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
pass 6676581 2022-02-11 10:36:29 2022-02-11 12:55:16 2022-02-11 13:26:21 0:31:05 0:19:08 0:11:57 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6676582 2022-02-11 10:36:30 2022-02-11 12:57:06 2022-02-11 14:00:34 1:03:28 0:52:55 0:10:33 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-stress-workunit} 2
pass 6676583 2022-02-11 10:36:31 2022-02-11 12:59:47 2022-02-11 13:54:19 0:54:32 0:43:28 0:11:04 smithi master ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6676584 2022-02-11 10:36:32 2022-02-11 13:00:38 2022-02-11 13:17:51 0:17:13 0:07:02 0:10:11 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit-multipeer} 2
pass 6676585 2022-02-11 10:36:33 2022-02-11 13:00:48 2022-02-11 13:51:21 0:50:33 0:39:30 0:11:03 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6676586 2022-02-11 10:36:34 2022-02-11 13:01:18 2022-02-11 13:41:35 0:40:17 0:28:54 0:11:23 smithi master ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
fail 6676587 2022-02-11 10:36:35 2022-02-11 13:01:29 2022-02-11 14:11:49 1:10:20 0:55:44 0:14:36 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

"2022-02-11T13:55:26.587012+0000 mon.a (mon.0) 1818 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6676588 2022-02-11 10:36:36 2022-02-11 13:01:39 2022-02-11 13:40:59 0:39:20 0:29:06 0:10:14 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 6676589 2022-02-11 10:36:37 2022-02-11 13:01:49 2022-02-11 13:59:38 0:57:49 0:47:53 0:09:56 smithi master ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
pass 6676590 2022-02-11 10:36:38 2022-02-11 13:02:10 2022-02-11 14:05:22 1:03:12 0:53:58 0:09:14 smithi master centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/rbd_mirror} 1
pass 6676591 2022-02-11 10:36:39 2022-02-11 13:02:10 2022-02-11 13:39:20 0:37:10 0:27:48 0:09:22 smithi master centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 6676592 2022-02-11 10:36:40 2022-02-11 13:02:21 2022-02-11 14:02:12 0:59:51 0:50:12 0:09:39 smithi master centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2