Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5263395 2020-07-28 06:32:19 2020-07-28 11:54:32 2020-07-28 12:10:31 0:15:59 0:09:37 0:06:22 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-bootstrap-workunit} 2
fail 5263396 2020-07-28 06:32:20 2020-07-28 11:54:35 2020-07-28 13:22:36 1:28:01 1:07:53 0:20:08 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2020-07-28T12:23:30.124146+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 31/2742 objects degraded (1.131%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 5263397 2020-07-28 06:32:21 2020-07-28 11:54:35 2020-07-28 12:22:34 0:27:59 0:15:35 0:12:24 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 5263398 2020-07-28 06:32:22 2020-07-28 11:56:47 2020-07-28 12:46:48 0:50:01 0:31:20 0:18:41 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263399 2020-07-28 06:32:23 2020-07-28 11:56:48 2020-07-28 12:30:48 0:34:00 0:16:07 0:17:53 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 5263400 2020-07-28 06:32:23 2020-07-28 11:56:48 2020-07-28 12:38:48 0:42:00 0:15:26 0:26:34 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 5263401 2020-07-28 06:32:24 2020-07-28 11:58:39 2020-07-28 12:42:39 0:44:00 0:20:15 0:23:45 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} 2
pass 5263402 2020-07-28 06:32:25 2020-07-28 12:00:37 2020-07-28 12:40:37 0:40:00 0:23:44 0:16:16 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 5263403 2020-07-28 06:32:26 2020-07-28 12:00:50 2020-07-28 12:28:49 0:27:59 0:15:37 0:12:22 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 5263404 2020-07-28 06:32:27 2020-07-28 12:02:32 2020-07-28 13:08:33 1:06:01 0:55:38 0:10:23 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263405 2020-07-28 06:32:28 2020-07-28 12:02:32 2020-07-28 12:28:31 0:25:59 0:16:32 0:09:27 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 5263406 2020-07-28 06:32:29 2020-07-28 12:03:24 2020-07-28 12:51:25 0:48:01 0:41:24 0:06:37 smithi master centos 8.1 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} 1
pass 5263407 2020-07-28 06:32:30 2020-07-28 12:07:07 2020-07-28 13:11:07 1:04:00 0:26:28 0:37:32 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
pass 5263408 2020-07-28 06:32:31 2020-07-28 12:07:07 2020-07-28 12:47:06 0:39:59 0:30:54 0:09:05 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 5263409 2020-07-28 06:32:31 2020-07-28 12:08:21 2020-07-28 12:38:21 0:30:00 0:20:30 0:09:30 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 5263410 2020-07-28 06:32:32 2020-07-28 12:09:08 2020-07-28 12:41:08 0:32:00 0:21:51 0:10:09 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 5263411 2020-07-28 06:32:33 2020-07-28 12:10:48 2020-07-28 12:44:48 0:34:00 0:20:06 0:13:54 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} 2
pass 5263412 2020-07-28 06:32:34 2020-07-28 12:10:52 2020-07-28 13:10:52 1:00:00 0:53:33 0:06:27 smithi master centos 8.1 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/rbd_mirror} 1
pass 5263413 2020-07-28 06:32:35 2020-07-28 12:12:37 2020-07-28 13:06:38 0:54:01 0:21:39 0:32:22 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 5263414 2020-07-28 06:32:36 2020-07-28 12:12:37 2020-07-28 12:38:37 0:26:00 0:09:06 0:16:54 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-bootstrap-workunit} 2
pass 5263415 2020-07-28 06:32:37 2020-07-28 12:13:55 2020-07-28 13:57:58 1:44:03 1:34:21 0:09:42 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263416 2020-07-28 06:32:38 2020-07-28 12:13:58 2020-07-28 12:49:58 0:36:00 0:15:02 0:20:58 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 5263417 2020-07-28 06:32:39 2020-07-28 12:16:37 2020-07-28 13:14:38 0:58:01 0:37:03 0:20:58 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263418 2020-07-28 06:32:40 2020-07-28 12:16:51 2020-07-28 12:54:51 0:38:00 0:20:50 0:17:10 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 5263419 2020-07-28 06:32:41 2020-07-28 12:17:09 2020-07-28 13:05:09 0:48:00 0:16:26 0:31:34 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 5263420 2020-07-28 06:32:42 2020-07-28 12:18:08 2020-07-28 12:56:08 0:38:00 0:18:50 0:19:10 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} 2
pass 5263421 2020-07-28 06:32:43 2020-07-28 12:18:08 2020-07-28 13:06:08 0:48:00 0:23:03 0:24:57 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 5263422 2020-07-28 06:32:44 2020-07-28 12:18:19 2020-07-28 13:12:20 0:54:01 0:21:22 0:32:39 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 5263423 2020-07-28 06:32:45 2020-07-28 12:18:46 2020-07-28 12:54:46 0:36:00 0:25:27 0:10:33 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit} 2
pass 5263424 2020-07-28 06:32:46 2020-07-28 12:18:50 2020-07-28 12:54:50 0:36:00 0:21:01 0:14:59 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 5263425 2020-07-28 06:32:46 2020-07-28 12:20:55 2020-07-28 13:08:55 0:48:00 0:41:22 0:06:38 smithi master ubuntu 18.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
pass 5263426 2020-07-28 06:32:47 2020-07-28 12:21:22 2020-07-28 13:01:22 0:40:00 0:26:07 0:13:53 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
fail 5263427 2020-07-28 06:32:48 2020-07-28 12:22:53 2020-07-28 13:38:55 1:16:02 0:25:14 0:50:48 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.0'

pass 5263428 2020-07-28 06:32:49 2020-07-28 12:22:53 2020-07-28 13:02:54 0:40:01 0:26:14 0:13:47 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 5263429 2020-07-28 06:32:50 2020-07-28 12:23:23 2020-07-28 13:13:23 0:50:00 0:21:26 0:28:34 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 5263430 2020-07-28 06:32:51 2020-07-28 12:24:20 2020-07-28 13:28:21 1:04:01 0:35:46 0:28:15 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263431 2020-07-28 06:32:52 2020-07-28 12:24:20 2020-07-28 13:24:21 1:00:01 0:53:46 0:06:15 smithi master centos 8.1 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
pass 5263432 2020-07-28 06:32:53 2020-07-28 12:24:50 2020-07-28 13:00:50 0:36:00 0:21:45 0:14:15 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
pass 5263433 2020-07-28 06:32:54 2020-07-28 12:25:38 2020-07-28 12:53:38 0:28:00 0:14:03 0:13:57 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 5263434 2020-07-28 06:32:55 2020-07-28 12:26:06 2020-07-28 12:54:06 0:28:00 0:19:08 0:08:52 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} 2
pass 5263435 2020-07-28 06:32:56 2020-07-28 12:28:29 2020-07-28 12:56:29 0:28:00 0:14:57 0:13:03 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
fail 5263436 2020-07-28 06:32:57 2020-07-28 12:28:29 2020-07-28 13:14:29 0:46:00 0:24:15 0:21:45 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.4 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.4'

pass 5263437 2020-07-28 06:32:58 2020-07-28 12:28:33 2020-07-28 13:04:33 0:36:00 0:21:00 0:15:00 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 5263438 2020-07-28 06:32:59 2020-07-28 12:28:51 2020-07-28 13:06:52 0:38:01 0:16:05 0:21:56 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 5263439 2020-07-28 06:33:00 2020-07-28 12:30:11 2020-07-28 13:10:11 0:40:00 0:29:10 0:10:50 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 5263440 2020-07-28 06:33:01 2020-07-28 12:30:51 2020-07-28 13:08:49 0:37:58 0:22:29 0:15:29 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 5263441 2020-07-28 06:33:02 2020-07-28 12:32:40 2020-07-28 13:00:40 0:28:00 0:16:04 0:11:56 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 5263442 2020-07-28 06:33:03 2020-07-28 12:32:58 2020-07-28 13:00:57 0:27:59 0:21:45 0:06:14 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} 2
pass 5263443 2020-07-28 06:33:04 2020-07-28 12:34:12 2020-07-28 13:16:12 0:42:00 0:21:30 0:20:30 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 5263444 2020-07-28 06:33:05 2020-07-28 12:34:32 2020-07-28 13:26:33 0:52:01 0:46:50 0:05:11 smithi master rhel 8.1 rbd/singleton/{all/rbd_mirror objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} 1
pass 5263445 2020-07-28 06:33:06 2020-07-28 12:38:23 2020-07-28 13:06:23 0:28:00 0:21:10 0:06:50 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 5263446 2020-07-28 06:33:07 2020-07-28 12:38:38 2020-07-28 13:40:39 1:02:01 0:51:09 0:10:52 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263447 2020-07-28 06:33:08 2020-07-28 12:39:06 2020-07-28 13:19:06 0:40:00 0:20:56 0:19:04 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 5263448 2020-07-28 06:33:09 2020-07-28 12:39:06 2020-07-28 13:19:06 0:40:00 0:26:51 0:13:09 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 5263449 2020-07-28 06:33:10 2020-07-28 12:40:54 2020-07-28 13:20:54 0:40:00 0:31:26 0:08:34 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263450 2020-07-28 06:33:11 2020-07-28 12:40:54 2020-07-28 13:40:55 1:00:01 0:53:53 0:06:08 smithi master centos 8.1 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
pass 5263451 2020-07-28 06:33:12 2020-07-28 12:41:09 2020-07-28 13:15:10 0:34:01 0:25:57 0:08:04 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 5263452 2020-07-28 06:33:13 2020-07-28 12:42:56 2020-07-28 13:12:56 0:30:00 0:14:31 0:15:29 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 5263453 2020-07-28 06:33:14 2020-07-28 12:42:56 2020-07-28 13:44:57 1:02:01 0:34:39 0:27:22 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263454 2020-07-28 06:33:15 2020-07-28 12:43:08 2020-07-28 13:17:08 0:34:00 0:15:20 0:18:40 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 5263455 2020-07-28 06:33:16 2020-07-28 12:43:13 2020-07-28 13:15:13 0:32:00 0:23:13 0:08:47 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} 2
pass 5263456 2020-07-28 06:33:17 2020-07-28 12:45:06 2020-07-28 13:15:06 0:30:00 0:15:49 0:14:11 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 5263457 2020-07-28 06:33:18 2020-07-28 12:46:03 2020-07-28 13:16:03 0:30:00 0:15:55 0:14:05 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 5263458 2020-07-28 06:33:19 2020-07-28 12:46:24 2020-07-28 14:06:26 1:20:02 1:12:35 0:07:27 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263459 2020-07-28 06:33:20 2020-07-28 12:46:49 2020-07-28 13:16:49 0:30:00 0:20:45 0:09:15 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 5263460 2020-07-28 06:33:21 2020-07-28 12:47:08 2020-07-28 13:15:07 0:27:59 0:16:04 0:11:55 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 5263461 2020-07-28 06:33:22 2020-07-28 12:48:19 2020-07-28 13:44:19 0:56:00 0:36:32 0:19:28 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263462 2020-07-28 06:33:23 2020-07-28 12:48:21 2020-07-28 13:16:21 0:28:00 0:16:46 0:11:14 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 5263463 2020-07-28 06:33:24 2020-07-28 12:50:16 2020-07-28 13:38:16 0:48:00 0:41:30 0:06:30 smithi master centos 8.1 rbd/singleton/{all/rbd_mirror objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} 1
pass 5263464 2020-07-28 06:33:25 2020-07-28 12:51:43 2020-07-28 13:19:43 0:28:00 0:21:23 0:06:37 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 5263465 2020-07-28 06:33:27 2020-07-28 12:52:20 2020-07-28 13:18:20 0:26:00 0:19:28 0:06:32 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} 2
pass 5263466 2020-07-28 06:33:28 2020-07-28 12:53:55 2020-07-28 13:29:55 0:36:00 0:21:24 0:14:36 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 5263467 2020-07-28 06:33:29 2020-07-28 12:53:58 2020-07-28 13:31:58 0:38:00 0:27:37 0:10:23 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
fail 5263468 2020-07-28 06:33:30 2020-07-28 12:53:59 2020-07-28 14:14:01 1:20:02 1:10:36 0:09:26 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2020-07-28T13:16:36.670648+0000 osd.2 (osd.2) 3 : cluster [WRN] slow request osd_op(client.4344.0:1872 3.26 3:67cae2ed:::rbd_mirroring:head [watch ping cookie 93967214506368 gen 5] snapc 0=[] ondisk+write+known_if_redirected e172) initiated 2020-07-28T13:16:05.939145+0000 currently delayed" in cluster log

pass 5263469 2020-07-28 06:33:31 2020-07-28 12:54:07 2020-07-28 13:54:08 1:00:01 0:52:27 0:07:34 smithi master centos 8.1 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/rbd_mirror} 1
pass 5263470 2020-07-28 06:33:32 2020-07-28 12:54:48 2020-07-28 13:32:48 0:38:00 0:26:31 0:11:29 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 5263471 2020-07-28 06:33:32 2020-07-28 12:54:52 2020-07-28 13:10:51 0:15:59 0:08:56 0:07:03 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
pass 5263472 2020-07-28 06:33:33 2020-07-28 12:54:53 2020-07-28 13:40:53 0:46:00 0:30:40 0:15:20 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 5263473 2020-07-28 06:33:34 2020-07-28 12:56:12 2020-07-28 13:38:12 0:42:00 0:19:49 0:22:11 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-ha-workunit} 2
pass 5263474 2020-07-28 06:33:35 2020-07-28 12:56:12 2020-07-28 13:42:12 0:46:00 0:21:55 0:24:05 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit} 2
pass 5263475 2020-07-28 06:33:36 2020-07-28 12:56:12 2020-07-28 13:28:12 0:32:00 0:15:47 0:16:13 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 5263476 2020-07-28 06:33:37 2020-07-28 12:56:30 2020-07-28 13:26:30 0:30:00 0:20:24 0:09:36 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 5263477 2020-07-28 06:33:38 2020-07-28 12:58:15 2020-07-28 14:06:15 1:08:00 1:01:25 0:06:35 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263478 2020-07-28 06:33:39 2020-07-28 12:58:18 2020-07-28 13:28:17 0:29:59 0:19:17 0:10:42 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 5263479 2020-07-28 06:33:40 2020-07-28 13:00:35 2020-07-28 13:42:35 0:42:00 0:20:45 0:21:15 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 5263480 2020-07-28 06:33:41 2020-07-28 13:00:42 2020-07-28 14:00:42 1:00:00 0:48:33 0:11:27 smithi master rhel 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-fsx-workunit} 2
pass 5263481 2020-07-28 06:33:42 2020-07-28 13:00:51 2020-07-28 13:26:51 0:26:00 0:17:30 0:08:30 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 5263482 2020-07-28 06:33:43 2020-07-28 13:00:59 2020-07-28 13:50:59 0:50:00 0:41:38 0:08:22 smithi master centos 8.1 rbd/singleton/{all/rbd_mirror objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} 1
pass 5263483 2020-07-28 06:33:44 2020-07-28 13:01:24 2020-07-28 13:41:24 0:40:00 0:21:25 0:18:35 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} workloads/rbd-mirror-workunit-config-key} 2
pass 5263484 2020-07-28 06:33:45 2020-07-28 13:02:21 2020-07-28 13:44:21 0:42:00 0:30:45 0:11:15 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263485 2020-07-28 06:33:46 2020-07-28 13:02:55 2020-07-28 13:46:55 0:44:00 0:25:53 0:18:07 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 5263486 2020-07-28 06:33:47 2020-07-28 13:04:34 2020-07-28 13:38:34 0:34:00 0:26:01 0:07:59 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
pass 5263487 2020-07-28 06:33:48 2020-07-28 13:04:34 2020-07-28 13:38:34 0:34:00 0:19:49 0:14:11 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit} 2
pass 5263488 2020-07-28 06:33:48 2020-07-28 13:05:10 2020-07-28 14:05:11 1:00:01 0:52:36 0:07:25 smithi master centos 8.1 rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/rbd_mirror} 1
pass 5263489 2020-07-28 06:33:49 2020-07-28 13:06:26 2020-07-28 13:48:27 0:42:01 0:26:38 0:15:23 smithi master rhel 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-simple} 2
pass 5263490 2020-07-28 06:33:50 2020-07-28 13:06:26 2020-07-28 13:24:26 0:18:00 0:09:27 0:08:33 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-bootstrap-workunit} 2
fail 5263491 2020-07-28 06:33:51 2020-07-28 13:06:39 2020-07-28 14:10:40 1:04:01 0:55:30 0:08:31 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2020-07-28T13:20:02.870408+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: Degraded data redundancy: 2/2562 objects degraded (0.078%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 5263492 2020-07-28 06:33:52 2020-07-28 13:06:53 2020-07-28 13:30:53 0:24:00 0:14:59 0:09:01 smithi master centos 8.1 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-ha-workunit} 2
pass 5263493 2020-07-28 06:33:53 2020-07-28 13:08:51 2020-07-28 13:46:51 0:38:00 0:32:08 0:05:52 smithi master centos 8.1 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} 2
pass 5263494 2020-07-28 06:33:54 2020-07-28 13:08:51 2020-07-28 13:34:51 0:26:00 0:16:20 0:09:40 smithi master ubuntu 18.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2