Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4317452 2019-09-19 12:39:06 2019-09-19 15:23:23 2019-09-19 16:03:23 0:40:00 0:09:41 0:30:19 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-bootstrap-workunit.yaml} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_bootstrap.sh) on smithi013 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=805995b8264ab8566c39ac82e25f07fbb7d0777d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_bootstrap.sh'

pass 4317453 2019-09-19 12:39:06 2019-09-19 15:23:31 2019-09-19 16:27:31 1:04:00 0:41:05 0:22:55 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317454 2019-09-19 12:39:07 2019-09-19 15:24:39 2019-09-19 15:56:38 0:31:59 0:21:52 0:10:07 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-ha-workunit.yaml} 2
pass 4317455 2019-09-19 12:39:08 2019-09-19 15:24:54 2019-09-19 16:22:54 0:58:00 0:25:05 0:32:55 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317456 2019-09-19 12:39:09 2019-09-19 15:24:59 2019-09-19 16:00:58 0:35:59 0:17:39 0:18:20 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml} 2
pass 4317457 2019-09-19 12:39:09 2019-09-19 15:26:36 2019-09-19 16:38:36 1:12:00 0:36:04 0:35:56 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317458 2019-09-19 12:39:10 2019-09-19 15:27:04 2019-09-19 16:27:04 1:00:00 0:26:58 0:33:02 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-config-key.yaml} 2
fail 4317459 2019-09-19 12:39:11 2019-09-19 15:27:32 2019-09-19 16:19:32 0:52:00 0:40:06 0:11:54 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
Failure Reason:

Found coredumps on ubuntu@smithi076.front.sepia.ceph.com

pass 4317460 2019-09-19 12:39:12 2019-09-19 15:27:34 2019-09-19 15:55:34 0:28:00 0:19:30 0:08:30 smithi master centos 7.6 rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-bitmap.yaml openstack.yaml supported-random-distro$/{centos_7.yaml}} 1
pass 4317461 2019-09-19 12:39:12 2019-09-19 15:35:18 2019-09-19 16:23:18 0:48:00 0:26:49 0:21:11 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml} 2
pass 4317462 2019-09-19 12:39:13 2019-09-19 15:35:20 2019-09-19 16:09:19 0:33:59 0:24:35 0:09:24 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317463 2019-09-19 12:39:14 2019-09-19 15:55:40 2019-09-19 16:29:40 0:34:00 0:21:38 0:12:22 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-none.yaml} 2
pass 4317464 2019-09-19 12:39:14 2019-09-19 15:56:54 2019-09-19 16:44:54 0:48:00 0:34:10 0:13:50 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317465 2019-09-19 12:39:15 2019-09-19 15:57:15 2019-09-19 16:33:14 0:35:59 0:21:21 0:14:38 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-simple.yaml} 2
pass 4317466 2019-09-19 12:39:16 2019-09-19 15:57:15 2019-09-19 16:37:15 0:40:00 0:27:18 0:12:42 smithi master centos 7.6 rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-low-osd-mem-target.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml} 1
pass 4317467 2019-09-19 12:39:17 2019-09-19 15:58:49 2019-09-19 16:20:49 0:22:00 0:16:14 0:05:46 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-bootstrap-workunit.yaml} 2
pass 4317468 2019-09-19 12:39:17 2019-09-19 15:59:05 2019-09-19 16:55:05 0:56:00 0:41:56 0:14:04 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317469 2019-09-19 12:39:18 2019-09-19 16:00:48 2019-09-19 16:28:47 0:27:59 0:16:03 0:11:56 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-ha-workunit.yaml} 2
pass 4317470 2019-09-19 12:39:19 2019-09-19 16:01:00 2019-09-19 16:34:59 0:33:59 0:21:28 0:12:31 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317471 2019-09-19 12:39:19 2019-09-19 16:01:00 2019-09-19 16:30:59 0:29:59 0:23:11 0:06:48 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml} 2
pass 4317472 2019-09-19 12:39:20 2019-09-19 16:01:18 2019-09-19 16:45:17 0:43:59 0:34:15 0:09:44 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317473 2019-09-19 12:39:21 2019-09-19 16:01:24 2019-09-19 16:37:23 0:35:59 0:24:46 0:11:13 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-config-key.yaml} 2
pass 4317474 2019-09-19 12:39:22 2019-09-19 16:02:54 2019-09-19 16:56:54 0:54:00 0:44:20 0:09:40 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317475 2019-09-19 12:39:22 2019-09-19 16:02:55 2019-09-19 16:32:54 0:29:59 0:19:25 0:10:34 smithi master centos 7.6 rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-stupid.yaml openstack.yaml supported-random-distro$/{centos_7.yaml}} 1
pass 4317476 2019-09-19 12:39:23 2019-09-19 16:03:01 2019-09-19 16:37:00 0:33:59 0:27:13 0:06:46 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml} 2
pass 4317477 2019-09-19 12:39:24 2019-09-19 16:03:03 2019-09-19 16:41:02 0:37:59 0:25:57 0:12:02 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317478 2019-09-19 12:39:24 2019-09-19 16:03:08 2019-09-19 16:37:07 0:33:59 0:27:22 0:06:37 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-none.yaml} 2
pass 4317479 2019-09-19 12:39:25 2019-09-19 16:03:08 2019-09-19 17:01:08 0:58:00 0:38:51 0:19:09 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317480 2019-09-19 12:39:26 2019-09-19 16:03:19 2019-09-19 16:55:19 0:52:00 0:28:52 0:23:08 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-simple.yaml} 2
pass 4317481 2019-09-19 12:39:27 2019-09-19 16:03:19 2019-09-19 16:41:19 0:38:00 0:26:44 0:11:16 smithi master centos 7.6 rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml} 1
fail 4317482 2019-09-19 12:39:27 2019-09-19 16:03:24 2019-09-19 16:25:24 0:22:00 0:09:25 0:12:35 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-bootstrap-workunit.yaml} 2
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_bootstrap.sh) on smithi022 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=805995b8264ab8566c39ac82e25f07fbb7d0777d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_bootstrap.sh'

pass 4317483 2019-09-19 12:39:28 2019-09-19 16:05:02 2019-09-19 16:59:01 0:53:59 0:42:34 0:11:25 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317484 2019-09-19 12:39:29 2019-09-19 16:05:35 2019-09-19 16:35:34 0:29:59 0:19:29 0:10:30 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-ha-workunit.yaml} 2
fail 4317485 2019-09-19 12:39:30 2019-09-19 16:05:59 2019-09-19 16:21:59 0:16:00 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
Failure Reason:

Command failed on smithi088 with status 1: 'sudo yum install -y kernel'

pass 4317486 2019-09-19 12:39:30 2019-09-19 16:07:00 2019-09-19 16:59:00 0:52:00 0:21:05 0:30:55 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml} 2
pass 4317487 2019-09-19 12:39:31 2019-09-19 16:07:33 2019-09-19 16:51:32 0:43:59 0:36:18 0:07:41 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317488 2019-09-19 12:39:32 2019-09-19 16:07:39 2019-09-19 16:53:38 0:45:59 0:28:06 0:17:53 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-config-key.yaml} 2
fail 4317489 2019-09-19 12:39:33 2019-09-19 16:09:35 2019-09-19 17:21:35 1:12:00 1:01:46 0:10:14 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
Failure Reason:

"2019-09-19T16:32:29.606028+0000 mon.a (mon.0) 297 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 30 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4317490 2019-09-19 12:39:33 2019-09-19 16:10:27 2019-09-19 16:40:26 0:29:59 0:23:15 0:06:44 smithi master rhel 7.6 rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-comp.yaml openstack.yaml supported-random-distro$/{rhel_7.yaml}} 1
pass 4317491 2019-09-19 12:39:34 2019-09-19 16:11:22 2019-09-19 16:53:22 0:42:00 0:27:32 0:14:28 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml} 2
pass 4317492 2019-09-19 12:39:35 2019-09-19 16:11:22 2019-09-19 16:55:22 0:44:00 0:23:45 0:20:15 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317493 2019-09-19 12:39:36 2019-09-19 16:13:17 2019-09-19 16:49:16 0:35:59 0:24:07 0:11:52 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-none.yaml} 2
pass 4317494 2019-09-19 12:39:36 2019-09-19 16:17:14 2019-09-19 17:07:14 0:50:00 0:30:10 0:19:50 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317495 2019-09-19 12:39:37 2019-09-19 16:17:14 2019-09-19 17:05:14 0:48:00 0:25:12 0:22:48 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-simple.yaml} 2
pass 4317496 2019-09-19 12:39:38 2019-09-19 16:17:15 2019-09-19 16:53:14 0:35:59 0:26:18 0:09:41 smithi master centos 7.6 rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-stupid.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml} 1
pass 4317497 2019-09-19 12:39:39 2019-09-19 16:19:04 2019-09-19 16:53:04 0:34:00 0:16:32 0:17:28 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-bootstrap-workunit.yaml} 2
fail 4317498 2019-09-19 12:39:39 2019-09-19 16:19:05 2019-09-19 17:43:05 1:24:00 0:58:31 0:25:29 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
Failure Reason:

"2019-09-19T16:57:13.233659+0000 mon.a (mon.0) 261 : cluster [WRN] Health check failed: 13 slow ops, oldest one blocked for 33 sec, daemons [osd,1,osd,2] have slow ops. (SLOW_OPS)" in cluster log

pass 4317499 2019-09-19 12:39:40 2019-09-19 16:19:19 2019-09-19 16:51:18 0:31:59 0:16:02 0:15:57 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-ha-workunit.yaml} 2
pass 4317500 2019-09-19 12:39:41 2019-09-19 16:19:33 2019-09-19 16:59:33 0:40:00 0:23:59 0:16:01 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317501 2019-09-19 12:39:42 2019-09-19 16:20:28 2019-09-19 16:50:27 0:29:59 0:17:53 0:12:06 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml} 2
pass 4317502 2019-09-19 12:39:43 2019-09-19 16:20:50 2019-09-19 17:02:50 0:42:00 0:35:36 0:06:24 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317503 2019-09-19 12:39:43 2019-09-19 16:21:21 2019-09-19 16:57:20 0:35:59 0:27:12 0:08:47 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-config-key.yaml} 2
pass 4317504 2019-09-19 12:39:44 2019-09-19 16:22:15 2019-09-19 17:20:14 0:57:59 0:43:39 0:14:20 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317505 2019-09-19 12:39:45 2019-09-19 16:22:16 2019-09-19 16:54:15 0:31:59 0:23:29 0:08:30 smithi master rhel 7.6 rbd/singleton/{all/rbd_mirror.yaml objectstore/filestore-xfs.yaml openstack.yaml supported-random-distro$/{rhel_7.yaml}} 1
pass 4317506 2019-09-19 12:39:46 2019-09-19 16:22:34 2019-09-19 16:54:34 0:32:00 0:21:11 0:10:49 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml} 2
pass 4317507 2019-09-19 12:39:46 2019-09-19 16:22:55 2019-09-19 17:12:55 0:50:00 0:26:22 0:23:38 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317508 2019-09-19 12:39:47 2019-09-19 16:23:13 2019-09-19 17:03:12 0:39:59 0:25:20 0:14:39 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-none.yaml} 2
pass 4317509 2019-09-19 12:39:48 2019-09-19 16:23:34 2019-09-19 17:11:34 0:48:00 0:36:22 0:11:38 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317510 2019-09-19 12:39:49 2019-09-19 16:25:23 2019-09-19 16:59:22 0:33:59 0:21:24 0:12:35 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-simple.yaml} 2
pass 4317511 2019-09-19 12:39:49 2019-09-19 16:25:24 2019-09-19 17:01:24 0:36:00 0:26:13 0:09:47 smithi master centos 7.6 rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/bluestore-comp.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml} 1
pass 4317512 2019-09-19 12:39:50 2019-09-19 16:25:25 2019-09-19 16:57:24 0:31:59 0:12:47 0:19:12 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-bootstrap-workunit.yaml} 2
pass 4317513 2019-09-19 12:39:51 2019-09-19 16:26:44 2019-09-19 17:26:44 1:00:00 0:47:14 0:12:46 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317514 2019-09-19 12:39:52 2019-09-19 16:26:56 2019-09-19 17:06:55 0:39:59 0:22:38 0:17:21 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-ha-workunit.yaml} 2
pass 4317515 2019-09-19 12:39:52 2019-09-19 16:27:06 2019-09-19 17:13:05 0:45:59 0:27:57 0:18:02 smithi master rhel 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317516 2019-09-19 12:39:53 2019-09-19 16:27:32 2019-09-19 16:59:32 0:32:00 0:20:34 0:11:26 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml} 2
pass 4317517 2019-09-19 12:39:54 2019-09-19 16:27:43 2019-09-19 17:13:42 0:45:59 0:34:22 0:11:37 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317518 2019-09-19 12:39:55 2019-09-19 16:29:00 2019-09-19 17:09:00 0:40:00 0:21:40 0:18:20 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-config-key.yaml} 2
pass 4317519 2019-09-19 12:39:55 2019-09-19 16:29:01 2019-09-19 17:29:00 0:59:59 0:47:48 0:12:11 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-fsx-workunit.yaml} 2
pass 4317520 2019-09-19 12:39:56 2019-09-19 16:29:00 2019-09-19 16:59:00 0:30:00 0:23:21 0:06:39 smithi master rhel 7.6 rbd/singleton/{all/rbd_mirror.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml supported-random-distro$/{rhel_7.yaml}} 1
pass 4317521 2019-09-19 12:39:57 2019-09-19 16:29:01 2019-09-19 17:13:00 0:43:59 0:24:49 0:19:10 smithi master centos 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml} 2
pass 4317522 2019-09-19 12:39:58 2019-09-19 16:29:10 2019-09-19 17:07:10 0:38:00 0:19:43 0:18:17 smithi master ubuntu 18.04 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-stress-workunit.yaml} 2
pass 4317523 2019-09-19 12:39:58 2019-09-19 16:29:26 2019-09-19 17:09:25 0:39:59 0:21:27 0:18:32 smithi master ubuntu 18.04 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-none.yaml} 2
pass 4317524 2019-09-19 12:39:59 2019-09-19 16:29:41 2019-09-19 17:17:41 0:48:00 0:33:57 0:14:03 smithi master centos 7.6 rbd/mirror-thrash/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml policy/simple.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{centos_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit.yaml} 2
pass 4317525 2019-09-19 12:40:00 2019-09-19 16:30:20 2019-09-19 17:06:20 0:36:00 0:27:05 0:08:55 smithi master rhel 7.6 rbd/mirror/{base/install.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} users/mirror.yaml workloads/rbd-mirror-workunit-policy-simple.yaml} 2
pass 4317526 2019-09-19 12:40:01 2019-09-19 16:30:47 2019-09-19 17:08:46 0:37:59 0:26:32 0:11:27 smithi master centos 7.6 rbd/valgrind/{base/install.yaml centos_latest.yaml clusters/{fixed-1.yaml openstack.yaml} objectstore/filestore-xfs.yaml validator/memcheck.yaml workloads/rbd_mirror.yaml} 1