Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4554634 2019-11-30 03:20:35 2019-12-02 17:32:04 2019-12-02 17:58:04 0:26:00 0:17:00 0:09:00 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_deep_flatten.yaml} 1
pass 4554635 2019-11-30 03:20:36 2019-12-02 17:32:16 2019-12-02 19:08:21 1:36:05 0:27:47 1:08:18 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4554636 2019-11-30 03:20:36 2019-12-02 17:34:04 2019-12-02 18:26:04 0:52:00 0:31:18 0:20:42 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} 3
pass 4554637 2019-11-30 03:20:37 2019-12-02 17:34:05 2019-12-02 18:38:05 1:04:00 0:27:18 0:36:42 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} 3
fail 4554638 2019-11-30 03:20:38 2019-12-02 17:34:18 2019-12-02 20:06:22 2:32:04 2:19:32 0:12:32 smithi master krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi078 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludexI_F3k -r -- '-g auto -g blockdev -x clone'"

pass 4554639 2019-11-30 03:20:38 2019-12-02 17:34:43 2019-12-02 18:52:45 1:18:02 1:04:39 0:13:23 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
fail 4554640 2019-11-30 03:20:39 2019-12-02 17:35:59 2019-12-02 18:03:58 0:27:59 0:15:37 0:12:22 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} 2
Failure Reason:

Command failed on smithi064 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 4554641 2019-11-30 03:20:40 2019-12-02 17:35:59 2019-12-02 18:01:58 0:25:59 0:15:31 0:10:28 smithi master krbd/wac/sysfs/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} 1
fail 4554642 2019-11-30 03:20:40 2019-12-02 17:36:20 2019-12-02 18:22:20 0:46:00 0:20:54 0:25:06 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi157 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2fdc51894157a2a43577ba3ec7d0fb12a25be4c5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4554643 2019-11-30 03:20:41 2019-12-02 17:37:57 2019-12-02 18:27:57 0:50:00 0:21:18 0:28:42 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4554644 2019-11-30 03:20:42 2019-12-02 17:37:58 2019-12-02 18:45:58 1:08:00 0:17:22 0:50:38 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} 3
fail 4554645 2019-11-30 03:20:43 2019-12-02 17:37:58 2019-12-02 19:43:59 2:06:01 1:23:55 0:42:06 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} 3
Failure Reason:

"2019-12-02T18:40:14.399942+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 86124 slow ops, oldest one blocked for 31 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4554646 2019-11-30 03:20:43 2019-12-02 17:37:58 2019-12-02 18:23:57 0:45:59 0:18:14 0:27:45 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_huge_osdmap.yaml} 3
pass 4554647 2019-11-30 03:20:44 2019-12-02 17:38:10 2019-12-02 18:36:14 0:58:04 0:48:28 0:09:36 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
pass 4554648 2019-11-30 03:20:45 2019-12-02 17:39:47 2019-12-02 18:05:45 0:25:58 0:16:34 0:09:24 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_discard.yaml} 1
fail 4554649 2019-11-30 03:20:45 2019-12-02 17:39:47 2019-12-02 18:33:46 0:53:59 0:42:41 0:11:18 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2019-12-02T17:56:19.658781+0000 mon.b (mon.0) 110 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4554650 2019-11-30 03:20:46 2019-12-02 17:39:55 2019-12-02 18:23:54 0:43:59 0:19:56 0:24:03 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4554651 2019-11-30 03:20:47 2019-12-02 17:41:29 2019-12-02 18:25:29 0:44:00 0:31:12 0:12:48 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4554652 2019-11-30 03:20:47 2019-12-02 17:41:35 2019-12-02 19:05:36 1:24:01 0:49:54 0:34:07 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
pass 4554653 2019-11-30 03:20:48 2019-12-02 17:41:50 2019-12-02 18:31:49 0:49:59 0:19:12 0:30:47 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_namespaces.yaml} 3
pass 4554654 2019-11-30 03:20:49 2019-12-02 17:42:13 2019-12-02 19:42:14 2:00:01 0:31:22 1:28:39 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} 3
pass 4554655 2019-11-30 03:20:49 2019-12-02 17:43:04 2019-12-02 19:39:07 1:56:03 0:16:41 1:39:22 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4554656 2019-11-30 03:20:50 2019-12-02 17:43:32 2019-12-02 18:29:32 0:46:00 0:21:33 0:24:27 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4554657 2019-11-30 03:20:51 2019-12-02 17:43:44 2019-12-02 18:07:43 0:23:59 0:15:06 0:08:53 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} 1
pass 4554658 2019-11-30 03:20:51 2019-12-02 17:43:49 2019-12-02 18:25:49 0:42:00 0:23:27 0:18:33 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4554659 2019-11-30 03:20:52 2019-12-02 17:43:50 2019-12-02 20:33:53 2:50:03 0:59:13 1:50:50 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4554660 2019-11-30 03:20:53 2019-12-02 17:43:54 2019-12-02 18:55:54 1:12:00 0:21:59 0:50:01 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} 3
pass 4554661 2019-11-30 03:20:54 2019-12-02 17:45:59 2019-12-02 18:15:58 0:29:59 0:17:10 0:12:49 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4554662 2019-11-30 03:20:54 2019-12-02 17:48:07 2019-12-02 18:52:07 1:04:00 0:17:15 0:46:45 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4554663 2019-11-30 03:20:55 2019-12-02 17:48:07 2019-12-02 18:34:07 0:46:00 0:29:00 0:17:00 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} 3
pass 4554664 2019-11-30 03:20:56 2019-12-02 17:50:00 2019-12-02 19:40:02 1:50:02 0:23:41 1:26:21 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4554665 2019-11-30 03:20:56 2019-12-02 17:50:52 2019-12-02 19:24:53 1:34:01 0:16:25 1:17:36 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} 3
pass 4554666 2019-11-30 03:20:57 2019-12-02 17:51:37 2019-12-02 18:15:37 0:24:00 0:15:10 0:08:50 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} 2
pass 4554667 2019-11-30 03:20:58 2019-12-02 17:52:12 2019-12-02 18:34:11 0:41:59 0:28:21 0:13:38 smithi master krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} 3
pass 4554668 2019-11-30 03:20:58 2019-12-02 17:52:17 2019-12-02 18:36:20 0:44:03 0:16:11 0:27:52 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} 3
pass 4554669 2019-11-30 03:20:59 2019-12-02 17:54:10 2019-12-02 18:18:09 0:23:59 0:15:15 0:08:44 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_modprobe.yaml} 1
pass 4554670 2019-11-30 03:21:00 2019-12-02 17:54:11 2019-12-02 20:10:12 2:16:01 0:50:33 1:25:28 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4554671 2019-11-30 03:21:01 2019-12-02 17:54:11 2019-12-02 18:56:10 1:01:59 0:19:39 0:42:20 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
pass 4554672 2019-11-30 03:21:01 2019-12-02 17:54:11 2019-12-02 19:14:11 1:20:00 0:16:36 1:03:24 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4554673 2019-11-30 03:21:02 2019-12-02 17:54:20 2019-12-02 19:08:21 1:14:01 0:29:11 0:44:50 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4554674 2019-11-30 03:21:03 2019-12-02 17:56:11 2019-12-02 19:00:11 1:04:00 0:26:19 0:37:41 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} 3
pass 4554675 2019-11-30 03:21:03 2019-12-02 17:57:46 2019-12-02 20:05:47 2:08:01 0:17:11 1:50:50 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
pass 4554676 2019-11-30 03:21:04 2019-12-02 17:57:48 2019-12-02 19:03:48 1:06:00 0:28:52 0:37:08 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} 3
pass 4554677 2019-11-30 03:21:05 2019-12-02 17:57:51 2019-12-02 18:23:50 0:25:59 0:15:19 0:10:40 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} 1
pass 4554678 2019-11-30 03:21:05 2019-12-02 17:58:06 2019-12-02 19:24:06 1:26:00 0:27:35 0:58:25 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4554679 2019-11-30 03:21:06 2019-12-02 17:58:11 2019-12-02 19:12:11 1:14:00 0:30:10 0:43:50 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} 3
pass 4554680 2019-11-30 03:21:07 2019-12-02 18:00:10 2019-12-02 18:46:09 0:45:59 0:30:32 0:15:27 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} 3
fail 4554681 2019-11-30 03:21:07 2019-12-02 18:00:10 2019-12-02 21:10:14 3:10:04 2:34:47 0:35:17 smithi master krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi009 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeRHG382 -r -- '-g auto -g blockdev -x clone'"

pass 4554682 2019-11-30 03:21:08 2019-12-02 18:02:00 2019-12-02 19:54:02 1:52:02 0:47:58 1:04:04 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
fail 4554683 2019-11-30 03:21:09 2019-12-02 18:02:00 2019-12-02 19:40:02 1:38:02 0:21:02 1:17:00 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi132 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2fdc51894157a2a43577ba3ec7d0fb12a25be4c5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4554684 2019-11-30 03:21:10 2019-12-02 18:02:00 2019-12-02 18:54:01 0:52:01 0:20:51 0:31:10 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4554685 2019-11-30 03:21:10 2019-12-02 18:04:22 2019-12-02 19:24:22 1:20:00 0:17:51 1:02:09 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} 3
pass 4554686 2019-11-30 03:21:11 2019-12-02 18:05:39 2019-12-02 19:05:39 1:00:00 0:29:05 0:30:55 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} 3
pass 4554687 2019-11-30 03:21:12 2019-12-02 18:05:47 2019-12-02 19:35:48 1:30:01 0:17:43 1:12:18 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_huge_osdmap.yaml} 3
pass 4554688 2019-11-30 03:21:12 2019-12-02 18:05:56 2019-12-02 20:09:57 2:04:01 0:46:23 1:17:38 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
pass 4554689 2019-11-30 03:21:13 2019-12-02 18:08:04 2019-12-02 18:36:04 0:28:00 0:14:57 0:13:03 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} 1
fail 4554690 2019-11-30 03:21:14 2019-12-02 18:08:05 2019-12-02 19:22:05 1:14:00 1:00:31 0:13:29 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

"2019-12-02T18:27:39.391773+0000 mon.a (mon.1) 23 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 4554691 2019-11-30 03:21:14 2019-12-02 18:08:48 2019-12-02 18:52:47 0:43:59 0:20:53 0:23:06 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4554692 2019-11-30 03:21:15 2019-12-02 18:12:30 2019-12-02 19:46:30 1:34:00 0:30:56 1:03:04 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4554693 2019-11-30 03:21:16 2019-12-02 18:14:38 2019-12-02 19:28:39 1:14:01 0:42:17 0:31:44 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
pass 4554694 2019-11-30 03:21:16 2019-12-02 18:15:55 2019-12-02 19:37:56 1:22:01 0:20:07 1:01:54 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_namespaces.yaml} 3
pass 4554695 2019-11-30 03:21:17 2019-12-02 18:15:56 2019-12-02 18:41:55 0:25:59 0:15:24 0:10:35 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} 2
pass 4554696 2019-11-30 03:21:18 2019-12-02 18:15:59 2019-12-02 19:09:59 0:54:00 0:28:42 0:25:18 smithi master krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} 3
pass 4554697 2019-11-30 03:21:19 2019-12-02 18:18:32 2019-12-02 19:20:33 1:02:01 0:35:10 0:26:51 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} 3
pass 4554698 2019-11-30 03:21:19 2019-12-02 18:19:51 2019-12-02 19:25:51 1:06:00 0:16:12 0:49:48 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4554699 2019-11-30 03:21:20 2019-12-02 18:20:24 2019-12-02 19:04:24 0:44:00 0:21:22 0:22:38 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4554700 2019-11-30 03:21:21 2019-12-02 18:22:13 2019-12-02 18:46:12 0:23:59 0:15:46 0:08:13 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} 1
pass 4554701 2019-11-30 03:21:21 2019-12-02 18:22:21 2019-12-02 19:04:21 0:42:00 0:27:31 0:14:29 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4554702 2019-11-30 03:21:22 2019-12-02 18:23:58 2019-12-02 20:13:59 1:50:01 0:51:30 0:58:31 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
dead 4554703 2019-11-30 03:21:23 2019-12-02 18:23:59 2019-12-02 21:34:01 3:10:02 1:53:56 1:16:06 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} 3
Failure Reason:

SSH connection to smithi105 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

pass 4554704 2019-11-30 03:21:23 2019-12-02 18:23:58 2019-12-02 20:13:59 1:50:01 0:16:29 1:33:32 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4554705 2019-11-30 03:21:24 2019-12-02 18:23:58 2019-12-02 19:19:58 0:56:00 0:16:52 0:39:08 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4554706 2019-11-30 03:21:25 2019-12-02 18:23:58 2019-12-02 19:43:58 1:20:00 0:30:33 0:49:27 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} 3
pass 4554707 2019-11-30 03:21:26 2019-12-02 18:23:59 2019-12-02 19:43:59 1:20:00 0:24:58 0:55:02 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4554708 2019-11-30 03:21:26 2019-12-02 18:23:59 2019-12-02 18:59:59 0:36:00 0:17:14 0:18:46 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} 3
pass 4554709 2019-11-30 03:21:27 2019-12-02 18:25:53 2019-12-02 19:03:52 0:37:59 0:16:18 0:21:41 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} 3
pass 4554710 2019-11-30 03:21:28 2019-12-02 18:25:53 2019-12-02 18:51:52 0:25:59 0:15:56 0:10:03 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} 1
pass 4554711 2019-11-30 03:21:28 2019-12-02 18:26:06 2019-12-02 19:46:06 1:20:00 0:58:09 0:21:51 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4554712 2019-11-30 03:21:29 2019-12-02 18:28:19 2019-12-02 19:38:18 1:09:59 0:18:53 0:51:06 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
pass 4554713 2019-11-30 03:21:30 2019-12-02 18:29:54 2019-12-02 19:51:54 1:22:00 0:16:20 1:05:40 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4554714 2019-11-30 03:21:30 2019-12-02 18:29:57 2019-12-02 19:41:57 1:12:00 0:28:50 0:43:10 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4554715 2019-11-30 03:21:31 2019-12-02 18:30:38 2019-12-02 19:32:38 1:02:00 0:20:53 0:41:07 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} 3
pass 4554716 2019-11-30 03:21:32 2019-12-02 18:32:12 2019-12-02 19:46:12 1:14:00 0:16:18 0:57:42 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
pass 4554717 2019-11-30 03:21:32 2019-12-02 18:32:12 2019-12-02 19:54:12 1:22:00 0:31:27 0:50:33 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} 3