Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4638342 2020-01-04 03:20:28 2020-01-07 07:53:20 2020-01-07 08:23:20 0:30:00 0:19:12 0:10:48 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_deep_flatten.yaml} 1
pass 4638343 2020-01-04 03:20:29 2020-01-07 07:53:21 2020-01-07 08:33:20 0:39:59 0:27:31 0:12:28 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4638344 2020-01-04 03:20:29 2020-01-07 07:53:31 2020-01-07 08:35:31 0:42:00 0:31:12 0:10:48 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} 3
pass 4638345 2020-01-04 03:20:30 2020-01-07 07:55:19 2020-01-07 08:39:20 0:44:01 0:32:49 0:11:12 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} 3
fail 4638346 2020-01-04 03:20:31 2020-01-07 07:55:20 2020-01-07 10:25:36 2:30:16 2:17:01 0:13:15 smithi master krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi169 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludebkHXZj -r -- '-g auto -g blockdev -x clone'"

pass 4638347 2020-01-04 03:20:31 2020-01-07 07:55:31 2020-01-07 09:03:32 1:08:01 0:56:41 0:11:20 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4638348 2020-01-04 03:20:32 2020-01-07 07:56:59 2020-01-07 08:26:58 0:29:59 0:20:13 0:09:46 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} 2
pass 4638349 2020-01-04 03:20:33 2020-01-07 07:56:59 2020-01-07 08:24:58 0:27:59 0:18:37 0:09:22 smithi master krbd/wac/sysfs/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} 1
fail 4638350 2020-01-04 03:20:33 2020-01-07 07:56:59 2020-01-07 08:38:59 0:42:00 0:28:59 0:13:01 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi203 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd24ccf90d65efe5fded6034f1b2097e9fa2be3a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4638351 2020-01-04 03:20:34 2020-01-07 07:57:16 2020-01-07 08:37:16 0:40:00 0:29:24 0:10:36 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4638352 2020-01-04 03:20:35 2020-01-07 07:59:08 2020-01-07 08:37:07 0:37:59 0:26:32 0:11:27 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} 3
fail 4638353 2020-01-04 03:20:35 2020-01-07 07:59:16 2020-01-07 08:39:16 0:40:00 0:27:37 0:12:23 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} 3
Failure Reason:

"2020-01-07T08:20:38.719530+0000 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 4638354 2020-01-04 03:20:36 2020-01-07 07:59:23 2020-01-07 08:39:23 0:40:00 0:28:02 0:11:58 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_huge_osdmap.yaml} 3
pass 4638355 2020-01-04 03:20:37 2020-01-07 07:59:36 2020-01-07 09:11:37 1:12:01 0:58:50 0:13:11 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
pass 4638356 2020-01-04 03:20:38 2020-01-07 08:01:08 2020-01-07 08:37:08 0:36:00 0:25:32 0:10:28 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_discard.yaml} 1
fail 4638357 2020-01-04 03:20:38 2020-01-07 08:01:12 2020-01-07 09:13:13 1:12:01 0:58:35 0:13:26 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2020-01-07T08:19:10.685991+0000 mon.a (mon.1) 29 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 4638358 2020-01-04 03:20:39 2020-01-07 08:01:17 2020-01-07 08:47:17 0:46:00 0:33:19 0:12:41 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4638359 2020-01-04 03:20:40 2020-01-07 08:01:54 2020-01-07 08:43:54 0:42:00 0:30:52 0:11:08 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4638360 2020-01-04 03:20:40 2020-01-07 08:03:29 2020-01-07 09:21:30 1:18:01 1:06:10 0:11:51 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
pass 4638361 2020-01-04 03:20:41 2020-01-07 08:03:29 2020-01-07 08:51:29 0:48:00 0:36:34 0:11:26 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_namespaces.yaml} 3
pass 4638362 2020-01-04 03:20:42 2020-01-07 08:03:29 2020-01-07 09:01:29 0:58:00 0:46:35 0:11:25 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} 3
pass 4638363 2020-01-04 03:20:42 2020-01-07 08:04:55 2020-01-07 08:50:56 0:46:01 0:32:42 0:13:19 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4638364 2020-01-04 03:20:43 2020-01-07 08:04:56 2020-01-07 08:52:56 0:48:00 0:36:29 0:11:31 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4638365 2020-01-04 03:20:44 2020-01-07 08:04:56 2020-01-07 08:42:56 0:38:00 0:28:01 0:09:59 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} 1
pass 4638366 2020-01-04 03:20:44 2020-01-07 08:05:07 2020-01-07 08:43:07 0:38:00 0:24:31 0:13:29 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4638367 2020-01-04 03:20:45 2020-01-07 08:05:16 2020-01-07 09:15:17 1:10:01 0:58:35 0:11:26 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4638368 2020-01-04 03:20:46 2020-01-07 08:05:23 2020-01-07 08:53:23 0:48:00 0:36:46 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} 3
pass 4638369 2020-01-04 03:20:46 2020-01-07 08:07:22 2020-01-07 08:51:22 0:44:00 0:32:19 0:11:41 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4638370 2020-01-04 03:20:47 2020-01-07 08:07:22 2020-01-07 08:53:22 0:46:00 0:32:43 0:13:17 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4638371 2020-01-04 03:20:48 2020-01-07 08:07:22 2020-01-07 08:53:22 0:46:00 0:31:49 0:14:11 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} 3
pass 4638372 2020-01-04 03:20:48 2020-01-07 08:07:22 2020-01-07 09:01:22 0:54:00 0:40:04 0:13:56 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4638373 2020-01-04 03:20:49 2020-01-07 08:09:21 2020-01-07 08:53:21 0:44:00 0:32:23 0:11:37 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} 3
pass 4638374 2020-01-04 03:20:50 2020-01-07 08:11:08 2020-01-07 08:53:08 0:42:00 0:31:27 0:10:33 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} 2
pass 4638375 2020-01-04 03:20:50 2020-01-07 08:11:08 2020-01-07 09:07:09 0:56:01 0:43:22 0:12:39 smithi master krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} 3
pass 4638376 2020-01-04 03:20:51 2020-01-07 08:11:08 2020-01-07 08:55:09 0:44:01 0:31:26 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} 3
pass 4638377 2020-01-04 03:20:52 2020-01-07 08:11:09 2020-01-07 08:51:09 0:40:00 0:30:53 0:09:07 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_modprobe.yaml} 1
pass 4638378 2020-01-04 03:20:52 2020-01-07 08:11:12 2020-01-07 09:35:14 1:24:02 1:03:28 0:20:34 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4638379 2020-01-04 03:20:53 2020-01-07 08:11:13 2020-01-07 09:05:13 0:54:00 0:26:15 0:27:45 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
pass 4638380 2020-01-04 03:20:54 2020-01-07 08:11:21 2020-01-07 08:57:21 0:46:00 0:30:10 0:15:50 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4638381 2020-01-04 03:20:54 2020-01-07 08:13:03 2020-01-07 08:53:03 0:40:00 0:26:22 0:13:38 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4638382 2020-01-04 03:20:55 2020-01-07 08:13:12 2020-01-07 09:03:13 0:50:01 0:32:53 0:17:08 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} 3
pass 4638383 2020-01-04 03:20:56 2020-01-07 08:15:30 2020-01-07 08:57:30 0:42:00 0:28:52 0:13:08 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
pass 4638384 2020-01-04 03:20:56 2020-01-07 08:15:30 2020-01-07 09:11:31 0:56:01 0:42:21 0:13:40 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} 3
pass 4638385 2020-01-04 03:20:57 2020-01-07 08:16:24 2020-01-07 08:54:24 0:38:00 0:28:59 0:09:01 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} 1
pass 4638386 2020-01-04 03:20:58 2020-01-07 08:17:24 2020-01-07 09:51:26 1:34:02 0:27:17 1:06:45 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4638387 2020-01-04 03:20:58 2020-01-07 08:17:24 2020-01-07 09:23:25 1:06:01 0:30:58 0:35:03 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} 3
pass 4638388 2020-01-04 03:20:59 2020-01-07 08:17:24 2020-01-07 09:39:26 1:22:02 0:39:45 0:42:17 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} 3
fail 4638389 2020-01-04 03:21:00 2020-01-07 08:17:41 2020-01-07 11:25:52 3:08:11 2:36:38 0:31:33 smithi master krbd/singleton/{bluestore-bitmap.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi152 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude2QgFxg -r -- '-g auto -g blockdev -x clone'"

pass 4638390 2020-01-04 03:21:01 2020-01-07 08:19:51 2020-01-07 09:39:52 1:20:01 1:04:59 0:15:02 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
fail 4638391 2020-01-04 03:21:01 2020-01-07 08:19:57 2020-01-07 09:07:58 0:48:01 0:29:06 0:18:55 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi168 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd24ccf90d65efe5fded6034f1b2097e9fa2be3a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4638392 2020-01-04 03:21:02 2020-01-07 08:21:14 2020-01-07 09:05:14 0:44:00 0:31:14 0:12:46 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4638393 2020-01-04 03:21:03 2020-01-07 08:23:32 2020-01-07 09:11:32 0:48:00 0:21:23 0:26:37 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} 3
pass 4638394 2020-01-04 03:21:03 2020-01-07 08:23:32 2020-01-07 09:31:33 1:08:01 0:41:53 0:26:08 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} 3
pass 4638395 2020-01-04 03:21:04 2020-01-07 08:23:32 2020-01-07 09:19:33 0:56:01 0:23:36 0:32:25 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_huge_osdmap.yaml} 3
pass 4638396 2020-01-04 03:21:05 2020-01-07 08:25:01 2020-01-07 09:31:02 1:06:01 0:54:27 0:11:34 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
pass 4638397 2020-01-04 03:21:05 2020-01-07 08:25:01 2020-01-07 09:01:01 0:36:00 0:26:23 0:09:37 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} 1
fail 4638398 2020-01-04 03:21:06 2020-01-07 08:25:01 2020-01-07 09:51:03 1:26:02 1:02:02 0:24:00 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

"2020-01-07T08:54:33.702134+0000 mon.b (mon.1) 62 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4638399 2020-01-04 03:21:07 2020-01-07 08:25:23 2020-01-07 09:21:25 0:56:02 0:26:06 0:29:56 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4638400 2020-01-04 03:21:07 2020-01-07 08:27:21 2020-01-07 09:23:21 0:56:00 0:33:31 0:22:29 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
pass 4638401 2020-01-04 03:21:08 2020-01-07 08:27:46 2020-01-07 10:07:50 1:40:04 0:45:34 0:54:30 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
pass 4638402 2020-01-04 03:21:09 2020-01-07 08:29:18 2020-01-07 09:07:18 0:38:00 0:25:07 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_namespaces.yaml} 3
pass 4638403 2020-01-04 03:21:09 2020-01-07 08:33:46 2020-01-07 09:05:45 0:31:59 0:20:19 0:11:40 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} 2
pass 4638404 2020-01-04 03:21:10 2020-01-07 08:35:56 2020-01-07 09:21:56 0:46:00 0:32:46 0:13:14 smithi master krbd/wac/wac/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} 3
pass 4638405 2020-01-04 03:21:11 2020-01-07 08:37:32 2020-01-07 09:45:32 1:08:00 0:37:47 0:30:13 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} 3
pass 4638406 2020-01-04 03:21:11 2020-01-07 08:37:32 2020-01-07 09:27:32 0:50:00 0:22:02 0:27:58 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4638407 2020-01-04 03:21:12 2020-01-07 08:37:32 2020-01-07 09:23:32 0:46:00 0:26:06 0:19:54 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4638408 2020-01-04 03:21:13 2020-01-07 08:39:23 2020-01-07 09:09:25 0:30:02 0:19:58 0:10:04 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} 1
pass 4638409 2020-01-04 03:21:13 2020-01-07 08:39:23 2020-01-07 10:01:27 1:22:04 0:25:44 0:56:20 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4638410 2020-01-04 03:21:14 2020-01-07 08:39:23 2020-01-07 09:53:26 1:14:03 0:56:34 0:17:29 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4638411 2020-01-04 03:21:15 2020-01-07 08:39:24 2020-01-07 09:25:25 0:46:01 0:27:40 0:18:21 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} 3
pass 4638412 2020-01-04 03:21:15 2020-01-07 08:43:23 2020-01-07 09:25:25 0:42:02 0:20:49 0:21:13 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4638413 2020-01-04 03:21:16 2020-01-07 08:43:24 2020-01-07 09:23:25 0:40:01 0:21:24 0:18:37 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4638414 2020-01-04 03:21:17 2020-01-07 08:43:24 2020-01-07 09:37:26 0:54:02 0:37:08 0:16:54 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/filestore-xfs.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} 3
pass 4638415 2020-01-04 03:21:17 2020-01-07 08:43:55 2020-01-07 09:25:55 0:42:00 0:29:41 0:12:19 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4638416 2020-01-04 03:21:18 2020-01-07 08:45:34 2020-01-07 09:27:34 0:42:00 0:21:56 0:20:04 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} 3
pass 4638417 2020-01-04 03:21:19 2020-01-07 08:45:34 2020-01-07 09:31:34 0:46:00 0:19:24 0:26:36 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} 3
pass 4638418 2020-01-04 03:21:19 2020-01-07 08:45:34 2020-01-07 09:17:34 0:32:00 0:21:21 0:10:39 smithi master krbd/basic/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} 1
pass 4638419 2020-01-04 03:21:20 2020-01-07 08:47:42 2020-01-07 10:03:50 1:16:08 0:57:22 0:18:46 smithi master krbd/thrash/{bluestore-bitmap.yaml ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4638420 2020-01-04 03:21:21 2020-01-07 08:47:42 2020-01-07 09:39:42 0:52:00 0:21:56 0:30:04 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
pass 4638421 2020-01-04 03:21:21 2020-01-07 08:47:42 2020-01-07 09:33:42 0:46:00 0:19:53 0:26:07 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4638422 2020-01-04 03:21:22 2020-01-07 08:48:17 2020-01-07 09:34:17 0:46:00 0:28:53 0:17:07 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml objectstore/bluestore-bitmap.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
pass 4638423 2020-01-04 03:21:23 2020-01-07 08:51:17 2020-01-07 09:31:17 0:40:00 0:25:45 0:14:15 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} 3
pass 4638424 2020-01-04 03:21:23 2020-01-07 08:51:17 2020-01-07 09:35:17 0:44:00 0:19:25 0:24:35 smithi master krbd/rbd/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
pass 4638425 2020-01-04 03:21:24 2020-01-07 08:51:30 2020-01-07 09:41:31 0:50:01 0:36:19 0:13:42 smithi master krbd/rbd-nomount/{bluestore-bitmap.yaml clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} 3