Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5118890 2020-06-05 05:15:27 2020-06-05 09:03:18 2020-06-05 09:25:18 0:22:00 0:12:56 0:09:04 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} 1
pass 5118891 2020-06-05 05:15:28 2020-06-05 09:04:16 2020-06-05 09:46:16 0:42:00 0:27:36 0:14:24 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 5118892 2020-06-05 05:15:29 2020-06-05 09:04:16 2020-06-05 09:52:16 0:48:00 0:33:08 0:14:52 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} 3
pass 5118893 2020-06-05 05:15:30 2020-06-05 09:04:27 2020-06-05 09:40:27 0:36:00 0:24:31 0:11:29 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} 3
fail 5118894 2020-06-05 05:15:31 2020-06-05 09:04:33 2020-06-05 13:26:39 4:22:06 3:59:03 0:23:03 smithi py2 krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi173 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludepdXEkT -r -- '-g auto -g blockdev -x clone'"

pass 5118895 2020-06-05 05:15:33 2020-06-05 09:04:38 2020-06-05 10:16:39 1:12:01 0:55:10 0:16:51 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} 3
pass 5118896 2020-06-05 05:15:34 2020-06-05 09:04:38 2020-06-05 09:26:38 0:22:00 0:11:27 0:10:33 smithi py2 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
pass 5118897 2020-06-05 05:15:35 2020-06-05 09:06:28 2020-06-05 09:26:28 0:20:00 0:11:09 0:08:51 smithi py2 krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} 1
pass 5118898 2020-06-05 05:15:36 2020-06-05 09:06:28 2020-06-05 09:38:28 0:32:00 0:14:42 0:17:18 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} 3
pass 5118899 2020-06-05 05:15:37 2020-06-05 09:06:30 2020-06-05 09:46:30 0:40:00 0:27:50 0:12:10 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 5118900 2020-06-05 05:15:38 2020-06-05 09:06:31 2020-06-05 09:40:30 0:33:59 0:19:03 0:14:56 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 5118901 2020-06-05 05:15:39 2020-06-05 09:06:42 2020-06-05 09:36:42 0:30:00 0:13:52 0:16:08 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} 3
pass 5118902 2020-06-05 05:15:41 2020-06-05 09:08:27 2020-06-05 09:48:27 0:40:00 0:27:56 0:12:04 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 5118903 2020-06-05 05:15:42 2020-06-05 09:08:27 2020-06-05 09:34:26 0:25:59 0:14:17 0:11:42 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 5118904 2020-06-05 05:15:43 2020-06-05 09:08:38 2020-06-05 10:06:39 0:58:01 0:45:27 0:12:34 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 5118905 2020-06-05 05:15:44 2020-06-05 09:09:01 2020-06-05 09:30:59 0:21:58 0:13:10 0:08:48 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} 1
pass 5118906 2020-06-05 05:15:45 2020-06-05 09:10:34 2020-06-05 09:52:34 0:42:00 0:25:57 0:16:03 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
fail 5118907 2020-06-05 05:15:46 2020-06-05 09:10:34 2020-06-05 10:36:35 1:26:01 1:10:28 0:15:33 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2020-06-05T09:32:22.613958+0000 mon.b (mon.0) 162 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 5118908 2020-06-05 05:15:47 2020-06-05 09:10:34 2020-06-05 09:42:34 0:32:00 0:16:53 0:15:07 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 5118909 2020-06-05 05:15:48 2020-06-05 09:10:34 2020-06-05 10:04:34 0:54:00 0:38:19 0:15:41 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 5118910 2020-06-05 05:15:50 2020-06-05 09:12:35 2020-06-05 10:46:36 1:34:01 1:19:32 0:14:29 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2020-06-05T09:49:13.885411+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4301.0:227125 2.5 2:a72734ca:::rbd_data.117389b80665.00000000000008dd:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3977216~12288 in=12288b] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2020-06-05T09:48:43.553748+0000 currently waiting for sub ops" in cluster log

pass 5118911 2020-06-05 05:15:51 2020-06-05 09:12:35 2020-06-05 09:46:35 0:34:00 0:16:56 0:17:04 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} 3
pass 5118912 2020-06-05 05:15:52 2020-06-05 09:12:35 2020-06-05 09:58:35 0:46:00 0:27:17 0:18:43 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 5118913 2020-06-05 05:15:53 2020-06-05 09:12:35 2020-06-05 11:12:37 2:00:02 0:27:51 1:32:11 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 5118914 2020-06-05 05:15:55 2020-06-05 09:12:35 2020-06-05 11:00:37 1:48:02 0:13:00 1:35:02 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 5118915 2020-06-05 05:15:56 2020-06-05 09:12:35 2020-06-05 10:40:37 1:28:02 0:17:54 1:10:08 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 5118916 2020-06-05 05:15:57 2020-06-05 09:12:38 2020-06-05 09:32:37 0:19:59 0:11:16 0:08:43 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} 1
pass 5118917 2020-06-05 05:15:58 2020-06-05 09:14:34 2020-06-05 09:54:34 0:40:00 0:27:06 0:12:54 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 5118918 2020-06-05 05:15:59 2020-06-05 09:16:17 2020-06-05 10:24:18 1:08:01 0:54:42 0:13:19 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 5118919 2020-06-05 05:16:00 2020-06-05 09:16:27 2020-06-05 09:48:27 0:32:00 0:19:42 0:12:18 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} 3
pass 5118920 2020-06-05 05:16:01 2020-06-05 09:16:28 2020-06-05 09:50:28 0:34:00 0:13:31 0:20:29 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 5118921 2020-06-05 05:16:02 2020-06-05 09:16:28 2020-06-05 10:32:29 1:16:01 0:30:03 0:45:58 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 5118922 2020-06-05 05:16:03 2020-06-05 09:16:34 2020-06-05 09:42:34 0:26:00 0:13:17 0:12:43 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} 3
pass 5118923 2020-06-05 05:16:04 2020-06-05 09:16:36 2020-06-05 10:48:37 1:32:01 0:31:49 1:00:12 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 5118924 2020-06-05 05:16:05 2020-06-05 09:16:39 2020-06-05 10:18:39 1:02:00 0:19:47 0:42:13 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 5118925 2020-06-05 05:16:06 2020-06-05 09:16:39 2020-06-05 09:54:39 0:38:00 0:13:00 0:25:00 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} 3
pass 5118926 2020-06-05 05:16:07 2020-06-05 09:16:39 2020-06-05 09:40:39 0:24:00 0:11:51 0:12:09 smithi py2 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 5118927 2020-06-05 05:16:09 2020-06-05 09:16:42 2020-06-05 09:56:42 0:40:00 0:26:26 0:13:34 smithi py2 krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 5118928 2020-06-05 05:16:10 2020-06-05 09:18:35 2020-06-05 09:46:34 0:27:59 0:12:36 0:15:23 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} 3
pass 5118929 2020-06-05 05:16:11 2020-06-05 09:18:35 2020-06-05 09:40:34 0:21:59 0:11:58 0:10:01 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} 1
pass 5118930 2020-06-05 05:16:12 2020-06-05 09:18:35 2020-06-05 10:16:35 0:58:00 0:28:28 0:29:32 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 5118931 2020-06-05 05:16:13 2020-06-05 09:18:35 2020-06-05 10:40:36 1:22:01 1:05:11 0:16:50 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 5118932 2020-06-05 05:16:15 2020-06-05 09:20:40 2020-06-05 09:50:40 0:30:00 0:15:34 0:14:26 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 5118933 2020-06-05 05:16:16 2020-06-05 09:20:40 2020-06-05 09:50:40 0:30:00 0:13:07 0:16:53 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 5118934 2020-06-05 05:16:18 2020-06-05 09:20:40 2020-06-05 10:36:41 1:16:01 0:50:47 0:25:14 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 5118935 2020-06-05 05:16:19 2020-06-05 09:20:40 2020-06-05 10:00:40 0:40:00 0:17:43 0:22:17 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} 3
pass 5118936 2020-06-05 05:16:21 2020-06-05 09:20:41 2020-06-05 10:14:41 0:54:00 0:12:35 0:41:25 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
fail 5118937 2020-06-05 05:16:22 2020-06-05 09:20:41 2020-06-05 10:20:41 1:00:00 0:30:02 0:29:58 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2020-06-05T10:00:26.605323+0000 osd.4 (osd.4) 3 : cluster [WRN] slow request osd_op(client.4531.0:983 4.1a 4:58b91c1c:::rbd_data.10d011531fcf.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write 446464~49152 in=49152b] snapc 0=[] ondisk+write+known_if_redirected e77) initiated 2020-06-05T09:59:56.196977+0000 currently waiting for sub ops" in cluster log

pass 5118938 2020-06-05 05:16:24 2020-06-05 09:20:41 2020-06-05 10:00:41 0:40:00 0:28:07 0:11:53 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} 3
pass 5118939 2020-06-05 05:16:25 2020-06-05 09:22:36 2020-06-05 09:44:36 0:22:00 0:11:47 0:10:13 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} 1
pass 5118940 2020-06-05 05:16:27 2020-06-05 09:22:36 2020-06-05 10:18:37 0:56:01 0:32:22 0:23:39 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 5118941 2020-06-05 05:16:28 2020-06-05 09:24:55 2020-06-05 10:10:55 0:46:00 0:34:17 0:11:43 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} 3
pass 5118942 2020-06-05 05:16:30 2020-06-05 09:24:55 2020-06-05 10:04:55 0:40:00 0:28:09 0:11:51 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} 3
fail 5118943 2020-06-05 05:16:32 2020-06-05 09:25:19 2020-06-05 13:55:25 4:30:06 4:03:55 0:26:11 smithi py2 krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi098 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeWkMJiU -r -- '-g auto -g blockdev -x clone'"

pass 5118944 2020-06-05 05:16:33 2020-06-05 09:26:28 2020-06-05 11:00:29 1:34:01 1:08:19 0:25:42 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 5118945 2020-06-05 05:16:34 2020-06-05 09:26:28 2020-06-05 10:34:29 1:08:01 0:14:46 0:53:15 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} 3
pass 5118946 2020-06-05 05:16:36 2020-06-05 09:26:29 2020-06-05 10:32:29 1:06:00 0:38:24 0:27:36 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 5118947 2020-06-05 05:16:38 2020-06-05 09:26:29 2020-06-05 10:10:29 0:44:00 0:18:41 0:25:19 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 5118948 2020-06-05 05:16:39 2020-06-05 09:26:38 2020-06-05 09:52:38 0:26:00 0:14:14 0:11:46 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} 3
pass 5118949 2020-06-05 05:16:41 2020-06-05 09:26:40 2020-06-05 10:14:40 0:48:00 0:35:14 0:12:46 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 5118950 2020-06-05 05:16:43 2020-06-05 09:26:41 2020-06-05 09:52:40 0:25:59 0:14:11 0:11:48 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 5118951 2020-06-05 05:16:45 2020-06-05 09:26:42 2020-06-05 10:20:42 0:54:00 0:43:04 0:10:56 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 5118952 2020-06-05 05:16:46 2020-06-05 09:26:43 2020-06-05 09:46:43 0:20:00 0:11:36 0:08:24 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} 1
pass 5118953 2020-06-05 05:16:48 2020-06-05 09:28:36 2020-06-05 10:10:36 0:42:00 0:26:56 0:15:04 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
fail 5118954 2020-06-05 05:16:49 2020-06-05 09:28:36 2020-06-05 10:40:37 1:12:01 0:53:28 0:18:33 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
Failure Reason:

"2020-06-05T09:52:31.855809+0000 mon.a (mon.0) 134 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 5118955 2020-06-05 05:16:51 2020-06-05 09:28:36 2020-06-05 10:02:36 0:34:00 0:17:27 0:16:33 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 5118956 2020-06-05 05:16:53 2020-06-05 09:28:38 2020-06-05 10:50:40 1:22:02 0:35:40 0:46:22 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 5118957 2020-06-05 05:16:55 2020-06-05 09:28:39 2020-06-05 11:40:41 2:12:02 1:11:10 1:00:52 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 5118958 2020-06-05 05:16:57 2020-06-05 09:28:42 2020-06-05 10:16:42 0:48:00 0:15:48 0:32:12 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} 3
pass 5118959 2020-06-05 05:16:59 2020-06-05 09:31:17 2020-06-05 09:55:17 0:24:00 0:11:48 0:12:12 smithi py2 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 5118960 2020-06-05 05:17:01 2020-06-05 09:32:37 2020-06-05 10:44:38 1:12:01 0:26:22 0:45:39 smithi py2 krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 5118961 2020-06-05 05:17:02 2020-06-05 09:32:37 2020-06-05 10:40:38 1:08:01 0:30:48 0:37:13 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 5118962 2020-06-05 05:17:05 2020-06-05 09:32:38 2020-06-05 10:12:39 0:40:01 0:26:47 0:13:14 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 5118963 2020-06-05 05:17:07 2020-06-05 09:34:38 2020-06-05 10:10:37 0:35:59 0:13:38 0:22:21 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 5118964 2020-06-05 05:17:09 2020-06-05 09:34:38 2020-06-05 10:14:38 0:40:00 0:18:04 0:21:56 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 5118965 2020-06-05 05:17:12 2020-06-05 09:34:38 2020-06-05 09:56:37 0:21:59 0:12:37 0:09:22 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} 1
pass 5118966 2020-06-05 05:17:14 2020-06-05 09:34:42 2020-06-05 10:22:43 0:48:01 0:32:25 0:15:36 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 5118967 2020-06-05 05:17:17 2020-06-05 09:34:43 2020-06-05 11:02:44 1:28:01 1:00:24 0:27:37 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 5118968 2020-06-05 05:17:19 2020-06-05 09:36:47 2020-06-05 10:10:46 0:33:59 0:20:04 0:13:55 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Found coredumps on ubuntu@smithi039.front.sepia.ceph.com

pass 5118969 2020-06-05 05:17:22 2020-06-05 09:36:47 2020-06-05 10:12:47 0:36:00 0:13:03 0:22:57 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 5118970 2020-06-05 05:17:24 2020-06-05 09:36:47 2020-06-05 15:36:56 6:00:09 5:33:03 0:27:06 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

"2020-06-05T12:00:00.000177+0000 mon.b (mon.0) 579 : cluster [WRN] overall HEALTH_WARN Slow OSD heartbeats on back (longest 1283.537ms); Slow OSD heartbeats on front (longest 2438.162ms)" in cluster log

pass 5118971 2020-06-05 05:17:26 2020-06-05 09:36:47 2020-06-05 10:42:47 1:06:00 0:13:02 0:52:58 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} 3
pass 5118972 2020-06-05 05:17:29 2020-06-05 09:36:47 2020-06-05 10:30:47 0:54:00 0:35:53 0:18:07 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 5118973 2020-06-05 05:17:33 2020-06-05 09:37:24 2020-06-05 10:23:25 0:46:01 0:21:57 0:24:04 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 5118974 2020-06-05 05:17:36 2020-06-05 09:38:46 2020-06-05 10:06:46 0:28:00 0:12:49 0:15:11 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} 3
pass 5118975 2020-06-05 05:17:38 2020-06-05 09:38:47 2020-06-05 10:38:47 1:00:00 0:12:35 0:47:25 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} 3
pass 5118976 2020-06-05 05:17:40 2020-06-05 09:40:43 2020-06-05 10:02:43 0:22:00 0:11:55 0:10:05 smithi py2 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} 1
pass 5118977 2020-06-05 05:17:42 2020-06-05 09:40:44 2020-06-05 11:20:45 1:40:01 0:27:03 1:12:58 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 5118978 2020-06-05 05:17:45 2020-06-05 09:40:43 2020-06-05 10:54:44 1:14:01 0:58:19 0:15:42 smithi py2 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 5118979 2020-06-05 05:17:46 2020-06-05 09:40:44 2020-06-05 10:34:44 0:54:00 0:15:25 0:38:35 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 5118980 2020-06-05 05:17:49 2020-06-05 09:40:44 2020-06-05 10:22:44 0:42:00 0:12:47 0:29:13 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 5118981 2020-06-05 05:17:51 2020-06-05 09:40:44 2020-06-05 11:38:46 1:58:02 0:33:26 1:24:36 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 5118982 2020-06-05 05:17:53 2020-06-05 09:42:37 2020-06-05 10:16:37 0:34:00 0:18:02 0:15:58 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} 3
pass 5118983 2020-06-05 05:17:55 2020-06-05 09:42:37 2020-06-05 10:34:38 0:52:01 0:12:54 0:39:07 smithi py2 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 5118984 2020-06-05 05:17:56 2020-06-05 09:42:37 2020-06-05 11:08:39 1:26:02 0:27:25 0:58:37 smithi py2 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
fail 5118985 2020-06-05 05:17:58 2020-06-05 09:44:54 2020-06-05 10:32:54 0:48:00 0:29:43 0:18:17 smithi py2 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2020-06-05T10:10:03.545648+0000 mon.a (mon.0) 161 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log