Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4546817 2019-11-27 05:15:27 2019-11-27 21:45:01 2019-11-27 22:09:01 0:24:00 0:14:41 0:09:19 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_blkroset.yaml} 1
Failure Reason:

Command failed on smithi014 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 4546818 2019-11-27 05:15:27 2019-11-27 21:46:42 2019-11-27 22:28:42 0:42:00 0:27:37 0:14:23 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} 3
pass 4546819 2019-11-27 05:15:28 2019-11-27 21:46:42 2019-11-27 22:26:42 0:40:00 0:23:06 0:16:54 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} 3
fail 4546820 2019-11-27 05:15:29 2019-11-27 21:46:44 2019-11-28 01:38:47 3:52:03 2:06:35 1:45:28 smithi master krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi025 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludePcbKf3 -r -- '-g auto -g blockdev -x clone'"

pass 4546821 2019-11-27 05:15:29 2019-11-27 21:47:17 2019-11-27 22:49:19 1:02:02 0:44:49 0:17:13 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4546822 2019-11-27 05:15:30 2019-11-27 21:48:51 2019-11-27 22:14:50 0:25:59 0:14:25 0:11:34 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} 2
pass 4546823 2019-11-27 05:15:31 2019-11-27 21:50:53 2019-11-27 22:14:52 0:23:59 0:13:39 0:10:20 smithi master krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} 1
fail 4546824 2019-11-27 05:15:31 2019-11-27 21:53:00 2019-11-27 22:24:59 0:31:59 0:19:23 0:12:36 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71bd687b6e8b9424dd5e5974ed542595d8977416 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4546825 2019-11-27 05:15:32 2019-11-27 21:53:00 2019-11-27 22:28:59 0:35:59 0:19:50 0:16:09 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4546826 2019-11-27 05:15:33 2019-11-27 21:54:46 2019-11-27 23:16:46 1:22:00 0:15:48 1:06:12 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} 3
pass 4546827 2019-11-27 05:15:33 2019-11-27 21:54:50 2019-11-27 22:36:49 0:41:59 0:18:34 0:23:25 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4546828 2019-11-27 05:15:34 2019-11-27 21:56:31 2019-11-27 22:52:31 0:56:00 0:44:26 0:11:34 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
fail 4546829 2019-11-27 05:15:35 2019-11-27 21:56:42 2019-11-27 22:50:42 0:54:00 0:38:58 0:15:02 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2019-11-27 22:15:32.768737 mon.a mon.0 172.21.15.109:6789/0 119 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 4546830 2019-11-27 05:15:35 2019-11-27 21:58:34 2019-11-27 22:42:34 0:44:00 0:27:21 0:16:39 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} 3
fail 4546831 2019-11-27 05:15:36 2019-11-27 21:58:34 2019-11-27 23:10:34 1:12:00 0:49:57 0:22:03 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2019-11-27 22:34:35.620434 mon.b mon.0 172.21.15.35:6789/0 110 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 31 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4546832 2019-11-27 05:15:37 2019-11-27 21:58:34 2019-11-27 22:50:34 0:52:00 0:21:40 0:30:20 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4546833 2019-11-27 05:15:37 2019-11-27 21:58:37 2019-11-27 22:22:36 0:23:59 0:13:37 0:10:22 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} 1
pass 4546834 2019-11-27 05:15:38 2019-11-27 21:59:56 2019-11-27 22:31:55 0:31:59 0:19:43 0:12:16 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} 3
pass 4546835 2019-11-27 05:15:39 2019-11-27 22:00:12 2019-11-27 22:44:12 0:44:00 0:14:59 0:29:01 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4546836 2019-11-27 05:15:39 2019-11-27 22:01:27 2019-11-27 22:55:27 0:54:00 0:15:22 0:38:38 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4546837 2019-11-27 05:15:40 2019-11-27 22:01:48 2019-11-27 22:59:48 0:58:00 0:43:38 0:14:22 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4546838 2019-11-27 05:15:41 2019-11-27 22:02:13 2019-11-27 23:14:13 1:12:00 0:15:25 0:56:35 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4546839 2019-11-27 05:15:41 2019-11-27 22:02:46 2019-11-27 22:30:45 0:27:59 0:16:25 0:11:34 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} 3
fail 4546840 2019-11-27 05:15:42 2019-11-27 22:04:12 2019-11-27 22:50:12 0:46:00 0:15:37 0:30:23 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} 3
Failure Reason:

Command failed (workunit test rbd/kernel.sh) on smithi204 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71bd687b6e8b9424dd5e5974ed542595d8977416 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/kernel.sh'

pass 4546841 2019-11-27 05:15:43 2019-11-27 22:04:14 2019-11-27 23:12:14 1:08:00 0:19:58 0:48:02 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4546842 2019-11-27 05:15:43 2019-11-29 07:55:26 2019-11-29 08:39:25 0:43:59 0:14:21 0:29:38 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} 2
pass 4546843 2019-11-27 05:15:44 2019-11-29 07:55:30 2019-11-29 08:31:30 0:36:00 0:20:41 0:15:19 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} 3
pass 4546844 2019-11-27 05:15:45 2019-11-29 07:56:19 2019-11-29 08:26:18 0:29:59 0:13:41 0:16:18 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kfsx.yaml} 3
pass 4546845 2019-11-27 05:15:45 2019-11-29 07:56:19 2019-11-29 09:08:19 1:12:00 0:40:19 0:31:41 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4546846 2019-11-27 05:15:46 2019-11-29 07:56:57 2019-11-29 08:32:57 0:36:00 0:23:37 0:12:23 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
pass 4546847 2019-11-27 05:15:47 2019-11-29 07:57:45 2019-11-29 09:43:45 1:46:00 0:15:23 1:30:37 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4546848 2019-11-27 05:15:47 2019-11-29 07:57:50 2019-11-29 08:23:49 0:25:59 0:13:52 0:12:07 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} 1
fail 4546849 2019-11-27 05:15:48 2019-11-29 07:58:01 2019-11-29 08:34:00 0:35:59 0:19:35 0:16:24 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-11-29T08:29:46.983560+00:00 smithi188 kernel: [ 984.747181] BUG: MAX_LOCKDEP_CHAIN_HLOCKS too low! ' in syslog

pass 4546850 2019-11-27 05:15:49 2019-11-29 07:59:49 2019-11-29 08:59:49 1:00:00 0:15:42 0:44:18 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
fail 4546851 2019-11-27 05:15:49 2019-11-29 07:59:49 2019-11-29 09:39:50 1:40:01 0:55:57 0:44:04 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

"2019-11-29 09:20:46.196529 mon.a mon.0 172.21.15.68:6789/0 115 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 30 sec, daemons [osd.3,osd.6] have slow ops. (SLOW_OPS)" in cluster log

pass 4546852 2019-11-27 05:15:50 2019-11-29 08:00:17 2019-11-29 09:42:18 1:42:01 0:26:21 1:15:40 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} 3
pass 4546853 2019-11-27 05:15:51 2019-11-29 08:01:27 2019-11-29 09:59:29 1:58:02 0:48:20 1:09:42 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} 3
fail 4546854 2019-11-27 05:15:51 2019-11-29 08:01:41 2019-11-29 11:27:44 3:26:03 2:18:49 1:07:14 smithi master krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi063 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludehkbG8P -r -- '-g auto -g blockdev -x clone'"

pass 4546855 2019-11-27 05:15:52 2019-11-29 08:01:50 2019-11-29 09:35:50 1:34:00 0:41:48 0:52:12 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
fail 4546856 2019-11-27 05:15:53 2019-11-29 08:02:07 2019-11-29 09:16:07 1:14:00 0:19:03 0:54:57 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi058 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71bd687b6e8b9424dd5e5974ed542595d8977416 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4546857 2019-11-27 05:15:53 2019-11-29 08:04:16 2019-11-29 08:56:16 0:52:00 0:19:33 0:32:27 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4546858 2019-11-27 05:15:54 2019-11-29 08:05:00 2019-11-29 09:23:01 1:18:01 0:17:38 1:00:23 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} 3
pass 4546859 2019-11-27 05:15:55 2019-11-29 08:05:56 2019-11-29 08:31:56 0:26:00 0:13:30 0:12:30 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} 1
pass 4546860 2019-11-27 05:15:55 2019-11-29 08:05:56 2019-11-29 08:45:56 0:40:00 0:18:38 0:21:22 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
fail 4546861 2019-11-27 05:15:56 2019-11-29 08:06:07 2019-11-29 09:36:08 1:30:01 0:40:55 0:49:06 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
Failure Reason:

"2019-11-29 09:24:57.231302 mon.a mon.0 172.21.15.109:6789/0 148 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 32 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

fail 4546862 2019-11-27 05:15:57 2019-11-29 08:06:20 2019-11-29 09:08:20 1:02:00 0:46:23 0:15:37 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

"2019-11-29 08:26:24.349709 mon.b mon.0 172.21.15.105:6789/0 103 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4546863 2019-11-27 05:15:57 2019-11-29 08:06:22 2019-11-29 08:54:22 0:48:00 0:32:57 0:15:03 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} 3
fail 4546864 2019-11-27 05:15:58 2019-11-29 08:08:02 2019-11-29 08:58:01 0:49:59 0:38:37 0:11:22 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2019-11-29 08:32:52.969742 mon.b mon.0 172.21.15.123:6789/0 95 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 34 sec, daemons [osd.3,osd.6] have slow ops. (SLOW_OPS)" in cluster log

pass 4546865 2019-11-27 05:15:59 2019-11-29 08:08:41 2019-11-29 08:38:41 0:30:00 0:14:19 0:15:41 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} 2
pass 4546866 2019-11-27 05:15:59 2019-11-29 08:09:48 2019-11-29 08:51:48 0:42:00 0:22:21 0:19:39 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} 3
pass 4546867 2019-11-27 05:16:00 2019-11-29 08:09:51 2019-11-29 09:17:51 1:08:00 0:20:21 0:47:39 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4546868 2019-11-27 05:16:01 2019-11-29 08:11:58 2019-11-29 10:13:59 2:02:01 0:20:16 1:41:45 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} 3
pass 4546869 2019-11-27 05:16:01 2019-11-29 08:11:58 2019-11-29 09:35:58 1:24:00 0:15:00 1:09:00 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4546870 2019-11-27 05:16:02 2019-11-29 08:14:27 2019-11-29 08:42:26 0:27:59 0:14:30 0:13:29 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4546871 2019-11-27 05:16:03 2019-11-29 08:14:27 2019-11-29 09:20:27 1:06:00 0:43:05 0:22:55 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4546872 2019-11-27 05:16:03 2019-11-29 08:15:22 2019-11-29 09:11:21 0:55:59 0:15:03 0:40:56 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
pass 4546873 2019-11-27 05:16:04 2019-11-29 08:16:13 2019-11-29 09:48:13 1:32:00 0:14:59 1:17:01 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} 3
pass 4546874 2019-11-27 05:16:05 2019-11-29 08:16:13 2019-11-29 08:42:12 0:25:59 0:15:00 0:10:59 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} 1
fail 4546875 2019-11-27 05:16:05 2019-11-29 08:16:13 2019-11-29 09:40:13 1:24:00 0:15:00 1:09:00 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} 3
Failure Reason:

Command failed (workunit test rbd/kernel.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=71bd687b6e8b9424dd5e5974ed542595d8977416 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/kernel.sh'

pass 4546876 2019-11-27 05:16:06 2019-11-29 08:16:53 2019-11-29 10:00:55 1:44:02 0:21:15 1:22:47 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4546877 2019-11-27 05:16:07 2019-11-29 08:17:44 2019-11-29 09:05:44 0:48:00 0:14:35 0:33:25 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kfsx.yaml} 3
pass 4546878 2019-11-27 05:16:08 2019-11-29 08:18:13 2019-11-29 09:54:13 1:36:00 0:46:19 0:49:41 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
fail 4546879 2019-11-27 05:16:08 2019-11-29 08:20:16 2019-11-29 09:00:16 0:40:00 0:23:58 0:16:02 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
Failure Reason:

"2019-11-29 08:49:41.222287 mon.a mon.0 172.21.15.12:6789/0 150 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 34 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log

pass 4546880 2019-11-27 05:16:09 2019-11-29 08:23:36 2019-11-29 09:41:35 1:17:59 0:14:36 1:03:23 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4546881 2019-11-27 05:16:10 2019-11-29 08:23:36 2019-11-29 09:43:36 1:20:00 0:19:29 1:00:31 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} 3
pass 4546882 2019-11-27 05:16:10 2019-11-29 08:23:50 2019-11-29 10:27:52 2:04:02 0:15:31 1:48:31 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
fail 4546883 2019-11-27 05:16:11 2019-11-29 08:24:01 2019-11-29 09:44:01 1:20:00 0:57:05 0:22:55 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

"2019-11-29 08:58:26.331292 mon.a mon.0 172.21.15.67:6789/0 179 : cluster [WRN] Health check failed: 10 slow ops, oldest one blocked for 30 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log