Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4887782 2020-03-25 05:15:22 2020-03-25 06:45:30 2020-03-25 07:01:30 0:16:00 0:08:01 0:07:59 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} 1
pass 4887783 2020-03-25 05:15:23 2020-03-25 06:45:31 2020-03-25 07:35:30 0:49:59 0:27:26 0:22:33 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} 3
fail 4887784 2020-03-25 05:15:23 2020-03-25 06:45:31 2020-03-25 10:11:34 3:26:03 3:09:59 0:16:04 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_data_pool.sh) on smithi044 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6adc22bdc5a329cc4f11c916744d82560dc4ea1f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_data_pool.sh'

fail 4887785 2020-03-25 05:15:24 2020-03-25 06:45:30 2020-03-25 09:27:33 2:42:03 2:03:33 0:38:30 smithi master krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi135 with status 2: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude24tZWK -r -- '-g auto -g blockdev -x clone'"

pass 4887786 2020-03-25 05:15:25 2020-03-25 06:45:34 2020-03-25 07:39:35 0:54:01 0:41:55 0:12:06 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4887787 2020-03-25 05:15:25 2020-03-25 06:45:37 2020-03-25 07:03:36 0:17:59 0:08:28 0:09:31 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} 2
pass 4887788 2020-03-25 05:15:26 2020-03-25 06:45:42 2020-03-25 07:01:42 0:16:00 0:07:41 0:08:19 smithi master krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} 1
pass 4887789 2020-03-25 05:15:27 2020-03-25 06:45:44 2020-03-25 07:09:43 0:23:59 0:11:04 0:12:55 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} 3
pass 4887790 2020-03-25 05:15:27 2020-03-25 06:45:44 2020-03-25 07:11:43 0:25:59 0:14:07 0:11:52 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4887791 2020-03-25 05:15:28 2020-03-25 06:45:57 2020-03-25 07:13:56 0:27:59 0:09:23 0:18:36 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} 3
pass 4887792 2020-03-25 05:15:29 2020-03-25 06:47:38 2020-03-25 07:31:38 0:44:00 0:12:49 0:31:11 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
pass 4887793 2020-03-25 05:15:29 2020-03-25 06:47:42 2020-03-25 07:45:42 0:58:00 0:38:03 0:19:57 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
fail 4887794 2020-03-25 05:15:30 2020-03-25 06:47:49 2020-03-25 07:39:48 0:51:59 0:34:26 0:17:33 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2020-03-25 07:11:15.230686 mon.b mon.0 172.21.15.47:6789/0 112 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4887795 2020-03-25 05:15:31 2020-03-25 06:47:54 2020-03-25 07:19:54 0:32:00 0:19:35 0:12:25 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} 3
pass 4887796 2020-03-25 05:15:32 2020-03-25 06:49:42 2020-03-25 08:15:43 1:26:01 0:41:06 0:44:55 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
pass 4887797 2020-03-25 05:15:32 2020-03-25 06:49:42 2020-03-25 07:45:42 0:56:00 0:14:15 0:41:45 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4887798 2020-03-25 05:15:33 2020-03-25 06:49:42 2020-03-25 07:07:42 0:18:00 0:07:47 0:10:13 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} 1
pass 4887799 2020-03-25 05:15:34 2020-03-25 06:51:46 2020-03-25 07:37:46 0:46:00 0:13:30 0:32:30 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} 3
pass 4887800 2020-03-25 05:15:34 2020-03-25 06:51:46 2020-03-25 07:27:45 0:35:59 0:08:57 0:27:02 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4887801 2020-03-25 05:15:35 2020-03-25 06:51:46 2020-03-25 08:05:46 1:14:00 0:09:34 1:04:26 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4887802 2020-03-25 05:15:36 2020-03-25 06:51:49 2020-03-25 08:05:49 1:14:00 0:42:01 0:31:59 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
pass 4887803 2020-03-25 05:15:36 2020-03-25 06:53:51 2020-03-25 07:29:51 0:36:00 0:09:26 0:26:34 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
fail 4887804 2020-03-25 05:15:37 2020-03-25 06:53:51 2020-03-25 10:29:55 3:36:04 3:11:01 0:25:03 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} 3
Failure Reason:

Command failed (workunit test rbd/image_read.sh) on smithi098 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6adc22bdc5a329cc4f11c916744d82560dc4ea1f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh'

pass 4887805 2020-03-25 05:15:38 2020-03-25 06:55:45 2020-03-25 07:51:45 0:56:00 0:08:55 0:47:05 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} 3
pass 4887806 2020-03-25 05:15:38 2020-03-25 06:55:49 2020-03-25 07:29:49 0:34:00 0:14:04 0:19:56 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
pass 4887807 2020-03-25 05:15:39 2020-03-25 06:57:53 2020-03-25 07:17:52 0:19:59 0:08:16 0:11:43 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} 2
pass 4887808 2020-03-25 05:15:40 2020-03-25 06:57:53 2020-03-25 07:33:52 0:35:59 0:14:52 0:21:07 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} 3
dead 4887809 2020-03-25 05:15:40 2020-03-25 06:57:53 2020-03-25 19:00:20 12:02:27 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kfsx.yaml} 3
pass 4887810 2020-03-25 05:15:41 2020-03-25 06:59:25 2020-03-25 07:57:25 0:58:00 0:36:07 0:21:53 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
fail 4887811 2020-03-25 05:15:42 2020-03-25 06:59:28 2020-03-25 07:41:28 0:42:00 0:20:08 0:21:52 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
Failure Reason:

"2020-03-25 07:32:02.393468 mon.b mon.0 172.21.15.63:6789/0 113 : cluster [WRN] Health check failed: 6 slow ops, oldest one blocked for 30 sec, daemons [osd.0,osd.6] have slow ops. (SLOW_OPS)" in cluster log

pass 4887812 2020-03-25 05:15:42 2020-03-25 06:59:35 2020-03-25 07:29:34 0:29:59 0:08:54 0:21:05 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} 3
dead 4887813 2020-03-25 05:15:43 2020-03-25 06:59:42 2020-03-25 19:02:05 12:02:23 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} 1
fail 4887814 2020-03-25 05:15:44 2020-03-25 07:13:48 2020-03-25 08:05:48 0:52:00 0:13:54 0:38:06 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2020-03-25T07:59:34.831046+00:00 smithi039 kernel: [ 613.299846] BUG: MAX_LOCKDEP_CHAIN_HLOCKS too low! ' in syslog

pass 4887815 2020-03-25 05:15:44 2020-03-25 07:13:48 2020-03-25 07:47:48 0:34:00 0:08:32 0:25:28 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
fail 4887816 2020-03-25 05:15:45 2020-03-25 07:13:57 2020-03-25 08:21:58 1:08:01 0:49:35 0:18:26 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

"2020-03-25 07:53:39.153256 mon.b mon.0 172.21.15.80:6789/0 116 : cluster [WRN] Health check failed: 3 slow ops, oldest one blocked for 30 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4887817 2020-03-25 05:15:46 2020-03-25 07:16:02 2020-03-25 08:08:02 0:52:00 0:26:07 0:25:53 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} 3
fail 4887818 2020-03-25 05:15:47 2020-03-25 07:18:11 2020-03-25 10:56:14 3:38:03 3:10:17 0:27:46 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_data_pool.sh) on smithi087 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6adc22bdc5a329cc4f11c916744d82560dc4ea1f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_data_pool.sh'

fail 4887819 2020-03-25 05:15:47 2020-03-25 07:18:11 2020-03-25 11:22:15 4:04:04 2:26:45 1:37:19 smithi master krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi065 with status 2: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude1DM0vq -r -- '-g auto -g blockdev -x clone'"

pass 4887820 2020-03-25 05:15:48 2020-03-25 07:20:01 2020-03-25 08:18:01 0:58:00 0:36:14 0:21:46 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4887821 2020-03-25 05:15:49 2020-03-25 07:20:01 2020-03-25 07:50:01 0:30:00 0:09:49 0:20:11 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} 3
pass 4887822 2020-03-25 05:15:49 2020-03-25 07:20:01 2020-03-25 08:46:02 1:26:01 0:13:30 1:12:31 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
pass 4887823 2020-03-25 05:15:50 2020-03-25 07:23:42 2020-03-25 09:17:43 1:54:01 0:11:22 1:42:39 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} 3
dead 4887824 2020-03-25 05:15:51 2020-03-25 07:23:47 2020-03-25 19:26:14 12:02:27 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} 1
pass 4887825 2020-03-25 05:15:51 2020-03-25 07:25:34 2020-03-25 07:51:34 0:26:00 0:11:57 0:14:03 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
fail 4887826 2020-03-25 05:15:52 2020-03-25 07:25:38 2020-03-25 08:17:38 0:52:00 0:35:37 0:16:23 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
Failure Reason:

"2020-03-25 07:49:39.084901 mon.b mon.0 172.21.15.181:6789/0 158 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

fail 4887827 2020-03-25 05:15:53 2020-03-25 07:27:59 2020-03-25 08:33:59 1:06:00 0:45:03 0:20:57 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

"2020-03-25 07:54:34.426050 mon.b mon.1 172.21.15.154:6789/0 19 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4887828 2020-03-25 05:15:53 2020-03-25 07:27:59 2020-03-25 08:05:59 0:38:00 0:25:06 0:12:54 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} 3
fail 4887829 2020-03-25 05:15:54 2020-03-25 07:29:39 2020-03-25 08:19:39 0:50:00 0:32:14 0:17:46 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2020-03-25 07:54:09.695808 mon.a mon.0 172.21.15.83:6789/0 155 : cluster [WRN] Health check failed: 30 slow ops, oldest one blocked for 32 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

pass 4887830 2020-03-25 05:15:55 2020-03-25 07:29:39 2020-03-25 07:49:38 0:19:59 0:08:16 0:11:43 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} 2
pass 4887831 2020-03-25 05:15:55 2020-03-25 07:29:39 2020-03-25 08:01:39 0:32:00 0:15:24 0:16:36 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} 3
pass 4887832 2020-03-25 05:15:56 2020-03-25 07:29:48 2020-03-25 07:59:47 0:29:59 0:14:39 0:15:20 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} 3
pass 4887833 2020-03-25 05:15:57 2020-03-25 07:29:50 2020-03-25 08:07:49 0:37:59 0:14:05 0:23:54 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} 3
pass 4887834 2020-03-25 05:15:58 2020-03-25 07:29:52 2020-03-25 08:23:52 0:54:00 0:09:03 0:44:57 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
pass 4887835 2020-03-25 05:15:58 2020-03-25 07:31:43 2020-03-25 08:09:43 0:38:00 0:08:38 0:29:22 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} 3
pass 4887836 2020-03-25 05:15:59 2020-03-25 07:31:43 2020-03-25 08:27:43 0:56:00 0:37:55 0:18:05 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
pass 4887837 2020-03-25 05:16:00 2020-03-25 07:34:05 2020-03-25 09:24:06 1:50:01 0:09:18 1:40:43 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
fail 4887838 2020-03-25 05:16:00 2020-03-25 07:34:05 2020-03-25 12:34:10 5:00:05 3:11:18 1:48:47 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} 3
Failure Reason:

Command failed (workunit test rbd/image_read.sh) on smithi197 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6adc22bdc5a329cc4f11c916744d82560dc4ea1f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh'

dead 4887839 2020-03-25 05:16:01 2020-03-25 07:34:05 2020-03-25 19:36:28 12:02:23 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} 1
pass 4887840 2020-03-25 05:16:02 2020-03-25 07:34:05 2020-03-25 08:30:05 0:56:00 0:08:59 0:47:01 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} 3
pass 4887841 2020-03-25 05:16:02 2020-03-25 07:35:37 2020-03-25 08:03:37 0:28:00 0:15:01 0:12:59 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
dead 4887842 2020-03-25 05:16:03 2020-03-25 07:35:37 2020-03-25 19:38:05 12:02:28 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kfsx.yaml} 3
pass 4887843 2020-03-25 05:16:04 2020-03-25 07:35:38 2020-03-25 08:41:38 1:06:00 0:43:07 0:22:53 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
fail 4887844 2020-03-25 05:16:04 2020-03-25 07:35:38 2020-03-25 08:11:37 0:35:59 0:17:55 0:18:04 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
Failure Reason:

"2020-03-25 08:01:39.661441 mon.b mon.0 172.21.15.150:6789/0 96 : cluster [WRN] Health check failed: 34 slow ops, oldest one blocked for 31 sec, daemons [osd.1,osd.3] have slow ops. (SLOW_OPS)" in cluster log

pass 4887845 2020-03-25 05:16:05 2020-03-25 07:38:02 2020-03-25 08:28:02 0:50:00 0:08:46 0:41:14 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} 3
pass 4887846 2020-03-25 05:16:06 2020-03-25 07:38:02 2020-03-25 08:32:02 0:54:00 0:13:54 0:40:06 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} 3
pass 4887847 2020-03-25 05:16:06 2020-03-25 07:38:02 2020-03-25 08:32:02 0:54:00 0:08:49 0:45:11 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
fail 4887848 2020-03-25 05:16:07 2020-03-25 07:38:02 2020-03-25 09:02:03 1:24:01 0:49:19 0:34:42 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

"2020-03-25 08:19:43.270920 mon.a mon.0 172.21.15.110:6789/0 109 : cluster [WRN] Health check failed: 20 slow ops, oldest one blocked for 30 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log