Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
pass 4368675 2019-10-08 03:16:16 2019-10-11 01:34:02 2019-10-11 02:28:02 0:54:00 0:17:39 0:36:21 smithi master centos 7.6
fail 4368676 2019-10-08 03:16:17 2019-10-11 01:34:11 2019-10-11 02:00:10 0:25:59 0:13:13 0:12:46 smithi master ubuntu 18.04
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 4368677 2019-10-08 03:16:17 2019-10-11 01:35:58 2019-10-11 02:09:57 0:33:59 0:19:44 0:14:15 smithi master ubuntu 18.04
pass 4368678 2019-10-08 03:16:18 2019-10-11 01:35:58 2019-10-11 02:05:57 0:29:59 0:22:11 0:07:48 smithi master rhel 7.6
pass 4368679 2019-10-08 03:16:19 2019-10-11 01:35:58 2019-10-11 02:17:57 0:41:59 0:14:30 0:27:29 smithi master centos 7.6
pass 4368680 2019-10-08 03:16:19 2019-10-11 01:37:47 2019-10-11 01:57:46 0:19:59 0:09:23 0:10:36 smithi master
pass 4368681 2019-10-08 03:16:20 2019-10-11 01:37:47 2019-10-11 02:39:47 1:02:00 0:49:25 0:12:35 smithi master centos 7.6
pass 4368682 2019-10-08 03:16:21 2019-10-11 01:37:56 2019-10-11 03:01:56 1:24:00 0:19:35 1:04:25 smithi master centos 7.6
pass 4368683 2019-10-08 03:16:22 2019-10-11 01:39:33 2019-10-11 03:07:33 1:28:00 1:11:36 0:16:24 smithi master rhel 7.6
fail 4368684 2019-10-08 03:16:22 2019-10-11 01:39:33 2019-10-11 03:11:34 1:32:01 0:24:29 1:07:32 smithi master
Failure Reason:

Command failed on smithi005 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

pass 4368685 2019-10-08 03:16:23 2019-10-11 01:39:45 2019-10-11 02:15:45 0:36:00 0:23:29 0:12:31 smithi master ubuntu 18.04
pass 4368686 2019-10-08 03:16:24 2019-10-11 01:41:47 2019-10-11 02:57:47 1:16:00 0:28:34 0:47:26 smithi master centos 7.6
pass 4368687 2019-10-08 03:16:25 2019-10-11 01:41:51 2019-10-11 02:07:50 0:25:59 0:16:30 0:09:29 smithi master rhel 7.6
pass 4368688 2019-10-08 03:16:25 2019-10-11 01:43:56 2019-10-11 02:53:57 1:10:01 0:23:49 0:46:12 smithi master rhel 7.6
fail 4368689 2019-10-08 03:16:26 2019-10-11 01:45:51 2019-10-11 05:31:54 3:46:03 3:31:03 0:15:00 smithi master centos
pass 4368690 2019-10-08 03:16:27 2019-10-11 01:47:54 2019-10-11 02:13:53 0:25:59 0:13:18 0:12:41 smithi master centos 7.6
pass 4368691 2019-10-08 03:16:28 2019-10-11 01:47:54 2019-10-11 02:17:53 0:29:59 0:21:52 0:08:07 smithi master rhel 7.6
pass 4368692 2019-10-08 03:16:28 2019-10-11 01:47:56 2019-10-11 02:23:55 0:35:59 0:13:31 0:22:28 smithi master centos 7.6
pass 4368693 2019-10-08 03:16:29 2019-10-11 01:49:49 2019-10-11 02:33:49 0:44:00 0:30:49 0:13:11 smithi master ubuntu 18.04
pass 4368694 2019-10-08 03:16:30 2019-10-11 01:49:49 2019-10-11 02:17:48 0:27:59 0:14:43 0:13:16 smithi master ubuntu 18.04
pass 4368695 2019-10-08 03:16:31 2019-10-11 01:51:07 2019-10-11 02:43:06 0:51:59 0:20:12 0:31:47 smithi master rhel 7.6
pass 4368696 2019-10-08 03:16:31 2019-10-11 01:51:07 2019-10-11 02:49:06 0:57:59 0:22:13 0:35:46 smithi master ubuntu 18.04
pass 4368697 2019-10-08 03:16:32 2019-10-11 01:51:40 2019-10-11 02:25:39 0:33:59 0:20:49 0:13:10 smithi master ubuntu 18.04
pass 4368698 2019-10-08 03:16:33 2019-10-11 01:51:43 2019-10-11 02:19:42 0:27:59 0:18:21 0:09:38 smithi master rhel 7.6
pass 4368699 2019-10-08 03:16:34 2019-10-11 01:53:41 2019-10-11 02:21:40 0:27:59 0:16:04 0:11:55 smithi master centos 7.6
pass 4368700 2019-10-08 03:16:34 2019-10-11 01:53:44 2019-10-11 02:29:43 0:35:59 0:21:45 0:14:14 smithi master centos 7.6
pass 4368701 2019-10-08 03:16:35 2019-10-11 01:55:44 2019-10-11 02:29:44 0:34:00 0:13:21 0:20:39 smithi master centos 7.6
pass 4368702 2019-10-08 03:16:36 2019-10-11 01:55:46 2019-10-11 05:45:49 3:50:03 0:10:55 3:39:08 smithi master ubuntu 18.04
fail 4368703 2019-10-08 03:16:36 2019-10-11 01:56:02 2019-10-11 02:38:01 0:41:59 0:11:19 0:30:40 smithi master
Failure Reason:

Command failed on smithi006 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

fail 4368704 2019-10-08 03:16:37 2019-10-11 01:57:33 2019-10-11 03:27:34 1:30:01 0:50:03 0:39:58 smithi master ubuntu 18.04
Failure Reason:

"2019-10-11T02:50:14.710968+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570762213 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4368705 2019-10-08 03:16:38 2019-10-11 01:57:47 2019-10-11 02:47:47 0:50:00 0:42:17 0:07:43 smithi master rhel 7.6
pass 4368706 2019-10-08 03:16:39 2019-10-11 01:59:01 2019-10-11 02:27:01 0:28:00 0:15:31 0:12:29 smithi master centos 7.6
pass 4368707 2019-10-08 03:16:39 2019-10-11 02:00:27 2019-10-11 02:36:26 0:35:59 0:18:22 0:17:37 smithi master ubuntu 18.04
pass 4368708 2019-10-08 03:16:40 2019-10-11 02:01:13 2019-10-11 02:57:13 0:56:00 0:43:08 0:12:52 smithi master ubuntu 18.04
pass 4368709 2019-10-08 03:16:41 2019-10-11 02:01:58 2019-10-11 02:55:58 0:54:00 0:17:21 0:36:39 smithi master ubuntu 18.04
fail 4368710 2019-10-08 03:16:42 2019-10-11 02:01:58 2019-10-11 03:47:59 1:46:01 1:20:52 0:25:09 smithi master ubuntu 18.04
Failure Reason:

"2019-10-11T02:38:16.177992+0000 mon.b (mon.0) 179 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570761493 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log

pass 4368711 2019-10-08 03:16:43 2019-10-11 02:06:14 2019-10-11 03:02:14 0:56:00 0:26:31 0:29:29 smithi master centos 7.6
fail 4368712 2019-10-08 03:16:43 2019-10-11 02:07:45 2019-10-11 03:09:45 1:02:00 0:49:49 0:12:11 smithi master
Failure Reason:

"2019-10-11T02:35:02.006511+0000 mon.b (mon.0) 140 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570761300 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4368713 2019-10-08 03:16:44 2019-10-11 02:07:45 2019-10-11 03:03:45 0:56:00 0:24:15 0:31:45 smithi master ubuntu 18.04
pass 4368714 2019-10-08 03:16:45 2019-10-11 02:07:51 2019-10-11 02:49:51 0:42:00 0:29:42 0:12:18 smithi master ubuntu 18.04
fail 4368715 2019-10-08 03:16:46 2019-10-11 02:10:14 2019-10-11 03:00:14 0:50:00 0:36:24 0:13:36 smithi master ubuntu 18.04
Failure Reason:

Command failed (workunit test suites/ffsb.sh) on smithi088 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e560faf65af823812237ef720637a3a0ff1b5c1e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

pass 4368716 2019-10-08 03:16:46 2019-10-11 02:10:24 2019-10-11 02:44:24 0:34:00 0:20:31 0:13:29 smithi master rhel 7.6
pass 4368717 2019-10-08 03:16:47 2019-10-11 02:13:57 2019-10-11 02:45:56 0:31:59 0:18:58 0:13:01 smithi master centos 7.6
pass 4368718 2019-10-08 03:16:48 2019-10-11 02:16:02 2019-10-11 02:58:01 0:41:59 0:33:37 0:08:22 smithi master rhel 7.6
fail 4368719 2019-10-08 03:16:49 2019-10-11 02:16:02 2019-10-11 02:48:01 0:31:59 0:24:41 0:07:18 smithi master rhel 7.6
Failure Reason:

"2019-10-11T02:40:57.367985+0000 mon.b (mon.0) 146 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570761656 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4368720 2019-10-08 03:16:49 2019-10-11 02:18:05 2019-10-11 02:42:04 0:23:59 0:13:19 0:10:40 smithi master ubuntu 18.04
fail 4368721 2019-10-08 03:16:50 2019-10-11 02:18:05 2019-10-11 04:10:06 1:52:01 1:34:36 0:17:25 smithi master rhel 7.6
Failure Reason:

"2019-10-11T03:16:47.298242+0000 mon.a (mon.0) 759 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1570763806 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

pass 4368722 2019-10-08 03:16:51 2019-10-11 02:18:05 2019-10-11 02:56:05 0:38:00 0:16:45 0:21:15 smithi master centos 7.6
pass 4368723 2019-10-08 03:16:52 2019-10-09 16:20:50 2019-10-09 16:48:49 0:27:59 0:14:54 0:13:05 smithi master ubuntu 18.04
pass 4368724 2019-10-08 03:16:52 2019-10-11 02:19:03 2019-10-11 02:49:02 0:29:59 0:13:09 0:16:50 smithi master centos 7.6
pass 4368725 2019-10-08 03:16:53 2019-10-11 02:19:54 2019-10-11 03:07:53 0:47:59 0:30:16 0:17:43 smithi master ubuntu 18.04
pass 4368726 2019-10-08 03:16:54 2019-10-11 02:21:56 2019-10-11 03:39:57 1:18:01 0:12:02 1:05:59 smithi master ubuntu 18.04
fail 4368727 2019-10-08 03:16:55 2019-10-11 02:23:49 2019-10-11 03:17:49 0:54:00 0:23:18 0:30:42 smithi master
Failure Reason:

Command failed on smithi134 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

pass 4368728 2019-10-08 03:16:55 2019-10-11 02:23:57 2019-10-11 03:15:56 0:51:59 0:25:06 0:26:53 smithi master rhel 7.6
pass 4368729 2019-10-08 03:16:56 2019-10-11 03:02:21 2019-10-11 03:22:20 0:19:59 0:13:30 0:06:29 smithi master rhel 7.6
pass 4368730 2019-10-08 03:16:57 2019-10-11 03:04:02 2019-10-11 04:12:02 1:08:00 0:54:26 0:13:34 smithi master centos 7.6
pass 4368731 2019-10-08 03:16:58 2019-10-11 03:07:51 2019-10-11 06:39:53 3:32:02 3:18:07 0:13:55 smithi master centos
pass 4368732 2019-10-08 03:16:58 2019-10-11 03:07:51 2019-10-11 03:33:50 0:25:59 0:16:30 0:09:29 smithi master rhel 7.6
pass 4368733 2019-10-08 03:16:59 2019-10-11 03:07:55 2019-10-11 03:35:54 0:27:59 0:14:38 0:13:21 smithi master centos 7.6
pass 4368734 2019-10-08 03:17:00 2019-10-11 03:10:02 2019-10-11 03:44:01 0:33:59 0:15:44 0:18:15 smithi master ubuntu 18.04
pass 4368735 2019-10-08 03:17:01 2019-10-11 03:11:50 2019-10-11 03:47:50 0:36:00 0:20:51 0:15:09 smithi master centos 7.6
pass 4368736 2019-10-08 03:17:01 2019-10-11 03:16:14 2019-10-11 03:54:14 0:38:00 0:21:43 0:16:17 smithi master rhel 7.6
pass 4368737 2019-10-08 03:17:02 2019-10-11 03:18:07 2019-10-11 04:14:06 0:55:59 0:49:08 0:06:51 smithi master rhel 7.6
pass 4368738 2019-10-08 03:17:03 2019-10-11 03:20:30 2019-10-11 03:50:29 0:29:59 0:21:52 0:08:07 smithi master rhel 7.6
pass 4368739 2019-10-08 03:17:04 2019-10-11 03:22:37 2019-10-11 04:52:38 1:30:01 1:15:53 0:14:08 smithi master rhel 7.6
fail 4368740 2019-10-08 03:17:04 2019-10-11 03:24:18 2019-10-11 04:18:18 0:54:00 0:33:05 0:20:55 smithi master ubuntu 18.04
Failure Reason:

"2019-10-11T04:07:45.467989+0000 mon.b (mon.0) 1050 : cluster [ERR] Health check failed: mons b,c are very low on available space (MON_DISK_CRIT)" in cluster log

pass 4368741 2019-10-08 03:17:05 2019-10-11 03:27:50 2019-10-11 04:15:50 0:48:00 0:24:41 0:23:19 smithi master ubuntu 18.04
fail 4368742 2019-10-08 03:17:06 2019-10-11 03:31:58 2019-10-11 03:59:58 0:28:00 0:15:21 0:12:39 smithi master centos 7.6
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 4368743 2019-10-08 03:17:07 2019-10-11 03:34:06 2019-10-11 04:24:06 0:50:00 0:34:00 0:16:00 smithi master centos 7.6
Failure Reason:

"2019-10-11T04:09:48.028298+0000 mon.b (mon.0) 140 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1570766985 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log

pass 4368744 2019-10-08 03:17:08 2019-10-11 03:36:03 2019-10-11 04:18:02 0:41:59 0:27:16 0:14:43 smithi master rhel 7.6
fail 4368745 2019-10-08 03:17:08 2019-10-11 03:36:03 2019-10-11 04:36:03 1:00:00 0:38:04 0:21:56 smithi master centos 7.6
Failure Reason:

Test failure: test_subvolume_group_ls (tasks.cephfs.test_volumes.TestVolumes)

fail 4368746 2019-10-08 03:17:09 2019-10-11 03:40:14 2019-10-11 04:10:13 0:29:59 0:12:10 0:17:49 smithi master ubuntu 18.04
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 4368747 2019-10-08 03:17:10 2019-10-11 03:40:29 2019-10-11 13:54:39 10:14:10 0:19:35 9:54:35 smithi master ubuntu 18.04
pass 4368748 2019-10-08 03:17:10 2019-10-11 03:44:18 2019-10-11 04:38:18 0:54:00 0:19:19 0:34:41 smithi master rhel 7.6
pass 4368749 2019-10-08 03:17:11 2019-10-11 03:48:07 2019-10-11 04:14:06 0:25:59 0:14:17 0:11:42 smithi master centos 7.6
pass 4368750 2019-10-08 03:17:12 2019-10-11 03:48:07 2019-10-11 04:24:06 0:35:59 0:19:09 0:16:50 smithi master rhel 7.6
fail 4368751 2019-10-08 03:17:13 2019-10-11 03:49:56 2019-10-11 04:33:54 0:43:58 0:33:11 0:10:47 smithi master rhel 7.6
Failure Reason:

Command failed (workunit test suites/ffsb.sh) on smithi093 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e560faf65af823812237ef720637a3a0ff1b5c1e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

fail 4368752 2019-10-08 03:17:13 2019-10-11 03:50:30 2019-10-11 04:52:30 1:02:00 0:24:20 0:37:40 smithi master
Failure Reason:

Command failed on smithi044 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

pass 4368753 2019-10-08 03:17:14 2019-10-11 03:54:30 2019-10-11 04:38:30 0:44:00 0:18:21 0:25:39 smithi master
pass 4368754 2019-10-08 03:17:15 2019-10-11 04:00:14 2019-10-11 04:42:14 0:42:00 0:24:28 0:17:32 smithi master centos 7.6
pass 4368755 2019-10-08 03:17:16 2019-10-11 04:07:58 2019-10-11 04:41:58 0:34:00 0:27:21 0:06:39 smithi master rhel 7.6
pass 4368756 2019-10-08 03:17:16 2019-10-11 04:08:04 2019-10-11 04:30:03 0:21:59 0:16:37 0:05:22 smithi master rhel 7.6
pass 4368757 2019-10-08 03:17:17 2019-10-11 04:10:23 2019-10-11 04:42:23 0:32:00 0:13:12 0:18:48 smithi master centos 7.6
pass 4368758 2019-10-08 03:17:18 2019-10-11 04:10:24 2019-10-11 05:06:23 0:55:59 0:19:12 0:36:47 smithi master rhel 7.6
pass 4368759 2019-10-08 03:17:19 2019-10-11 04:12:19 2019-10-11 04:34:18 0:21:59 0:15:44 0:06:15 smithi master rhel 7.6
pass 4368760 2019-10-08 03:17:19 2019-10-11 04:14:22 2019-10-11 04:54:22 0:40:00 0:30:37 0:09:23 smithi master ubuntu 18.04
fail 4368761 2019-10-08 03:17:20 2019-10-11 04:14:22 2019-10-11 04:48:22 0:34:00 0:21:10 0:12:50 smithi master centos 7.6
Failure Reason:

"2019-10-11T04:41:35.501410+0000 mon.b (mon.0) 149 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1570768894 sec, daemons [osd.0,osd.6] have slow ops. (SLOW_OPS)" in cluster log

pass 4368762 2019-10-08 03:17:21 2019-10-11 04:16:06 2019-10-11 05:26:06 1:10:00 0:41:56 0:28:04 smithi master ubuntu 18.04
pass 4368763 2019-10-08 03:17:21 2019-10-11 04:18:04 2019-10-11 05:08:03 0:49:59 0:19:35 0:30:24 smithi master centos 7.6
pass 4368764 2019-10-08 03:17:22 2019-10-11 04:18:04 2019-10-11 06:06:05 1:48:01 1:21:19 0:26:42 smithi master centos 7.6
pass 4368765 2019-10-08 03:17:23 2019-10-11 04:18:20 2019-10-11 05:06:19 0:47:59 0:24:35 0:23:24 smithi master centos 7.6
pass 4368766 2019-10-08 03:17:24 2019-10-11 04:24:22 2019-10-11 05:02:22 0:38:00 0:14:51 0:23:09 smithi master rhel 7.6
pass 4368767 2019-10-08 03:17:25 2019-10-11 04:24:22 2019-10-11 05:08:22 0:44:00 0:15:41 0:28:19 smithi master centos 7.6
pass 4368768 2019-10-08 03:17:25 2019-10-11 04:30:20 2019-10-11 05:18:19 0:47:59 0:17:00 0:30:59 smithi master centos 7.6
pass 4368769 2019-10-08 03:17:26 2019-10-11 04:34:11 2019-10-11 05:16:10 0:41:59 0:24:02 0:17:57 smithi master rhel 7.6
pass 4368770 2019-10-08 03:17:27 2019-10-11 04:34:19 2019-10-11 05:06:19 0:32:00 0:24:06 0:07:54 smithi master rhel 7.6
fail 4368771 2019-10-08 03:17:27 2019-10-11 04:36:20 2019-10-11 05:42:20 1:06:00 0:53:34 0:12:26 smithi master centos
Failure Reason:

"2019-10-11T05:14:41.276049+0000 mon.a (mon.0) 148 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570770879 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log

pass 4368772 2019-10-08 03:17:28 2019-10-11 04:37:47 2019-10-11 05:11:46 0:33:59 0:12:55 0:21:04 smithi master centos 7.6
pass 4368773 2019-10-08 03:17:29 2019-10-11 04:38:20 2019-10-11 06:32:21 1:54:01 0:10:18 1:43:43 smithi master ubuntu 18.04
fail 4368774 2019-10-08 03:17:30 2019-10-11 04:38:31 2019-10-11 05:14:31 0:36:00 0:11:38 0:24:22 smithi master
Failure Reason:

Command failed on smithi080 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

pass 4368775 2019-10-08 03:17:30 2019-10-11 04:42:14 2019-10-11 05:58:14 1:16:00 0:46:47 0:29:13 smithi master rhel 7.6
pass 4368776 2019-10-08 03:17:31 2019-10-11 04:42:15 2019-10-11 05:10:15 0:28:00 0:18:24 0:09:36 smithi master rhel 7.6
pass 4368777 2019-10-08 03:17:32 2019-10-11 04:42:24 2019-10-11 05:24:24 0:42:00 0:12:36 0:29:24 smithi master ubuntu 18.04
pass 4368778 2019-10-08 03:17:32 2019-10-11 04:47:26 2019-10-11 05:33:26 0:46:00 0:23:38 0:22:22 smithi master rhel 7.6
pass 4368779 2019-10-08 03:17:33 2019-10-11 04:48:23 2019-10-11 05:20:23 0:32:00 0:15:06 0:16:54 smithi master ubuntu 18.04
pass 4368780 2019-10-08 03:17:34 2019-10-11 04:52:47 2019-10-11 05:46:47 0:54:00 0:29:14 0:24:46 smithi master centos 7.6
pass 4368781 2019-10-08 03:17:34 2019-10-11 04:52:47 2019-10-11 05:44:47 0:52:00 0:29:26 0:22:34 smithi master ubuntu 18.04
pass 4368782 2019-10-08 03:17:35 2019-10-11 04:54:38 2019-10-11 05:34:38 0:40:00 0:19:03 0:20:57 smithi master centos 7.6
pass 4368783 2019-10-08 03:17:36 2019-10-11 05:34:40 2019-10-11 06:08:39 0:33:59 0:15:26 0:18:33 smithi master ubuntu 18.04
pass 4368784 2019-10-08 03:17:37 2019-10-11 05:40:09 2019-10-11 06:24:08 0:43:59 0:14:51 0:29:08 smithi master ubuntu 18.04
pass 4368785 2019-10-08 03:17:37 2019-10-11 05:40:21 2019-10-11 06:20:21 0:40:00 0:28:55 0:11:05 smithi master ubuntu 18.04
pass 4368786 2019-10-08 03:17:38 2019-10-11 05:42:36 2019-10-11 07:24:37 1:42:01 1:25:12 0:16:49 smithi master centos 7.6
pass 4368787 2019-10-08 03:17:39 2019-10-11 05:44:53 2019-10-11 06:22:52 0:37:59 0:13:51 0:24:08 smithi master ubuntu 18.04
pass 4368788 2019-10-08 03:17:39 2019-10-11 05:44:53 2019-10-11 06:28:53 0:44:00 0:18:13 0:25:47 smithi master rhel 7.6
pass 4368789 2019-10-08 03:17:40 2019-10-11 05:45:50 2019-10-11 06:49:50 1:04:00 0:18:50 0:45:10 smithi master ubuntu 18.04
pass 4368790 2019-10-08 03:17:41 2019-10-11 05:52:45 2019-10-11 07:02:45 1:10:00 0:43:57 0:26:03 smithi master ubuntu 18.04
pass 4368791 2019-10-08 03:17:42 2019-10-11 05:56:07 2019-10-11 06:48:07 0:52:00 0:17:33 0:34:27 smithi master ubuntu 18.04
pass 4368792 2019-10-08 03:17:42 2019-10-11 05:56:23 2019-10-11 07:46:24 1:50:01 1:15:51 0:34:10 smithi master ubuntu 18.04
pass 4368793 2019-10-08 03:17:43 2019-10-11 05:58:32 2019-10-11 06:56:32 0:58:00 0:29:54 0:28:06 smithi master rhel 7.6
pass 4368794 2019-10-08 03:17:44 2019-10-11 06:00:34 2019-10-11 06:48:34 0:48:00 0:18:21 0:29:39 smithi master
pass 4368795 2019-10-08 03:17:44 2019-10-11 06:43:00 2019-10-11 07:10:59 0:27:59 0:10:40 0:17:19 smithi master ubuntu 18.04
pass 4368796 2019-10-08 03:17:45 2019-10-11 06:46:38 2019-10-11 07:22:37 0:35:59 0:22:10 0:13:49 smithi master ubuntu 18.04
pass 4368797 2019-10-08 03:17:46 2019-10-11 06:46:49 2019-10-11 08:42:50 1:56:01 0:14:36 1:41:25 smithi master ubuntu 18.04
fail 4368798 2019-10-08 03:17:47 2019-10-11 06:48:24 2019-10-11 07:42:24 0:54:00 0:23:56 0:30:04 smithi master
Failure Reason:

Command failed on smithi067 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=false"

fail 4368799 2019-10-08 03:17:47 2019-10-11 06:48:24 2019-10-11 08:28:25 1:40:01 1:10:58 0:29:03 smithi master centos 7.6
Failure Reason:

"2019-10-11T07:44:48.527423+0000 mon.a (mon.0) 903 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570779886 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4368800 2019-10-08 03:17:48 2019-10-11 06:48:25 2019-10-11 07:18:25 0:30:00 0:12:03 0:17:57 smithi master centos 7.6
pass 4368801 2019-10-08 03:17:49 2019-10-11 06:48:35 2019-10-11 07:32:35 0:44:00 0:17:14 0:26:46 smithi master rhel 7.6
pass 4368802 2019-10-08 03:17:50 2019-10-11 06:50:07 2019-10-11 07:38:07 0:48:00 0:16:54 0:31:06 smithi master rhel 7.6
pass 4368803 2019-10-08 03:17:51 2019-10-11 06:50:29 2019-10-11 07:30:29 0:40:00 0:27:36 0:12:24 smithi master rhel 7.6
pass 4368804 2019-10-08 03:17:51 2019-10-11 06:52:22 2019-10-11 07:26:21 0:33:59 0:21:18 0:12:41 smithi master centos 7.6
pass 4368805 2019-10-08 03:17:52 2019-10-11 06:52:22 2019-10-11 07:18:21 0:25:59 0:14:52 0:11:07 smithi master ubuntu 18.04
pass 4368806 2019-10-08 03:17:53 2019-10-11 06:56:08 2019-10-11 07:44:07 0:47:59 0:19:02 0:28:57 smithi master rhel 7.6
fail 4368807 2019-10-08 03:17:53 2019-10-11 06:56:33 2019-10-11 07:32:33 0:36:00 0:20:19 0:15:41 smithi master rhel 7.6
Failure Reason:

Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays)

pass 4368808 2019-10-08 03:17:54 2019-10-11 06:56:41 2019-10-11 07:58:41 1:02:00 0:29:07 0:32:53 smithi master rhel 7.6
pass 4368809 2019-10-08 03:17:55 2019-10-11 07:36:39 2019-10-11 09:16:39 1:40:00 1:29:35 0:10:25 smithi master centos 7.6
fail 4368810 2019-10-08 03:17:56 2019-10-11 07:37:11 2019-10-11 08:01:10 0:23:59 0:12:49 0:11:10 smithi master ubuntu 18.04
Failure Reason:

Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient)

fail 4368811 2019-10-08 03:17:56 2019-10-11 07:38:09 2019-10-11 08:50:09 1:12:00 0:56:52 0:15:08 smithi master centos 7.6
Failure Reason:

"2019-10-11T08:08:06.243426+0000 mon.b (mon.0) 148 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1570781285 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log

fail 4368812 2019-10-08 03:17:57 2019-10-11 07:38:09 2019-10-11 08:46:09 1:08:00 0:54:27 0:13:33 smithi master centos
Failure Reason:

"2019-10-11T08:19:42.265689+0000 mon.b (mon.0) 147 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1570781980 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log