Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
fail 2888093 2018-08-10 03:33:51 2018-08-10 04:17:04 2018-08-10 04:59:04 0:42:00 0:22:09 0:19:51 smithi master ubuntu 18.04
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi076 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-test-crt-2018-08-09 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh'

fail 2888094 2018-08-10 03:33:51 2018-08-10 04:17:15 2018-08-10 06:21:16 2:04:01 1:42:28 0:21:33 smithi master ubuntu 18.04
Failure Reason:

"2018-08-10 04:45:41.111753 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888095 2018-08-10 03:33:52 2018-08-10 04:17:19 2018-08-10 04:41:18 0:23:59 0:12:13 0:11:46 smithi master rhel 7.5
pass 2888096 2018-08-10 03:33:53 2018-08-10 04:17:20 2018-08-10 06:11:21 1:54:01 1:05:20 0:48:41 smithi master
fail 2888097 2018-08-10 03:33:54 2018-08-10 04:17:24 2018-08-10 05:15:24 0:58:00 0:20:13 0:37:47 smithi master ubuntu 16.04
Failure Reason:

"2018-08-10 05:04:36.790173 mon.a (mon.0) 703 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

fail 2888098 2018-08-10 03:33:54 2018-08-10 04:17:28 2018-08-10 05:35:28 1:18:00 0:55:12 0:22:48 smithi master ubuntu 18.04
Failure Reason:

"2018-08-10 04:58:23.780393 mon.b (mon.0) 214 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888099 2018-08-10 03:33:55 2018-08-10 04:17:31 2018-08-10 04:43:31 0:26:00 0:10:10 0:15:50 smithi master ubuntu 18.04
pass 2888100 2018-08-10 03:33:56 2018-08-10 04:19:04 2018-08-10 04:57:04 0:38:00 0:29:25 0:08:35 smithi master centos 7.4
pass 2888101 2018-08-10 03:33:57 2018-08-10 04:19:13 2018-08-10 04:53:12 0:33:59 0:10:08 0:23:51 smithi master ubuntu 18.04
pass 2888102 2018-08-10 03:33:57 2018-08-10 04:19:18 2018-08-10 04:53:18 0:34:00 0:12:51 0:21:09 smithi master ubuntu 18.04
fail 2888103 2018-08-10 03:33:58 2018-08-10 04:19:28 2018-08-10 04:41:27 0:21:59 0:07:48 0:14:11 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi029 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.46:6789,172.21.15.46:6790,172.21.15.196:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888104 2018-08-10 03:33:59 2018-08-10 04:19:28 2018-08-10 05:37:28 1:18:00 0:55:02 0:22:58 smithi master centos
pass 2888105 2018-08-10 03:33:59 2018-08-10 04:19:46 2018-08-10 05:17:46 0:58:00 0:28:40 0:29:20 smithi master ubuntu 16.04
fail 2888106 2018-08-10 03:34:00 2018-08-10 04:21:30 2018-08-10 04:53:29 0:31:59 0:08:05 0:23:54 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi114 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.190:6789,172.21.15.190:6790,172.21.15.25:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888107 2018-08-10 03:34:01 2018-08-10 04:21:30 2018-08-10 05:01:30 0:40:00 0:09:29 0:30:31 smithi master ubuntu 18.04
fail 2888108 2018-08-10 03:34:02 2018-08-10 04:21:30 2018-08-10 05:31:30 1:10:00 0:46:08 0:23:52 smithi master centos 7.4
Failure Reason:

"2018-08-10 04:56:02.011505 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log

fail 2888109 2018-08-10 03:34:03 2018-08-10 04:23:15 2018-08-10 06:23:16 2:00:01 1:01:34 0:58:27 smithi master centos 7.4
Failure Reason:

"2018-08-10 05:37:47.502417 mon.b (mon.0) 149 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888110 2018-08-10 03:34:03 2018-08-10 04:23:22 2018-08-10 04:45:21 0:21:59 0:07:57 0:14:02 smithi master ubuntu 16.04
pass 2888111 2018-08-10 03:34:04 2018-08-10 04:23:23 2018-08-10 04:57:22 0:33:59 0:09:44 0:24:15 smithi master
fail 2888112 2018-08-10 03:34:05 2018-08-10 04:23:28 2018-08-10 04:45:27 0:21:59 0:08:09 0:13:50 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi130 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.60:6789,172.21.15.60:6790,172.21.15.193:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888113 2018-08-10 03:34:06 2018-08-10 04:23:28 2018-08-10 05:47:29 1:24:01 0:50:11 0:33:50 smithi master ubuntu 18.04
pass 2888114 2018-08-10 03:34:06 2018-08-10 04:23:38 2018-08-10 04:57:38 0:34:00 0:13:06 0:20:54 smithi master centos 7.4
pass 2888115 2018-08-10 03:34:07 2018-08-10 04:25:03 2018-08-10 05:07:03 0:42:00 0:24:46 0:17:14 smithi master centos 7.4
fail 2888116 2018-08-10 03:34:08 2018-08-10 04:27:31 2018-08-10 04:45:31 0:18:00 0:07:16 0:10:44 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi033 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.172:6789,172.21.15.172:6790,172.21.15.107:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888117 2018-08-10 03:34:08 2018-08-10 04:27:38 2018-08-10 04:49:38 0:22:00 0:15:59 0:06:01 smithi master centos 7.4
fail 2888118 2018-08-10 03:34:09 2018-08-10 04:29:16 2018-08-10 04:53:16 0:24:00 0:07:38 0:16:22 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi179 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.85:6789,172.21.15.85:6790,172.21.15.8:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888119 2018-08-10 03:34:10 2018-08-10 04:29:17 2018-08-10 05:27:17 0:58:00 0:47:43 0:10:17 smithi master centos
Failure Reason:

"2018-08-10 05:09:30.174407 mon.b (mon.0) 283 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888120 2018-08-10 03:34:11 2018-08-10 04:29:18 2018-08-10 05:19:18 0:50:00 0:34:18 0:15:42 smithi master ubuntu 18.04
pass 2888121 2018-08-10 03:34:12 2018-08-10 04:29:21 2018-08-10 05:49:21 1:20:00 0:56:45 0:23:15 smithi master ubuntu 18.04
dead 2888122 2018-08-10 03:34:12 2018-08-10 04:29:21 2018-08-10 16:31:47 12:02:26 smithi master centos 7.4
pass 2888123 2018-08-10 03:34:13 2018-08-10 04:29:23 2018-08-10 06:39:24 2:10:01 1:54:15 0:15:46 smithi master centos 7.4
fail 2888124 2018-08-10 03:34:14 2018-08-10 04:29:27 2018-08-10 06:55:29 2:26:02 1:39:08 0:46:54 smithi master centos 7.4
Failure Reason:

"2018-08-10 05:25:49.675720 mon.a (mon.0) 203 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888125 2018-08-10 03:34:14 2018-08-10 04:29:28 2018-08-10 04:57:27 0:27:59 0:09:32 0:18:27 smithi master ubuntu 18.04
fail 2888126 2018-08-10 03:34:15 2018-08-10 04:31:28 2018-08-10 05:19:28 0:48:00 0:07:23 0:40:37 smithi master
Failure Reason:

Command failed on smithi100 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.192:6789,172.21.15.192:6790,172.21.15.189:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888127 2018-08-10 03:34:16 2018-08-10 04:33:15 2018-08-10 05:11:15 0:38:00 0:19:37 0:18:23 smithi master ubuntu 18.04
Failure Reason:

"2018-08-10 05:00:52.768973 mon.b (mon.0) 504 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

fail 2888128 2018-08-10 03:34:17 2018-08-10 04:33:17 2018-08-10 04:55:17 0:22:00 0:07:12 0:14:48 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi177 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.109:6789,172.21.15.109:6790,172.21.15.75:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888129 2018-08-10 03:34:17 2018-08-10 04:33:28 2018-08-10 04:55:28 0:22:00 0:09:59 0:12:01 smithi master ubuntu 18.04
pass 2888130 2018-08-10 03:34:18 2018-08-10 04:33:28 2018-08-10 05:17:28 0:44:00 0:28:28 0:15:32 smithi master ubuntu 18.04
pass 2888131 2018-08-10 03:34:19 2018-08-10 04:33:33 2018-08-10 05:13:33 0:40:00 0:14:06 0:25:54 smithi master rhel 7.5
fail 2888132 2018-08-10 03:34:20 2018-08-10 04:33:46 2018-08-10 06:17:47 1:44:01 0:07:42 1:36:19 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi080 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.79:6789,172.21.15.79:6790,172.21.15.89:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888133 2018-08-10 03:34:20 2018-08-10 04:34:42 2018-08-10 04:58:41 0:23:59 0:09:12 0:14:47 smithi master ubuntu 16.04
fail 2888134 2018-08-10 03:34:21 2018-08-10 04:35:27 2018-08-10 05:45:28 1:10:01 0:58:40 0:11:21 smithi master centos
Failure Reason:

"2018-08-10 05:03:56.339097 mon.b (mon.0) 220 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888135 2018-08-10 03:34:22 2018-08-10 04:35:27 2018-08-10 05:17:27 0:42:00 0:31:52 0:10:08 smithi master rhel 7.5
fail 2888136 2018-08-10 03:34:22 2018-08-10 04:35:28 2018-08-10 05:21:27 0:45:59 0:33:46 0:12:13 smithi master centos 7.4
Failure Reason:

Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-test-crt-2018-08-09 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/misc/layout_vxattrs.sh'

pass 2888137 2018-08-10 03:34:23 2018-08-10 04:36:53 2018-08-10 05:04:53 0:28:00 0:11:52 0:16:08 smithi master centos 7.4
fail 2888138 2018-08-10 03:34:24 2018-08-10 04:37:00 2018-08-10 05:16:59 0:39:59 0:20:49 0:19:10 smithi master ubuntu 18.04
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi033 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-test-crt-2018-08-09 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

fail 2888139 2018-08-10 03:34:25 2018-08-10 04:37:11 2018-08-10 05:59:12 1:22:01 0:58:47 0:23:14 smithi master ubuntu 18.04
Failure Reason:

"2018-08-10 05:31:09.667139 osd.5 (osd.5) 2 : cluster [ERR] osd.5 pg 3.0s0 found obsolete rollback obj 0#3:00142b91:::20000000420.00000015:head#d6a generation < trimmed_to 22'17213...repaired" in cluster log

dead 2888140 2018-08-10 03:34:25 2018-08-10 04:37:36 2018-08-10 05:45:36 1:08:00 0:25:33 0:42:27 smithi master centos 7.4
Failure Reason:

SSH connection to smithi159 was lost: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

fail 2888141 2018-08-10 03:34:26 2018-08-10 04:37:36 2018-08-10 05:01:35 0:23:59 0:07:26 0:16:33 smithi master
Failure Reason:

Command failed on smithi189 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.41:6789,172.21.15.41:6790,172.21.15.192:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888142 2018-08-10 03:34:27 2018-08-10 04:37:36 2018-08-10 06:15:37 1:38:01 0:24:09 1:13:52 smithi master rhel 7.5
Failure Reason:

"2018-08-10 06:04:41.701904 mon.b (mon.0) 1175 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 34 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

pass 2888143 2018-08-10 03:34:28 2018-08-10 04:37:39 2018-08-10 07:47:41 3:10:02 1:03:56 2:06:06 smithi master centos 7.4
pass 2888144 2018-08-10 03:34:28 2018-08-10 04:37:44 2018-08-10 05:21:43 0:43:59 0:13:38 0:30:21 smithi master rhel 7.5
pass 2888145 2018-08-10 03:34:29 2018-08-10 04:38:24 2018-08-10 05:14:24 0:36:00 0:22:18 0:13:42 smithi master ubuntu 18.04
fail 2888146 2018-08-10 03:34:30 2018-08-10 04:38:54 2018-08-10 04:58:54 0:20:00 0:07:22 0:12:38 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi016 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.117:6789,172.21.15.117:6790,172.21.15.36:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888147 2018-08-10 03:34:30 2018-08-10 04:39:05 2018-08-10 05:11:04 0:31:59 0:17:17 0:14:42 smithi master rhel 7.5
pass 2888148 2018-08-10 03:34:31 2018-08-10 04:39:08 2018-08-10 05:23:08 0:44:00 0:12:32 0:31:28 smithi master rhel 7.5
fail 2888149 2018-08-10 03:34:32 2018-08-10 04:39:19 2018-08-10 06:51:20 2:12:01 0:54:01 1:18:00 smithi master centos
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 2888150 2018-08-10 03:34:32 2018-08-10 04:39:19 2018-08-10 05:11:19 0:32:00 0:07:29 0:24:31 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi179 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.190:6789,172.21.15.190:6790,172.21.15.85:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888151 2018-08-10 03:34:33 2018-08-10 04:39:27 2018-08-10 06:17:28 1:38:01 0:56:27 0:41:34 smithi master ubuntu 18.04
fail 2888152 2018-08-10 03:34:34 2018-08-10 04:41:11 2018-08-10 05:03:11 0:22:00 0:07:43 0:14:17 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi052 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.101:6789,172.21.15.101:6790,172.21.15.204:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888153 2018-08-10 03:34:35 2018-08-10 04:41:12 2018-08-10 06:47:13 2:06:01 1:43:40 0:22:21 smithi master centos 7.4
fail 2888154 2018-08-10 03:34:35 2018-08-10 04:41:14 2018-08-10 05:53:14 1:12:00 0:07:31 1:04:29 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi102 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.94:6789,172.21.15.94:6790,172.21.15.31:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888155 2018-08-10 03:34:36 2018-08-10 04:41:19 2018-08-10 06:37:20 1:56:01 0:11:50 1:44:11 smithi master centos 7.4
pass 2888156 2018-08-10 03:34:37 2018-08-10 04:41:24 2018-08-10 06:09:25 1:28:01 0:58:33 0:29:28 smithi master
fail 2888157 2018-08-10 03:34:38 2018-08-10 04:41:28 2018-08-10 05:17:28 0:36:00 0:25:14 0:10:46 smithi master centos 7.4
Failure Reason:

"2018-08-10 05:13:02.263987 mon.b (mon.0) 1578 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

pass 2888158 2018-08-10 03:34:38 2018-08-10 04:41:29 2018-08-10 06:59:31 2:18:02 1:08:05 1:09:57 smithi master rhel 7.5
pass 2888159 2018-08-10 03:34:39 2018-08-10 04:41:33 2018-08-10 05:03:32 0:21:59 0:13:05 0:08:54 smithi master centos 7.4
pass 2888160 2018-08-10 03:34:40 2018-08-10 04:43:33 2018-08-10 05:25:33 0:42:00 0:31:15 0:10:45 smithi master centos 7.4
pass 2888161 2018-08-10 03:34:40 2018-08-10 04:43:34 2018-08-10 05:15:33 0:31:59 0:11:02 0:20:57 smithi master ubuntu 18.04
pass 2888162 2018-08-10 03:34:41 2018-08-10 04:43:34 2018-08-10 05:09:33 0:25:59 0:13:56 0:12:03 smithi master centos 7.4
fail 2888163 2018-08-10 03:34:42 2018-08-10 04:43:33 2018-08-10 05:03:33 0:20:00 0:07:20 0:12:40 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi130 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.164:6789,172.21.15.164:6790,172.21.15.193:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888164 2018-08-10 03:34:43 2018-08-10 04:43:39 2018-08-10 05:55:39 1:12:00 0:51:46 0:20:14 smithi master centos
pass 2888165 2018-08-10 03:34:43 2018-08-10 04:43:59 2018-08-10 06:00:00 1:16:01 0:33:29 0:42:32 smithi master rhel 7.5
fail 2888166 2018-08-10 03:34:44 2018-08-10 04:44:13 2018-08-10 05:14:13 0:30:00 0:07:07 0:22:53 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi115 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.17:6789,172.21.15.17:6790,172.21.15.112:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888167 2018-08-10 03:34:45 2018-08-10 04:45:23 2018-08-10 06:07:23 1:22:00 0:10:26 1:11:34 smithi master ubuntu 18.04
fail 2888168 2018-08-10 03:34:45 2018-08-10 04:45:29 2018-08-10 05:35:28 0:49:59 0:07:00 0:42:59 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi076 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.110:6789,172.21.15.110:6790,172.21.15.98:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888169 2018-08-10 03:34:46 2018-08-10 04:45:32 2018-08-10 05:43:32 0:58:00 0:50:16 0:07:44 smithi master rhel 7.5
Failure Reason:

"2018-08-10 05:12:11.648392 mon.a (mon.0) 330 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888170 2018-08-10 03:34:47 2018-08-10 04:46:31 2018-08-10 05:20:30 0:33:59 0:12:19 0:21:40 smithi master rhel 7.5
pass 2888171 2018-08-10 03:34:48 2018-08-10 04:47:01 2018-08-10 05:35:00 0:47:59 0:09:54 0:38:05 smithi master
pass 2888172 2018-08-10 03:34:48 2018-08-10 04:47:20 2018-08-10 06:35:21 1:48:01 0:23:01 1:25:00 smithi master rhel 7.5
pass 2888173 2018-08-10 03:34:49 2018-08-10 04:47:20 2018-08-10 06:33:21 1:46:01 1:04:38 0:41:23 smithi master ubuntu 16.04
pass 2888174 2018-08-10 03:34:50 2018-08-10 04:47:22 2018-08-10 05:13:22 0:26:00 0:13:04 0:12:56 smithi master rhel 7.5
pass 2888175 2018-08-10 03:34:51 2018-08-10 04:47:23 2018-08-10 05:25:22 0:37:59 0:26:21 0:11:38 smithi master rhel 7.5
pass 2888176 2018-08-10 03:34:52 2018-08-10 04:47:28 2018-08-10 05:35:28 0:48:00 0:12:55 0:35:05 smithi master rhel 7.5
pass 2888177 2018-08-10 03:34:52 2018-08-10 04:47:29 2018-08-10 06:11:29 1:24:00 0:16:35 1:07:25 smithi master centos 7.4
pass 2888178 2018-08-10 03:34:53 2018-08-10 04:47:42 2018-08-10 05:15:42 0:28:00 0:12:22 0:15:38 smithi master rhel 7.5
dead 2888179 2018-08-10 03:34:54 2018-08-10 04:49:27 2018-08-10 16:51:52 12:02:25 smithi master centos
fail 2888180 2018-08-10 03:34:55 2018-08-10 04:49:27 2018-08-10 05:07:27 0:18:00 0:07:21 0:10:39 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi186 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.146:6789,172.21.15.146:6790,172.21.15.141:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888181 2018-08-10 03:34:55 2018-08-10 04:49:39 2018-08-10 06:19:40 1:30:01 0:49:02 0:40:59 smithi master ubuntu 16.04
Failure Reason:

"2018-08-10 05:37:47.870522 mon.b (mon.0) 303 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log

fail 2888182 2018-08-10 03:34:56 2018-08-10 04:50:41 2018-08-10 05:20:40 0:29:59 0:07:13 0:22:46 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi083 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.15:6789,172.21.15.15:6790,172.21.15.41:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888183 2018-08-10 03:34:57 2018-08-10 04:51:21 2018-08-10 05:59:21 1:08:00 0:31:39 0:36:21 smithi master ubuntu 18.04
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi022 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-test-crt-2018-08-09 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh'

fail 2888184 2018-08-10 03:34:57 2018-08-10 04:53:24 2018-08-10 05:45:24 0:52:00 0:07:17 0:44:43 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi168 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.190:6789,172.21.15.190:6790,172.21.15.173:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888185 2018-08-10 03:34:58 2018-08-10 04:53:24 2018-08-10 05:19:24 0:26:00 0:12:24 0:13:36 smithi master centos 7.4
fail 2888186 2018-08-10 03:34:59 2018-08-10 04:53:25 2018-08-10 06:21:25 1:28:00 0:07:29 1:20:31 smithi master
Failure Reason:

Command failed on smithi040 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.59:6789,172.21.15.59:6790,172.21.15.188:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888187 2018-08-10 03:35:00 2018-08-10 04:53:24 2018-08-10 06:17:25 1:24:01 0:22:10 1:01:51 smithi master ubuntu 18.04
Failure Reason:

"2018-08-10 06:06:59.963988 mon.a (mon.0) 703 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

fail 2888188 2018-08-10 03:35:00 2018-08-10 04:53:30 2018-08-10 06:01:31 1:08:01 0:07:13 1:00:48 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi151 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.62:6789,172.21.15.62:6790,172.21.15.122:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888189 2018-08-10 03:35:01 2018-08-10 04:55:30 2018-08-10 05:17:29 0:21:59 0:13:27 0:08:32 smithi master rhel 7.5
fail 2888190 2018-08-10 03:35:02 2018-08-10 04:55:31 2018-08-10 06:55:31 2:00:00 0:07:13 1:52:47 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi186 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.165:6789,172.21.15.165:6790,172.21.15.117:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888191 2018-08-10 03:35:02 2018-08-10 04:56:48 2018-08-10 05:16:48 0:20:00 0:09:11 0:10:49 smithi master ubuntu 16.04
pass 2888192 2018-08-10 03:35:03 2018-08-10 04:57:05 2018-08-10 05:39:05 0:42:00 0:12:41 0:29:19 smithi master ubuntu 18.04
pass 2888193 2018-08-10 03:35:04 2018-08-10 04:57:24 2018-08-10 05:17:23 0:19:59 0:08:31 0:11:28 smithi master ubuntu 16.04
fail 2888194 2018-08-10 03:35:05 2018-08-10 04:57:29 2018-08-10 06:07:29 1:10:00 0:48:28 0:21:32 smithi master centos
Failure Reason:

"2018-08-10 05:36:42.686544 mon.a (mon.0) 271 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 2888195 2018-08-10 03:35:05 2018-08-10 04:57:39 2018-08-10 06:15:39 1:18:00 0:33:44 0:44:16 smithi master rhel 7.5
fail 2888196 2018-08-10 03:35:06 2018-08-10 04:58:43 2018-08-10 05:50:43 0:52:00 0:29:43 0:22:17 smithi master rhel 7.5
Failure Reason:

Command failed (workunit test fs/misc/layout_vxattrs.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-test-crt-2018-08-09 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh'

pass 2888197 2018-08-10 03:35:07 2018-08-10 04:58:54 2018-08-10 05:28:54 0:30:00 0:12:58 0:17:02 smithi master rhel 7.5
fail 2888198 2018-08-10 03:35:07 2018-08-10 04:58:55 2018-08-10 05:34:54 0:35:59 0:07:24 0:28:35 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi181 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.121:6789,172.21.15.121:6790,172.21.15.97:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888199 2018-08-10 03:35:08 2018-08-10 04:59:05 2018-08-10 06:15:10 1:16:05 0:59:18 0:16:47 smithi master centos 7.4
Failure Reason:

"2018-08-10 05:33:03.316296 mon.b (mon.0) 196 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

fail 2888200 2018-08-10 03:35:09 2018-08-10 05:01:39 2018-08-10 05:25:39 0:24:00 0:07:29 0:16:31 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi186 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.143:6789,172.21.15.143:6790,172.21.15.141:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888201 2018-08-10 03:35:10 2018-08-10 05:01:39 2018-08-10 05:23:39 0:22:00 0:08:07 0:13:53 smithi master
Failure Reason:

Command failed on smithi087 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.24:6789,172.21.15.24:6790,172.21.15.55:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

fail 2888202 2018-08-10 03:35:10 2018-08-10 05:01:39 2018-08-10 05:41:39 0:40:00 0:22:49 0:17:11 smithi master centos 7.4
Failure Reason:

"2018-08-10 05:39:06.180901 mon.a (mon.0) 879 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS)" in cluster log

pass 2888203 2018-08-10 03:35:11 2018-08-10 05:03:22 2018-08-10 06:53:23 1:50:01 1:01:39 0:48:22 smithi master centos 7.4
pass 2888204 2018-08-10 03:35:12 2018-08-10 05:03:33 2018-08-10 05:35:33 0:32:00 0:12:35 0:19:25 smithi master centos 7.4
pass 2888205 2018-08-10 03:35:12 2018-08-10 05:03:34 2018-08-10 07:11:35 2:08:01 0:26:36 1:41:25 smithi master rhel 7.5
pass 2888206 2018-08-10 03:35:13 2018-08-10 05:04:54 2018-08-10 06:00:54 0:56:00 0:11:42 0:44:18 smithi master centos 7.4
pass 2888207 2018-08-10 03:35:14 2018-08-10 05:07:04 2018-08-10 05:43:04 0:36:00 0:18:30 0:17:30 smithi master centos 7.4
pass 2888208 2018-08-10 03:35:15 2018-08-10 05:07:28 2018-08-10 05:55:28 0:48:00 0:11:05 0:36:55 smithi master ubuntu 18.04
pass 2888209 2018-08-10 03:35:15 2018-08-10 05:09:43 2018-08-10 06:11:43 1:02:00 0:47:09 0:14:51 smithi master centos
fail 2888210 2018-08-10 03:35:16 2018-08-10 05:11:14 2018-08-10 06:35:15 1:24:01 0:07:29 1:16:32 smithi master ubuntu 16.04
Failure Reason:

Command failed on smithi090 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /sbin/mount.ceph 172.21.15.26:6789,172.21.15.26:6790,172.21.15.66:6789:/ /home/ubuntu/cephtest/mnt.0 -v -o name=0,secretfile=/home/ubuntu/cephtest/ceph.data/client.0.secret,norequire_active_mds'

pass 2888211 2018-08-10 03:35:17 2018-08-10 05:11:16 2018-08-10 07:01:17 1:50:01 1:08:45 0:41:16 smithi master ubuntu 16.04
pass 2888212 2018-08-10 03:35:17 2018-08-10 05:11:20 2018-08-10 06:57:21 1:46:01 0:13:47 1:32:14 smithi master rhel 7.5