Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
pass 4485085 2019-11-08 20:15:37 2019-11-08 20:16:13 2019-11-08 20:38:13 0:22:00 0:07:44 0:14:16 smithi master centos 7.6
fail 4485086 2019-11-08 20:15:38 2019-11-08 20:17:02 2019-11-08 20:53:02 0:36:00 0:14:25 0:21:35 smithi master centos 7.6
Failure Reason:

Command failed on smithi173 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0'

pass 4485088 2019-11-08 20:15:39 2019-11-08 20:17:02 2019-11-08 21:19:02 1:02:00 0:36:58 0:25:02 smithi master centos 7.6
pass 4485090 2019-11-08 20:15:40 2019-11-08 20:19:04 2019-11-08 21:11:04 0:52:00 0:17:31 0:34:29 smithi master centos 7.6
fail 4485092 2019-11-08 20:15:40 2019-11-08 20:20:33 2019-11-08 22:20:34 2:00:01 1:09:48 0:50:13 smithi master centos 7.6
Failure Reason:

Command failed on smithi007 with status 16: 'sudo rbd device unmap /dev/rbd0'

pass 4485094 2019-11-08 20:15:41 2019-11-08 20:21:17 2019-11-08 20:51:17 0:30:00 0:09:49 0:20:11 smithi master centos 7.6
fail 4485095 2019-11-08 20:15:42 2019-11-08 20:22:47 2019-11-08 20:44:46 0:21:59 0:07:24 0:14:35 smithi master centos 7.6
Failure Reason:

Command failed (workunit test rbd/krbd_stable_pages_required.sh) on smithi199 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05f5f0dd7f23ebbd68df1745f36aa8f3ed583314 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_stable_pages_required.sh'

fail 4485097 2019-11-08 20:15:43 2019-11-08 20:22:47 2019-11-08 21:44:47 1:22:00 0:08:57 1:13:03 smithi master centos 7.6
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi043 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05f5f0dd7f23ebbd68df1745f36aa8f3ed583314 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4485099 2019-11-08 20:15:44 2019-11-08 20:25:04 2019-11-08 21:19:04 0:54:00 0:12:45 0:41:15 smithi master centos 7.6
pass 4485101 2019-11-08 20:15:44 2019-11-08 20:26:59 2019-11-08 21:04:58 0:37:59 0:09:05 0:28:54 smithi master centos 7.6
fail 4485102 2019-11-08 20:15:45 2019-11-08 20:26:59 2019-11-08 21:40:59 1:14:00 0:50:39 0:23:21 smithi master centos 7.6
Failure Reason:

Command failed on smithi077 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K pool_client.2 image_client.2'

pass 4485104 2019-11-08 20:15:46 2019-11-08 20:27:08 2019-11-08 20:59:08 0:32:00 0:10:31 0:21:29 smithi master centos 7.6
dead 4485106 2019-11-08 20:15:47 2019-11-08 20:27:11 2019-11-08 20:47:10 0:19:59 smithi master centos 7.6
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

pass 4485108 2019-11-08 20:15:48 2019-11-08 20:29:08 2019-11-08 20:49:07 0:19:59 0:09:07 0:10:52 smithi master centos 7.6
fail 4485110 2019-11-08 20:15:48 2019-11-08 20:31:17 2019-11-08 22:29:18 1:58:01 0:31:34 1:26:27 smithi master centos 7.6
Failure Reason:

"2019-11-08T22:03:16.301812+0000 mon.b (mon.0) 106 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 4485111 2019-11-08 20:15:49 2019-11-08 20:31:17 2019-11-08 21:53:18 1:22:01 0:13:10 1:08:51 smithi master centos 7.6
fail 4485113 2019-11-08 20:15:50 2019-11-08 20:32:54 2019-11-08 22:18:55 1:46:01 0:19:54 1:26:07 smithi master centos 7.6
Failure Reason:

Command failed on smithi138 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0'

pass 4485114 2019-11-08 20:15:51 2019-11-08 20:33:02 2019-11-08 21:45:02 1:12:00 0:41:14 0:30:46 smithi master centos 7.6
pass 4485115 2019-11-08 20:15:51 2019-11-08 20:33:07 2019-11-08 21:05:07 0:32:00 0:11:45 0:20:15 smithi master centos 7.6
pass 4485116 2019-11-08 20:15:52 2019-11-08 20:34:50 2019-11-08 23:18:52 2:44:02 0:25:34 2:18:28 smithi master centos 7.6
pass 4485117 2019-11-08 20:15:53 2019-11-08 20:34:51 2019-11-08 21:28:50 0:53:59 0:09:24 0:44:35 smithi master centos 7.6
pass 4485118 2019-11-08 20:15:54 2019-11-08 20:35:01 2019-11-08 22:49:02 2:14:01 0:11:47 2:02:14 smithi master centos 7.6
pass 4485119 2019-11-08 20:15:54 2019-11-08 20:36:47 2019-11-08 20:56:46 0:19:59 0:08:23 0:11:36 smithi master centos 7.6
pass 4485120 2019-11-08 20:15:55 2019-11-08 20:36:51 2019-11-08 21:42:51 1:06:00 0:23:55 0:42:05 smithi master centos 7.6
pass 4485121 2019-11-08 20:15:56 2019-11-08 20:37:18 2019-11-08 22:17:18 1:40:00 1:02:22 0:37:38 smithi master centos 7.6
pass 4485122 2019-11-08 20:15:57 2019-11-08 20:38:31 2019-11-08 22:26:32 1:48:01 0:13:31 1:34:30 smithi master centos 7.6
pass 4485123 2019-11-08 20:15:57 2019-11-08 20:38:31 2019-11-09 00:06:34 3:28:03 0:08:49 3:19:14 smithi master centos 7.6
pass 4485124 2019-11-08 20:15:58 2019-11-08 20:38:32 2019-11-08 21:08:31 0:29:59 0:10:45 0:19:14 smithi master centos 7.6
fail 4485125 2019-11-08 20:15:59 2019-11-08 20:38:36 2019-11-08 21:16:36 0:38:00 0:14:00 0:24:00 smithi master centos 7.6
Failure Reason:

Command failed on smithi088 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K pool_client.0 image_client.0'

pass 4485126 2019-11-08 20:16:00 2019-11-08 20:38:46 2019-11-08 22:14:47 1:36:01 0:12:33 1:23:28 smithi master centos 7.6
pass 4485127 2019-11-08 20:16:00 2019-11-08 20:41:06 2019-11-08 22:09:07 1:28:01 0:08:43 1:19:18 smithi master centos 7.6
pass 4485128 2019-11-08 20:16:01 2019-11-08 20:41:17 2019-11-08 21:03:16 0:21:59 0:08:18 0:13:41 smithi master centos 7.6
pass 4485129 2019-11-08 20:16:02 2019-11-08 20:43:07 2019-11-08 22:31:08 1:48:01 0:22:16 1:25:45 smithi master centos 7.6
pass 4485130 2019-11-08 20:16:03 2019-11-08 20:43:07 2019-11-08 21:25:07 0:42:00 0:09:24 0:32:36 smithi master centos 7.6
pass 4485131 2019-11-08 20:16:03 2019-11-08 20:45:03 2019-11-08 21:05:03 0:20:00 0:07:54 0:12:06 smithi master centos 7.6
pass 4485132 2019-11-08 20:16:04 2019-11-08 20:45:03 2019-11-08 21:53:04 1:08:01 0:39:26 0:28:35 smithi master centos 7.6
pass 4485133 2019-11-08 20:16:05 2019-11-08 20:45:12 2019-11-08 23:07:13 2:22:01 0:11:29 2:10:32 smithi master centos 7.6
pass 4485134 2019-11-08 20:16:06 2019-11-08 20:47:12 2019-11-09 01:01:15 4:14:03 0:08:27 4:05:36 smithi master centos 7.6
fail 4485135 2019-11-08 20:16:07 2019-11-08 20:47:12 2019-11-08 23:09:13 2:22:01 0:24:20 1:57:41 smithi master centos 7.6
Failure Reason:

Command failed on smithi084 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0'

pass 4485136 2019-11-08 20:16:07 2019-11-08 20:49:06 2019-11-08 21:31:06 0:42:00 0:14:24 0:27:36 smithi master centos 7.6
pass 4485137 2019-11-08 20:16:08 2019-11-08 20:49:09 2019-11-08 21:29:08 0:39:59 0:09:26 0:30:33 smithi master centos 7.6
pass 4485138 2019-11-08 20:16:09 2019-11-08 20:51:36 2019-11-08 21:49:36 0:58:00 0:15:52 0:42:08 smithi master centos 7.6
pass 4485139 2019-11-08 20:16:10 2019-11-08 20:53:22 2019-11-08 21:11:21 0:17:59 0:07:33 0:10:26 smithi master centos 7.6
fail 4485140 2019-11-08 20:16:10 2019-11-08 20:53:22 2019-11-08 22:11:22 1:18:00 0:12:32 1:05:28 smithi master centos 7.6
Failure Reason:

Command failed on smithi159 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0'

pass 4485141 2019-11-08 20:16:11 2019-11-08 20:56:35 2019-11-08 21:46:35 0:50:00 0:30:44 0:19:16 smithi master centos 7.6
pass 4485142 2019-11-08 20:16:12 2019-11-08 20:56:35 2019-11-08 21:46:35 0:50:00 0:21:05 0:28:55 smithi master centos 7.6
pass 4485143 2019-11-08 20:16:13 2019-11-08 20:56:47 2019-11-08 22:04:47 1:08:00 0:48:35 0:19:25 smithi master centos 7.6
fail 4485144 2019-11-08 20:16:14 2019-11-08 20:58:49 2019-11-08 21:36:48 0:37:59 0:08:42 0:29:17 smithi master centos 7.6
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=05f5f0dd7f23ebbd68df1745f36aa8f3ed583314 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

pass 4485145 2019-11-08 20:16:14 2019-11-08 20:58:49 2019-11-08 21:44:49 0:46:00 0:12:38 0:33:22 smithi master centos 7.6
pass 4485146 2019-11-08 20:16:15 2019-11-08 20:58:54 2019-11-08 21:56:54 0:58:00 0:12:21 0:45:39 smithi master centos 7.6
fail 4485147 2019-11-08 20:16:16 2019-11-08 20:59:09 2019-11-08 22:21:09 1:22:00 1:00:58 0:21:02 smithi master centos 7.6
Failure Reason:

Command failed on smithi047 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K pool_client.1 image_client.1'

pass 4485148 2019-11-08 20:16:17 2019-11-08 21:00:34 2019-11-08 21:28:33 0:27:59 0:10:07 0:17:52 smithi master centos 7.6
fail 4485149 2019-11-08 20:16:17 2019-11-08 21:02:27 2019-11-08 22:14:27 1:12:00 0:39:41 0:32:19 smithi master centos 7.6
Failure Reason:

"2019-11-08T21:58:29.634094+0000 mon.a (mon.0) 147 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 33 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4485150 2019-11-08 20:16:18 2019-11-08 21:02:27 2019-11-08 21:20:26 0:17:59 0:07:09 0:10:50 smithi master centos 7.6
fail 4485151 2019-11-08 20:16:19 2019-11-08 21:02:27 2019-11-08 22:24:27 1:22:00 0:59:09 0:22:51 smithi master centos 7.6
Failure Reason:

"2019-11-08T21:32:04.521283+0000 mon.b (mon.0) 106 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

pass 4485152 2019-11-08 20:16:20 2019-11-08 21:02:48 2019-11-08 22:08:48 1:06:00 0:12:49 0:53:11 smithi master centos 7.6
pass 4485153 2019-11-08 20:16:20 2019-11-08 21:03:18 2019-11-08 21:45:17 0:41:59 0:25:24 0:16:35 smithi master centos 7.6
pass 4485154 2019-11-08 20:16:21 2019-11-08 21:05:12 2019-11-08 22:57:13 1:52:01 0:32:03 1:19:58 smithi master centos 7.6
pass 4485155 2019-11-08 20:16:22 2019-11-08 21:05:12 2019-11-08 22:33:13 1:28:01 0:11:04 1:16:57 smithi master centos 7.6
pass 4485156 2019-11-08 20:16:22 2019-11-08 21:05:13 2019-11-08 21:29:12 0:23:59 0:08:37 0:15:22 smithi master centos 7.6
fail 4485157 2019-11-08 20:16:23 2019-11-08 21:05:13 2019-11-08 21:57:12 0:51:59 0:23:12 0:28:47 smithi master centos 7.6
Failure Reason:

Command failed on smithi003 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'! dmesg | grep -q \'"\'"\'libceph: osd.* socket closed\'"\'"\'\''

pass 4485158 2019-11-08 20:16:24 2019-11-08 21:05:13 2019-11-08 22:13:13 1:08:00 0:30:14 0:37:46 smithi master centos 7.6
pass 4485159 2019-11-08 20:16:25 2019-11-08 21:07:03 2019-11-08 21:41:02 0:33:59 0:09:26 0:24:33 smithi master centos 7.6
pass 4485160 2019-11-08 20:16:25 2019-11-08 21:07:03 2019-11-08 22:37:04 1:30:01 0:11:09 1:18:52 smithi master centos 7.6
pass 4485161 2019-11-08 20:16:26 2019-11-08 21:08:50 2019-11-08 21:26:50 0:18:00 0:08:28 0:09:32 smithi master centos 7.6
fail 4485162 2019-11-08 20:16:27 2019-11-08 21:11:23 2019-11-08 21:43:22 0:31:59 0:15:26 0:16:33 smithi master centos 7.6
Failure Reason:

Command failed on smithi138 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0'

pass 4485163 2019-11-08 20:16:28 2019-11-08 21:11:23 2019-11-08 22:09:23 0:58:00 0:36:48 0:21:12 smithi master centos 7.6
pass 4485164 2019-11-08 20:16:28 2019-11-08 21:13:05 2019-11-09 00:39:07 3:26:02 2:38:24 0:47:38 smithi master centos 7.6
pass 4485165 2019-11-08 20:16:29 2019-11-08 21:13:05 2019-11-08 21:59:05 0:46:00 0:08:21 0:37:39 smithi master centos 7.6
pass 4485166 2019-11-08 20:16:30 2019-11-08 21:16:55 2019-11-08 23:34:56 2:18:01 0:08:40 2:09:21 smithi master centos 7.6
pass 4485167 2019-11-08 20:16:31 2019-11-08 21:16:55 2019-11-08 23:10:56 1:54:01 0:27:49 1:26:12 smithi master centos 7.6
pass 4485168 2019-11-08 20:16:31 2019-11-08 21:17:23 2019-11-08 22:25:23 1:08:00 0:12:25 0:55:35 smithi master centos 7.6
pass 4485169 2019-11-08 20:16:32 2019-11-08 21:19:21 2019-11-08 22:23:21 1:04:00 0:08:40 0:55:20 smithi master centos 7.6
pass 4485170 2019-11-08 20:16:33 2019-11-08 21:19:21 2019-11-08 22:09:21 0:50:00 0:08:27 0:41:33 smithi master centos 7.6
pass 4485171 2019-11-08 20:16:34 2019-11-08 21:19:22 2019-11-08 21:45:21 0:25:59 0:08:17 0:17:42 smithi master centos 7.6
pass 4485172 2019-11-08 20:16:34 2019-11-08 21:20:46 2019-11-08 23:18:47 1:58:01 0:54:10 1:03:51 smithi master centos 7.6
pass 4485173 2019-11-08 20:16:35 2019-11-08 21:25:26 2019-11-08 22:41:26 1:16:00 0:10:32 1:05:28 smithi master centos 7.6
pass 4485174 2019-11-08 20:16:36 2019-11-08 21:27:08 2019-11-08 21:53:08 0:26:00 0:08:15 0:17:45 smithi master centos 7.6
fail 4485175 2019-11-08 20:16:37 2019-11-08 21:28:52 2019-11-08 22:16:52 0:48:00 0:13:46 0:34:14 smithi master centos 7.6
Failure Reason:

Command failed on smithi040 with status 166: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.2 image_client.2'

pass 4485176 2019-11-08 20:16:38 2019-11-08 21:28:52 2019-11-08 22:22:52 0:54:00 0:13:22 0:40:38 smithi master centos 7.6
pass 4485177 2019-11-08 20:16:38 2019-11-08 21:29:10 2019-11-08 21:55:09 0:25:59 0:08:30 0:17:29 smithi master centos 7.6
pass 4485178 2019-11-08 20:16:39 2019-11-08 21:29:13 2019-11-08 22:29:13 1:00:00 0:20:25 0:39:35 smithi master centos 7.6