Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi180.front.sepia.ceph.com smithi True True 2019-10-15 20:39:59.885130 scheduled_pdonnell@teuthology ubuntu 18.04 x86_64 /home/teuthworker/archive/pdonnell-2019-10-14_02:22:28-multimds-wip-pdonnell-testing-20191012.025926-distro-basic-smithi/4410426
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
fail 4415084 2019-10-15 17:55:49 2019-10-15 19:40:41 2019-10-15 20:40:40 0:59:59 0:31:13 0:28:46 smithi master centos 7.6
Failure Reason:

"2019-10-15T20:33:32.468487+0000 mon.b (mon.0) 782 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1571171610 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 4415050 2019-10-15 17:55:21 2019-10-15 19:02:07 2019-10-15 19:54:06 0:51:59 0:21:57 0:30:02 smithi master centos 7.6
pass 4415044 2019-10-15 17:55:16 2019-10-15 18:56:49 2019-10-15 19:22:48 0:25:59 0:15:09 0:10:50 smithi master centos 7.6
pass 4415023 2019-10-15 17:54:59 2019-10-15 18:28:25 2019-10-15 18:58:25 0:30:00 0:18:10 0:11:50 smithi master ubuntu 18.04
pass 4414991 2019-10-15 16:36:48 2019-10-15 17:15:55 2019-10-15 18:29:55 1:14:00 0:43:08 0:30:52 smithi master centos
fail 4414566 2019-10-15 08:36:36 2019-10-15 10:32:44 2019-10-15 11:40:44 1:08:00 0:59:34 0:08:26 smithi master ubuntu 18.04
Failure Reason:

"2019-10-15T10:46:14.367359+0000 mon.a (mon.0) 27 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

fail 4414481 2019-10-15 07:00:39 2019-10-15 07:49:25 2019-10-15 10:29:26 2:40:01 2:04:05 0:35:56 smithi master
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

fail 4414426 2019-10-15 06:01:33 2019-10-15 16:04:47 2019-10-15 17:38:47 1:34:00 1:19:57 0:14:03 smithi master rhel 7.6
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 4414312 2019-10-15 06:00:48 2019-10-15 15:30:23 2019-10-15 16:08:22 0:37:59 0:18:49 0:19:10 smithi master centos 7.6
pass 4414200 2019-10-15 05:59:56 2019-10-15 14:57:44 2019-10-15 15:37:43 0:39:59 0:29:41 0:10:18 smithi master ubuntu 18.04
pass 4414154 2019-10-15 05:59:14 2019-10-15 14:20:13 2019-10-15 15:00:13 0:40:00 0:21:14 0:18:46 smithi master ubuntu 18.04
pass 4413729 2019-10-15 02:30:53 2019-10-15 03:22:04 2019-10-15 14:22:16 11:00:12 2:26:27 8:33:45 smithi master centos 7.6
dead 4413624 2019-10-14 19:05:13 2019-10-14 20:13:45 2019-10-15 08:16:07 12:02:22 11:45:52 0:16:30 smithi master rhel 7.7
Failure Reason:

Command failed (workunit test suites/ffsb.sh) on smithi100 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=96e5565376f419bd097c227b15f8088a545840f6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

fail 4413601 2019-10-14 19:04:55 2019-10-14 19:39:21 2019-10-14 20:23:21 0:44:00 0:16:56 0:27:04 smithi master ubuntu 18.04
Failure Reason:

"2019-10-14T20:12:53.585554+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 1571083971 sec, daemons [osd.0,osd.1,osd.3] have slow ops. (SLOW_OPS)" in cluster log

fail 4413583 2019-10-14 19:04:40 2019-10-14 19:12:25 2019-10-14 19:56:24 0:43:59 0:32:13 0:11:46 smithi master rhel 7.7
Failure Reason:

"2019-10-14T19:41:16.647446+0000 mon.a (mon.0) 147 : cluster [ERR] Health check failed: mon a is very low on available space (MON_DISK_CRIT)" in cluster log

fail 4413155 2019-10-14 15:20:56 2019-10-14 16:13:56 2019-10-14 19:15:58 3:02:02 2:49:32 0:12:30 smithi master centos 7.4
Failure Reason:

"2019-10-14 17:23:42.882974 osd.3 172.21.15.180:6804/31186 788 : cluster [ERR] OSD full dropping all updates 98% full" in cluster log

pass 4413115 2019-10-14 15:20:23 2019-10-14 15:48:02 2019-10-14 16:14:01 0:25:59 0:10:40 0:15:19 smithi master
running 4410426 2019-10-14 02:26:34 2019-10-15 20:24:48 2019-10-15 21:12:48 0:48:44 smithi master
dead 4410371 2019-10-14 02:25:51 2019-10-14 02:46:18 2019-10-14 14:48:45 12:02:27 smithi master ubuntu 18.04
pass 4410260 2019-10-14 02:24:50 2019-10-14 15:11:41 2019-10-14 15:39:40 0:27:59 0:19:48 0:08:11 smithi master rhel 7.7