Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 3481455 2019-01-19 03:20:59 2019-01-21 14:40:02 2019-01-21 14:58:01 0:17:59 0:08:12 0:09:47 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_blkroset.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:49:10.020410+00:00 smithi012 kernel: [ 49.749753] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481456 2019-01-19 03:21:00 2019-01-21 14:40:10 2019-01-21 15:24:10 0:44:00 0:26:21 0:17:39 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:56:50.019324+00:00 smithi203 kernel: [ 73.756996] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481457 2019-01-19 03:21:01 2019-01-21 14:40:11 2019-01-21 15:26:11 0:46:00 0:26:37 0:19:23 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:58:20.019890+00:00 smithi002 kernel: [ 63.693729] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481458 2019-01-19 03:21:01 2019-01-21 14:40:15 2019-01-21 15:42:15 1:02:00 0:21:32 0:40:28 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:19:40.024208+00:00 smithi028 kernel: [ 86.697143] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481459 2019-01-19 03:21:02 2019-01-21 14:42:13 2019-01-21 17:44:16 3:02:03 1:40:50 1:21:13 smithi master krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi027 with status 123: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeM3geEY -r -- '-g auto -g blockdev -x clone'"

dead 3481460 2019-01-19 03:21:03 2019-01-21 14:42:16 2019-01-22 02:44:49 12:02:33 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
fail 3481461 2019-01-19 03:21:04 2019-01-21 14:46:01 2019-01-21 15:10:01 0:24:00 0:14:26 0:09:34 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} 2
Failure Reason:

Command failed on smithi083 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

fail 3481462 2019-01-19 03:21:04 2019-01-21 14:46:07 2019-01-21 15:02:06 0:15:59 0:07:33 0:08:26 smithi master krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:54:00.019661+00:00 smithi046 kernel: [ 66.753070] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481463 2019-01-19 03:21:05 2019-01-21 14:46:12 2019-01-21 15:10:11 0:23:59 0:13:35 0:10:24 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=51bfb6791ff0479c4a2bd7e368c8af7f3fb3761c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

fail 3481464 2019-01-19 03:21:06 2019-01-21 14:46:12 2019-01-21 15:18:12 0:32:00 0:12:36 0:19:24 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:04:10.019835+00:00 smithi115 kernel: [ 37.747319] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481465 2019-01-19 03:21:06 2019-01-21 14:48:10 2019-01-21 15:08:09 0:19:59 0:09:44 0:10:15 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:57:10.020173+00:00 smithi082 kernel: [ 44.742395] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481466 2019-01-19 03:21:07 2019-01-21 14:48:10 2019-01-21 15:44:10 0:56:00 0:37:14 0:18:46 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:05:20.019122+00:00 smithi102 kernel: [ 58.750540] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481467 2019-01-19 03:21:08 2019-01-21 14:48:10 2019-01-21 15:36:10 0:48:00 0:26:24 0:21:36 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

"2019-01-21 15:15:26.152543 mon.b (mon.0) 180 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

fail 3481468 2019-01-19 03:21:08 2019-01-21 14:48:10 2019-01-21 15:24:09 0:35:59 0:13:18 0:22:41 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:09:00.019631+00:00 smithi084 kernel: [ 38.758814] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481469 2019-01-19 03:21:09 2019-01-21 14:48:10 2019-01-21 15:28:10 0:40:00 0:26:05 0:13:55 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-3-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:02:00.019732+00:00 smithi013 kernel: [ 62.745297] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481470 2019-01-19 03:21:10 2019-01-21 14:48:11 2019-01-21 16:00:11 1:12:00 0:32:29 0:39:31 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:27:30.019741+00:00 smithi162 kernel: [ 72.749846] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481471 2019-01-19 03:21:11 2019-01-21 14:48:16 2019-01-21 15:16:16 0:28:00 0:13:18 0:14:42 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:01:00.020246+00:00 smithi091 kernel: [ 44.747009] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481472 2019-01-19 03:21:11 2019-01-21 14:50:11 2019-01-21 15:06:10 0:15:59 0:08:04 0:07:55 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:57:10.020311+00:00 smithi031 kernel: [ 32.728605] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481473 2019-01-19 03:21:12 2019-01-21 14:50:11 2019-01-21 15:14:10 0:23:59 0:10:04 0:13:55 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:03:00.020094+00:00 smithi025 kernel: [ 69.786665] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481474 2019-01-19 03:21:13 2019-01-21 14:50:11 2019-01-21 15:34:11 0:44:00 0:09:14 0:34:46 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:23:40.024316+00:00 smithi092 kernel: [ 91.319415] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481475 2019-01-19 03:21:13 2019-01-21 14:50:12 2019-01-21 15:48:12 0:58:00 0:46:17 0:11:43 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T14:59:50.019695+00:00 smithi099 kernel: [ 73.547676] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481476 2019-01-19 03:21:14 2019-01-21 14:50:12 2019-01-21 15:14:12 0:24:00 0:09:16 0:14:44 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:04:10.022759+00:00 smithi137 kernel: [ 96.543657] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481477 2019-01-19 03:21:15 2019-01-21 14:50:21 2019-01-21 15:30:21 0:40:00 0:10:03 0:29:57 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:18:40.019590+00:00 smithi124 kernel: [ 72.762857] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481478 2019-01-19 03:21:15 2019-01-21 14:52:15 2019-01-21 15:22:14 0:29:59 0:09:07 0:20:52 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:11:10.019627+00:00 smithi110 kernel: [ 60.762011] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481479 2019-01-19 03:21:16 2019-01-21 14:52:16 2019-01-21 15:36:16 0:44:00 0:26:12 0:17:48 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-1-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:10:00.019651+00:00 smithi135 kernel: [ 69.753523] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481480 2019-01-19 03:21:17 2019-01-21 14:53:30 2019-01-21 15:27:29 0:33:59 0:14:34 0:19:25 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:11:10.020251+00:00 smithi179 kernel: [ 58.553250] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481481 2019-01-19 03:21:17 2019-01-21 14:53:58 2019-01-21 15:13:57 0:19:59 0:09:13 0:10:46 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:03:00.021980+00:00 smithi069 kernel: [ 62.748489] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481482 2019-01-19 03:21:18 2019-01-21 14:54:06 2019-01-21 15:20:06 0:26:00 0:14:37 0:11:23 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:04:00.019909+00:00 smithi068 kernel: [ 53.565907] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481483 2019-01-19 03:21:19 2019-01-21 14:54:07 2019-01-21 15:36:07 0:42:00 0:08:29 0:33:31 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:26:00.019699+00:00 smithi178 kernel: [ 73.748722] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481484 2019-01-19 03:21:19 2019-01-21 14:55:05 2019-01-21 15:53:05 0:58:00 0:42:34 0:15:26 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:08:30.024606+00:00 smithi042 kernel: [ 84.698490] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481485 2019-01-19 03:21:20 2019-01-21 14:55:52 2019-01-21 15:19:51 0:23:59 0:10:59 0:13:00 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:08:00.019702+00:00 smithi077 kernel: [ 47.770717] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481486 2019-01-19 03:21:21 2019-01-21 14:56:21 2019-01-21 15:12:21 0:16:00 0:07:39 0:08:21 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:04:00.019630+00:00 smithi143 kernel: [ 34.745416] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481487 2019-01-19 03:21:22 2019-01-21 14:56:22 2019-01-21 15:50:23 0:54:01 0:13:57 0:40:04 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:36:10.020195+00:00 smithi074 kernel: [ 71.756142] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481488 2019-01-19 03:21:22 2019-01-21 14:56:22 2019-01-21 15:28:22 0:32:00 0:08:38 0:23:22 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:18:00.019684+00:00 smithi052 kernel: [ 50.748923] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481489 2019-01-19 03:21:23 2019-01-21 14:56:22 2019-01-21 19:40:26 4:44:04 4:15:31 0:28:33 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

Command failed (workunit test rbd/simple_big.sh) on smithi161 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=51bfb6791ff0479c4a2bd7e368c8af7f3fb3761c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh'

fail 3481490 2019-01-19 03:21:24 2019-01-21 14:58:19 2019-01-21 15:46:18 0:47:59 0:20:57 0:27:02 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/default/{msgr-failures/few.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:23:20.019575+00:00 smithi201 kernel: [ 38.768905] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481491 2019-01-19 03:21:24 2019-01-21 14:58:19 2019-01-21 15:44:18 0:45:59 0:25:58 0:20:01 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:17:00.019630+00:00 smithi067 kernel: [ 58.777926] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481492 2019-01-19 03:21:25 2019-01-21 14:58:19 2019-01-21 15:52:18 0:53:59 0:25:10 0:28:49 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:27:00.019701+00:00 smithi061 kernel: [ 47.769184] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481493 2019-01-19 03:21:26 2019-01-21 15:00:08 2019-01-21 17:58:10 2:58:02 1:51:23 1:06:39 smithi master krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} 4
Failure Reason:

Command failed on smithi077 with status 134: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludepEDROK -r -- '-g auto -g blockdev -x clone'"

fail 3481494 2019-01-19 03:21:26 2019-01-21 15:00:08 2019-01-21 15:58:08 0:58:00 0:42:59 0:15:01 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:13:00.020285+00:00 smithi172 kernel: [ 54.770249] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481495 2019-01-19 03:21:27 2019-01-21 15:00:10 2019-01-21 15:52:10 0:52:00 0:13:16 0:38:44 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} 3
Failure Reason:

Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi013 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=51bfb6791ff0479c4a2bd7e368c8af7f3fb3761c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'

fail 3481496 2019-01-19 03:21:28 2019-01-21 15:00:10 2019-01-21 15:46:10 0:46:00 0:12:30 0:33:30 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:33:10.020147+00:00 smithi145 kernel: [ 73.768455] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481497 2019-01-19 03:21:29 2019-01-21 15:00:10 2019-01-21 15:50:10 0:50:00 0:09:48 0:40:12 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:39:00.019743+00:00 smithi083 kernel: [ 73.746013] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481498 2019-01-19 03:21:29 2019-01-21 15:00:22 2019-01-21 15:18:22 0:18:00 0:07:51 0:10:09 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:08:30.019835+00:00 smithi046 kernel: [ 51.693901] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481499 2019-01-19 03:21:30 2019-01-21 15:00:27 2019-01-21 15:48:27 0:48:00 0:35:08 0:12:52 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:14:00.019664+00:00 smithi131 kernel: [ 74.756606] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481500 2019-01-19 03:21:31 2019-01-21 15:02:23 2019-01-21 16:00:23 0:58:00 0:45:10 0:12:50 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

"2019-01-21 15:19:42.738501 mon.b (mon.0) 102 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log

fail 3481501 2019-01-19 03:21:31 2019-01-21 15:02:23 2019-01-21 16:18:24 1:16:01 0:12:58 1:03:03 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T16:04:10.019630+00:00 smithi193 kernel: [ 30.757493] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481502 2019-01-19 03:21:32 2019-01-21 15:02:23 2019-01-21 16:34:24 1:32:01 0:28:32 1:03:29 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/fancy/{msgr-failures/few.yaml randomized-striping-on.yaml} tasks/fsx-1-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T16:05:00.020459+00:00 smithi110 kernel: [ 50.544140] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481503 2019-01-19 03:21:33 2019-01-21 15:02:23 2019-01-21 16:30:24 1:28:01 0:26:16 1:01:45 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T16:03:10.019588+00:00 smithi125 kernel: [ 63.759944] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481504 2019-01-19 03:21:33 2019-01-21 15:02:23 2019-01-21 15:24:22 0:21:59 0:08:56 0:13:03 smithi master krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:14:00.021982+00:00 smithi009 kernel: [ 37.695540] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481505 2019-01-19 03:21:34 2019-01-21 15:04:36 2019-01-21 15:34:35 0:29:59 0:14:46 0:15:13 smithi master krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:19:00.020025+00:00 smithi130 kernel: [ 35.776398] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481506 2019-01-19 03:21:35 2019-01-21 15:06:28 2019-01-21 15:38:27 0:31:59 0:14:32 0:17:27 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:23:00.019665+00:00 smithi144 kernel: [ 74.760822] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481507 2019-01-19 03:21:35 2019-01-21 15:06:28 2019-01-21 15:32:27 0:25:59 0:09:35 0:16:24 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:22:30.024492+00:00 smithi026 kernel: [ 80.754488] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481508 2019-01-19 03:21:36 2019-01-21 15:06:28 2019-01-21 15:28:27 0:21:59 0:08:58 0:13:01 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:19:10.020048+00:00 smithi105 kernel: [ 49.777839] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481509 2019-01-19 03:21:37 2019-01-21 15:06:28 2019-01-21 15:54:27 0:47:59 0:29:41 0:18:18 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:23:20.024674+00:00 smithi125 kernel: [ 108.759826] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481510 2019-01-19 03:21:37 2019-01-21 15:06:30 2019-01-21 15:30:29 0:23:59 0:09:27 0:14:32 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:19:00.019693+00:00 smithi083 kernel: [ 51.749850] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481511 2019-01-19 03:21:38 2019-01-21 15:08:15 2019-01-21 16:22:15 1:14:00 0:09:12 1:04:48 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T16:12:10.019678+00:00 smithi114 kernel: [ 45.753935] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481512 2019-01-19 03:21:39 2019-01-21 15:08:15 2019-01-21 15:26:14 0:17:59 0:08:33 0:09:26 smithi master krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_discard.yaml} 1
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:16:10.019835+00:00 smithi136 kernel: [ 38.762277] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481513 2019-01-19 03:21:39 2019-01-21 15:10:19 2019-01-21 15:48:18 0:37:59 0:08:47 0:29:12 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:39:00.019969+00:00 smithi124 kernel: [ 64.750944] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481514 2019-01-19 03:21:40 2019-01-21 15:10:19 2019-01-21 15:50:19 0:40:00 0:26:25 0:13:35 smithi master krbd/fsx/{ceph/ceph.yaml clusters/3-node.yaml conf.yaml striping/default/{msgr-failures/many.yaml randomized-striping-off.yaml} tasks/fsx-3-client.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:22:20.024350+00:00 smithi143 kernel: [ 86.760328] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481515 2019-01-19 03:21:41 2019-01-21 15:10:19 2019-01-21 15:52:19 0:42:00 0:16:09 0:25:51 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:34:10.020427+00:00 smithi036 kernel: [ 44.743179] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481516 2019-01-19 03:21:41 2019-01-21 15:10:19 2019-01-21 15:52:19 0:42:00 0:08:38 0:33:22 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:43:00.019578+00:00 smithi087 kernel: [ 37.321514] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481517 2019-01-19 03:21:42 2019-01-21 15:10:19 2019-01-21 16:26:19 1:16:00 0:37:17 0:38:43 smithi master krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:47:00.019797+00:00 smithi118 kernel: [ 47.754136] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481518 2019-01-19 03:21:43 2019-01-21 15:10:19 2019-01-21 16:02:19 0:52:00 0:10:57 0:41:03 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:51:00.020500+00:00 smithi029 kernel: [ 45.741609] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481519 2019-01-19 03:21:43 2019-01-21 15:11:48 2019-01-21 15:59:48 0:48:00 0:13:31 0:34:29 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:45:20.019414+00:00 smithi091 kernel: [ 45.545405] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481520 2019-01-19 03:21:44 2019-01-21 15:12:22 2019-01-21 15:42:22 0:30:00 0:08:59 0:21:01 smithi master krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} 3
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2019-01-21T15:32:00.021352+00:00 smithi084 kernel: [ 27.747228] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:908 ' in syslog

fail 3481521 2019-01-19 03:21:45 2019-01-21 15:12:59 2019-01-21 19:25:03 4:12:04 3:55:50 0:16:14 smithi master krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} 3
Failure Reason:

Command failed (workunit test rbd/simple_big.sh) on smithi177 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=51bfb6791ff0479c4a2bd7e368c8af7f3fb3761c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh'