Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 331638 2016-07-25 03:41:58 2016-07-25 03:43:47 2016-07-25 04:41:34 0:57:47 0:51:50 0:05:57 mira master rados/thrash-erasure-code-shec/{leveldb.yaml rados.yaml clusters/{fixed-4.yaml openstack.yaml} fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2016-07-25T04:28:59.897273+00:00 mira030 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog

pass 331639 2016-07-25 03:41:59 2016-07-25 03:43:49 2016-07-25 04:57:35 1:13:46 1:13:23 0:00:23 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 331640 2016-07-25 03:42:01 2016-07-25 03:43:47 2016-07-25 04:51:35 1:07:48 1:05:55 0:01:53 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
fail 331641 2016-07-25 03:42:02 2016-07-25 03:43:46 2016-07-25 04:23:33 0:39:47 0:35:38 0:04:09 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/btrfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
Failure Reason:

{'mira069.front.sepia.ceph.com': {'msg': 'SSH Error: data could not be sent to the remote host. Make sure this host can be reached over ssh', 'unreachable': True, 'changed': False}}

pass 331642 2016-07-25 03:42:03 2016-07-25 03:43:48 2016-07-25 04:45:34 1:01:46 0:59:38 0:02:08 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 331643 2016-07-25 03:42:05 2016-07-25 03:43:52 2016-07-25 05:29:37 1:45:45 1:05:02 0:40:43 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/btrfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
pass 331644 2016-07-25 03:42:06 2016-07-25 03:43:51 2016-07-25 05:05:36 1:21:45 0:36:45 0:45:00 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/random.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
pass 331645 2016-07-25 03:42:08 2016-07-25 03:43:50 2016-07-25 04:53:35 1:09:45 0:57:50 0:11:55 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 331646 2016-07-25 03:42:09 2016-07-25 03:43:47 2016-07-25 04:49:35 1:05:48 1:04:47 0:01:01 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 331647 2016-07-25 03:42:10 2016-07-25 03:43:48 2016-07-25 05:01:35 1:17:47 1:16:12 0:01:35 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
fail 331648 2016-07-25 03:42:12 2016-07-25 03:43:46 2016-07-25 03:55:32 0:11:46 0:06:53 0:04:53 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

{'mira051.front.sepia.ceph.com': {'cmd': '/usr/bin/git reset --hard origin/master', '_ansible_no_log': False, 'stdout': '', 'changed': False, 'invocation': {'module_name': 'git', 'module_args': {'force': True, 'track_submodules': False, 'reference': None, 'dest': '/var/lib/teuthworker/.cache/src/keys', 'verify_commit': False, 'clone': True, 'update': True, 'ssh_opts': None, 'repo': 'https://github.com/ceph/keys', 'bare': False, 'refspec': None, 'executable': None, 'remote': 'origin', 'recursive': True, 'accept_hostkey': False, 'depth': None, 'version': 'master', 'key_file': None}}, 'failed': True, 'stderr': "fatal: Unable to create '/home/teuthworker/.cache/src/keys/.git/index.lock': File exists.\n\nIf no other git process is currently running, this probably means a\ngit process crashed in this repository earlier. Make sure no other git\nprocess is running and remove the file manually to continue.\n", 'rc': 128, '_ansible_delegated_vars': {'ansible_host': 'localhost'}, 'stdout_lines': [], 'msg': 'Failed to checkout master'}}

pass 331649 2016-07-25 03:42:13 2016-07-25 03:43:46 2016-07-25 04:31:35 0:47:49 0:46:27 0:01:22 mira master rados/monthrash/{rados.yaml ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml mon_kv_backend/rocksdb.yaml msgr/random.yaml msgr-failures/mon-delay.yaml thrashers/sync-many.yaml workloads/rados_api_tests.yaml} 2
fail 331650 2016-07-25 03:42:14 2016-07-25 03:43:46 2016-07-25 04:23:34 0:39:48 0:34:53 0:04:55 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

{'mira118.front.sepia.ceph.com': {'msg': 'SSH Error: data could not be sent to the remote host. Make sure this host can be reached over ssh', 'unreachable': True, 'changed': False}}

pass 331651 2016-07-25 03:42:16 2016-07-25 03:43:48 2016-07-25 04:53:35 1:09:47 1:08:08 0:01:39 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/btrfs.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
pass 331652 2016-07-25 03:42:17 2016-07-25 03:43:46 2016-07-25 04:27:34 0:43:48 0:43:25 0:00:23 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/random.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache.yaml} 2
pass 331653 2016-07-25 03:42:19 2016-07-25 03:43:48 2016-07-25 04:27:34 0:43:46 0:43:20 0:00:26 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/btrfs.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 331654 2016-07-25 03:42:20 2016-07-25 03:43:50 2016-07-25 05:21:37 1:37:47 0:52:54 0:44:53 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
pass 331655 2016-07-25 03:42:21 2016-07-25 03:43:49 2016-07-25 04:43:35 0:59:46 0:57:54 0:01:52 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-snaps.yaml} 2
pass 331656 2016-07-25 03:42:23 2016-07-25 03:43:50 2016-07-25 04:33:35 0:49:45 0:47:48 0:01:57 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/rados_api_tests.yaml} 2
dead 331657 2016-07-25 03:42:24 2016-07-25 03:43:48 2016-07-25 15:51:15 12:07:27 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/rgw_snaps.yaml} 2
pass 331658 2016-07-25 03:42:26 2016-07-25 03:43:50 2016-07-25 05:13:36 1:29:46 0:53:44 0:36:02 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
fail 331659 2016-07-25 03:42:27 2016-07-25 03:43:48 2016-07-25 04:39:34 0:55:46 0:51:58 0:03:48 mira master rados/thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/simple.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed on mira101 with status 33: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05'

fail 331660 2016-07-25 03:42:29 2016-07-25 03:43:50 2016-07-25 04:49:35 1:05:45 0:59:27 0:06:18 mira master rados/monthrash/{rados.yaml ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml mon_kv_backend/leveldb.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/one.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2016-07-25T04:23:20.730781+00:00 mira054 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog

fail 331661 2016-07-25 03:42:30 2016-07-25 03:43:45 2016-07-25 04:33:34 0:49:49 0:45:26 0:04:23 mira master rados/singleton/{rados.yaml all/lost-unfound-upgrade.yaml fs/xfs.yaml msgr/random.yaml msgr-failures/few.yaml} 2
Failure Reason:

SELinux denials found on ubuntu@mira085.front.sepia.ceph.com: ['type=AVC msg=audit(1469420618.472:5035): avc: denied { read } for pid=32329 comm="ceph-osd" name="magic" dev="sdf" ino=26 scontext=system_u:system_r:ceph_t:s0 tcontext=unconfined_u:object_r:unlabeled_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1469420618.073:5022): avc: denied { read } for pid=32287 comm="ceph-osd" name="magic" dev="sdf" ino=26 scontext=system_u:system_r:ceph_t:s0 tcontext=unconfined_u:object_r:unlabeled_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1469420618.472:5035): avc: denied { open } for pid=32329 comm="ceph-osd" path="/var/lib/ceph/osd/ceph-1/magic" dev="sdf" ino=26 scontext=system_u:system_r:ceph_t:s0 tcontext=unconfined_u:object_r:unlabeled_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1469420618.073:5022): avc: denied { open } for pid=32287 comm="ceph-osd" path="/var/lib/ceph/osd/ceph-1/magic" dev="sdf" ino=26 scontext=system_u:system_r:ceph_t:s0 tcontext=unconfined_u:object_r:unlabeled_t:s0 tclass=file permissive=1']

pass 331662 2016-07-25 03:42:31 2016-07-25 03:43:50 2016-07-25 04:19:34 0:35:44 0:35:07 0:00:37 mira master rados/singleton/{rados.yaml all/osd-recovery-incomplete.yaml fs/xfs.yaml msgr/async.yaml msgr-failures/many.yaml} 1
fail 331663 2016-07-25 03:42:33 2016-07-25 03:43:49 2016-07-25 04:17:34 0:33:45 0:29:51 0:03:54 mira master rados/singleton/{rados.yaml all/reg11184.yaml fs/xfs.yaml msgr/simple.yaml msgr-failures/few.yaml} 1
fail 331664 2016-07-25 03:42:34 2016-07-25 04:02:10 2016-07-25 05:51:39 1:49:29 0:50:22 0:59:07 mira master rados/thrash-erasure-code-shec/{leveldb.yaml rados.yaml clusters/{fixed-4.yaml openstack.yaml} fs/xfs.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2016-07-25T05:40:39.251099+00:00 mira066 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog

fail 331665 2016-07-25 03:42:35 2016-07-25 04:21:07 2016-07-25 05:08:43 0:47:36 0:39:43 0:07:53 mira master rados/singleton/{rados.yaml all/cephtool.yaml fs/xfs.yaml msgr/async.yaml msgr-failures/many.yaml} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on mira114 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e1c3b1ebd3a5dd73daaf6f9e875849800d163eab TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/cephtool/test.sh'

fail 331666 2016-07-25 03:42:37 2016-07-25 04:21:10 2016-07-25 04:56:42 0:35:32 0:30:45 0:04:47 mira master rados/singleton/{rados.yaml all/divergent_priors.yaml fs/xfs.yaml msgr/random.yaml msgr-failures/few.yaml} 1
fail 331667 2016-07-25 03:42:38 2016-07-25 04:29:26 2016-07-25 05:01:02 0:31:36 0:26:16 0:05:20 mira master rados/singleton/{rados.yaml all/divergent_priors2.yaml fs/xfs.yaml msgr/simple.yaml msgr-failures/many.yaml} 1
pass 331668 2016-07-25 03:42:39 2016-07-25 04:29:28 2016-07-25 05:03:02 0:33:34 0:30:43 0:02:51 mira master rados/singleton/{rados.yaml all/lost-unfound-delete-upgrade.yaml fs/xfs.yaml msgr/async.yaml msgr-failures/many.yaml} 2
pass 331669 2016-07-25 03:42:41 2016-07-25 04:29:32 2016-07-25 05:33:07 1:03:35 0:52:01 0:11:34 mira master rados/multimon/{rados.yaml clusters/9.yaml fs/xfs.yaml mon_kv_backend/rocksdb.yaml msgr/async.yaml msgr-failures/few.yaml tasks/mon_recovery.yaml} 3
pass 331670 2016-07-25 03:42:42 2016-07-25 04:37:13 2016-07-25 05:26:45 0:49:32 0:42:24 0:07:08 mira master rados/thrash-erasure-code-big/{leveldb.yaml rados.yaml cluster/{12-osds.yaml openstack.yaml} fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 331671 2016-07-25 03:42:43 2016-07-25 04:37:14 2016-07-25 05:34:47 0:57:33 0:56:20 0:01:13 mira master rados/basic/{rados.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml mon_kv_backend/leveldb.yaml msgr/async.yaml msgr-failures/few.yaml tasks/rados_stress_watch.yaml} 2
fail 331672 2016-07-25 03:42:45 2016-07-25 04:37:15 2016-07-25 05:34:47 0:57:32 0:51:25 0:06:07 mira master rados/verify/{rados.yaml 1thrash/default.yaml clusters/{fixed-2.yaml openstack.yaml} fs/btrfs.yaml mon_kv_backend/rocksdb.yaml msgr/simple.yaml msgr-failures/few.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 331673 2016-07-25 03:42:46 2016-07-25 04:46:01 2016-07-25 05:33:33 0:47:32 0:45:15 0:02:17 mira master rados/basic/{rados.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml mon_kv_backend/leveldb.yaml msgr/simple.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml} 2
pass 331674 2016-07-25 03:42:48 2016-07-25 04:46:02 2016-07-25 05:31:34 0:45:32 0:39:58 0:05:34 mira master rados/thrash-erasure-code-big/{leveldb.yaml rados.yaml cluster/{12-osds.yaml openstack.yaml} fs/xfs.yaml msgr-failures/few.yaml thrashers/fastread.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 4
pass 331675 2016-07-25 03:42:49 2016-07-25 04:46:01 2016-07-25 06:03:35 1:17:34 1:01:57 0:15:37 mira master centos 7.2 rados/thrash-erasure-code-isa/{leveldb.yaml rados.yaml arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr-failures/fastclose.yaml supported/centos_7.2.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
fail 331676 2016-07-25 03:42:50 2016-07-25 04:46:06 2016-07-25 06:01:39 1:15:33 1:03:41 0:11:52 mira master centos 7.2 rados/thrash-erasure-code-isa/{leveldb.yaml rados.yaml arch/x86_64.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr-failures/few.yaml supported/centos_7.2.yaml thrashers/mapgap.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/kern.log:2016-07-25T05:26:35.122552+00:00 mira054 kernel: [ INFO: possible circular locking dependency detected ] ' in syslog