Pulpito

teuthology-2016-07-20_02:10:03-fs-jewel---basic-smithi/325095

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2016-07-20 09:12:37 2016-07-25 10:30:29 253 smithi master 2 fail

Description: fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_trivial_sync.yaml}

Log: http://qa-proxy.ceph.com/teuthology/teuthology-2016-07-20_02:10:03-fs-jewel---basic-smithi/325095/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=ea61644615f443898b5bfcdd35d97d0d

Performance graphs: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-07-25T10%3A25%3A13&time_from=2016-07-25T10%3A21%3A21&hosts=smithi062%2Csmithi018

Failure Reason:

{'smithi018.front.sepia.ceph.com': {'changed': False, '_ansible_no_log': False, 'stdout': '', '_ansible_delegated_vars': {'ansible_host': 'localhost'}, 'failed': True, 'stderr': "fatal: Unable to create '/home/teuthworker/.cache/src/keys/.git/index.lock': File exists.\n\nIf no other git process is currently running, this probably means a\ngit process crashed in this repository earlier. Make sure no other git\nprocess is running and remove the file manually to continue.\n", 'rc': 128, 'invocation': {'module_name': 'git', 'module_args': {'force': True, 'track_submodules': False, 'reference': None, 'dest': '/var/lib/teuthworker/.cache/src/keys', 'verify_commit': False, 'clone': True, 'update': True, 'ssh_opts': None, 'repo': 'https://github.com/ceph/keys', 'bare': False, 'refspec': None, 'executable': None, 'remote': 'origin', 'recursive': True, 'accept_hostkey': False, 'depth': None, 'version': 'master', 'key_file': None}}, 'stdout_lines': [], 'msg': 'Failed to checkout branch master'}}

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/teuthology-2016-07-20_02:10:03-fs-jewel---basic-smithi/325095/teuthology.log
  • archive_path: /var/lib/teuthworker/archive/teuthology-2016-07-20_02:10:03-fs-jewel---basic-smithi/325095
  • description: fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_trivial_sync.yaml}
  • duration: 253
  • email: ceph-qa@ceph.com
  • failure_reason: {'smithi018.front.sepia.ceph.com': {'changed': False, '_ansible_no_log': False, 'stdout': '', '_ansible_delegated_vars': {'ansible_host': 'localhost'}, 'failed': True, 'stderr': "fatal: Unable to create '/home/teuthworker/.cache/src/keys/.git/index.lock': File exists.\n\nIf no other git process is currently running, this probably means a\ngit process crashed in this repository earlier. Make sure no other git\nprocess is running and remove the file manually to continue.\n", 'rc': 128, 'invocation': {'module_name': 'git', 'module_args': {'force': True, 'track_submodules': False, 'reference': None, 'dest': '/var/lib/teuthworker/.cache/src/keys', 'verify_commit': False, 'clone': True, 'update': True, 'ssh_opts': None, 'repo': 'https://github.com/ceph/keys', 'bare': False, 'refspec': None, 'executable': None, 'remote': 'origin', 'recursive': True, 'accept_hostkey': False, 'depth': None, 'version': 'master', 'key_file': None}}, 'stdout_lines': [], 'msg': 'Failed to checkout branch master'}}
  • flavor:
  • job_id: 325095
  • kernel:
  • last_in_suite: False
  • machine_type: smithi
  • name: teuthology-2016-07-20_02:10:03-fs-jewel---basic-smithi
  • nuke_on_error: True
  • os_type:
  • os_version:
  • overrides:
    • ceph:
      • log-whitelist:
        • slow request
        • wrongly marked me down
      • fs: btrfs
      • conf:
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
        • client:
          • debug ms: 1
          • debug client: 10
        • global:
          • ms inject socket failures: 2500
          • ms inject delay probability: 0.005
          • mds inject delay type: osd mds
          • ms inject delay max: 1
        • osd:
          • debug ms: 1
          • debug journal: 20
          • debug osd: 25
          • osd sloppy crc: True
          • osd op thread timeout: 60
          • debug filestore: 20
        • mon:
          • debug mon: 20
          • debug paxos: 20
          • debug ms: 1
      • sha1: b15cf42a4be7bb290e095cd5027d7f9ac604a97d
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
          • debug mon: 1
          • debug paxos: 20
          • debug ms: 20
    • workunit:
      • sha1: b15cf42a4be7bb290e095cd5027d7f9ac604a97d
    • install:
      • ceph:
        • sha1: b15cf42a4be7bb290e095cd5027d7f9ac604a97d
    • admin_socket:
      • branch: jewel
  • owner: scheduled_teuthology@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2', 'mds.b-s-a']
    • ['mon.b', 'mds.a', 'osd.3', 'osd.4', 'osd.5', 'client.0']
  • sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=ea61644615f443898b5bfcdd35d97d0d
  • status: fail
  • success: False
  • branch: jewel
  • seed:
  • sha1: b15cf42a4be7bb290e095cd5027d7f9ac604a97d
  • subset:
  • suite:
  • suite_branch: jewel
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1:
  • targets:
    • ubuntu@smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJIZ6C/wSPNCVMxhWWYf2SIiqwnYTJ/p+bVifajoWrjxaxr0AHhkCHguNg6OK3ySKdKuPYKcONh7tBp09YRSj7RsvwLu4jfTeW7ZyBmL+kaiwussRTbwvenR7U4fxqTd47m/EpQ7gj7Rt6wwTK/6bSxKu3WpWqd+HczINkXtxvIDFIFHeoAqYEXSuJMKLAduVQCcZsN24Zt2UxkBzdFBiDN01QykMEeV/B8cx7XxMp0/R9dcoBkcKxrQGgE5F43HFSbgDSFAmT4Gf6ulxLtMoGe9SYqEhRYZPq3JQAbeNDcOSnG10XhSClc3DZbb1MEKTupYhRt1VIdeS8K2KriDXj
    • ubuntu@smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUgXLIH608eXc5ym/2MgW7w08y6xi9dZym3Qb0hQuEe5Vw741OwBfUKmFWKk8GlAzlSq6EU0g0EEzCQ2jj+RuqkVbq5jdmGv1icXW+f1N0LsjqI5zuQ6WfA0YAgI8Fo8PVN0rdduRDaxwXcWi8I6WvHb1cnYHrNmDRaj0cNZkeUsFWKgoExsQ3de5CV7nx4C/b/VLo/mrZnWtLFu/FgZdj5s6Vx4a4Ceukwp032CiP1KWpc33aVxV7z0Z04z3ytQAcQ2+6iYm/3TWcLSvom5zp62tayvsHVSOHy9mYI6Q8xr9A0t5iUEClGtDxFY64JzxDJV7BdwbL4siujDrqAcc5
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 2
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock.check:
    • install:
    • ceph:
    • mds_thrash:
    • ceph-fuse:
    • workunit:
      • clients:
        • all:
          • fs/misc/trivial_sync.sh
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url: http://pcp.front.sepia.ceph.com:44323/grafana/index.html#/dashboard/script/index.js?time_to=2016-07-25T10%3A25%3A13&time_from=2016-07-25T10%3A21%3A21&hosts=smithi062%2Csmithi018
  • priority:
  • user:
  • queue:
  • posted: 2016-07-20 09:12:37
  • started:
  • updated: 2016-07-25 10:30:29
  • status_class: danger