Pulpito

yuriw-2020-05-28_22:48:21-kcephfs-wip-yuri6-testing-2020-05-28-2041-octopus-distro-basic-smithi/5099725

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2020-05-28 22:49:27 2020-05-29 00:34:17 2020-05-29 06:34:26 6:00:09 0:21:42 5:38:27 smithi py2 ubuntu 18.04 6 pass

Description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-05-28_22:48:21-kcephfs-wip-yuri6-testing-2020-05-28-2041-octopus-distro-basic-smithi/5099725/teuthology.log

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2020-05-28_22:48:21-kcephfs-wip-yuri6-testing-2020-05-28-2041-octopus-distro-basic-smithi/5099725/teuthology.log
  • archive_path: /home/teuthworker/archive/yuriw-2020-05-28_22:48:21-kcephfs-wip-yuri6-testing-2020-05-28-2041-octopus-distro-basic-smithi/5099725
  • description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
  • duration: 0:21:42
  • email: ceph-qa@ceph.io
  • failure_reason:
  • flavor: basic
  • job_id: 5099725
  • kernel:
    • client:
      • branch: testing
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: yuriw-2020-05-28_22:48:21-kcephfs-wip-yuri6-testing-2020-05-28-2041-octopus-distro-basic-smithi
  • nuke_on_error: True
  • os_type: ubuntu
  • os_version: 18.04
  • overrides:
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
    • workunit:
      • sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
      • branch: wip-yuri6-testing-2020-05-28-2041-octopus
    • ceph:
      • sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
        • bad backtrace on directory inode
        • error reading table object
        • Metadata damage detected
        • slow requests are blocked
        • Behind on trimming
      • fs: xfs
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug ms: 1
          • debug mon: 20
          • debug paxos: 20
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • mon osd full ratio: 0.9
          • debug ms: 20
          • bluestore fsck on mount: True
          • debug osd: 25
          • bluestore compression mode: aggressive
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • mon osd backfillfull_ratio: 0.85
          • mon osd nearfull ratio: 0.8
          • osd op complaint time: 180
          • bluestore block size: 96636764160
          • debug filestore: 20
          • debug rocksdb: 10
          • osd shutdown pgref assert: True
          • osd failsafe full ratio: 0.95
          • debug journal: 20
      • cephfs_ec_profile:
        • m=2
        • k=2
        • crush-failure-domain=osd
    • install:
      • ceph:
        • sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
    • admin_socket:
      • branch: wip-yuri6-testing-2020-05-28-2041-octopus
    • thrashosds:
      • bdev_inject_crash_probability: 0.5
      • bdev_inject_crash: 2
  • owner: scheduled_yuriw@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
    • ['client.2']
    • ['client.3']
  • sentry_event:
  • status: pass
  • success: True
  • branch: wip-yuri6-testing-2020-05-28-2041-octopus
  • seed:
  • sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
  • subset:
  • suite:
  • suite_branch: wip-yuri6-testing-2020-05-28-2041-octopus
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
  • targets:
    • smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCiLpFNcrm+rojVVSmWNS4F/E7Tmww8Q9ITY/5IhYMTXseNp/bHZv5S4gz66rv8dWTVZg7En0G2x0qnegkoJUJTq1RmTc+wuIrPnprg8kwPXB9mddh/5RSUgXqunuVhTMNjLGZq0iPHHUVpNeWQWXI88J4iugIVLwCv77rbT5VHQuO6rPbKyohQpSZDGqFOLpCfVCsdPKOiITA5M3gIxNeRsr6scjIgHsrCI333VZxsVxdpbRmJtvYvhK2vlYj3w6wdYVOn8+/vEW1v49WGt5YCqv/qLpp6Tvo57axwyAwn0JNx3f4ljgY/XeNgSbbjyeazx+TH7E195r9bCsktVBed
    • smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAT4ROI8S7bbZwUjsod2mXI675anuqL8eZnkYF8mJS/B11oGfv+AsjNqSttpT6p6imJQ3zM2y7B9/BfK74RjSM+a1Rnbm0824moKYrKuc4gPBhYkYIyAm0zQqpHKufzi3MoqA+cO/XmWTxdF6Y16h/NRclSIraD+uK79tZ4iZgfKUVj8x2ivpnqwtkNisJI2DXXEq5oDYbo5+t1zON16EtrIXmzxekiBFeJjV2HlYgfDTKTS/KwbojB2GjVROxBgBDirrbFhnVOiQfX56JUT0fRiiuruVOZJTlF59JrxIBrPbxzEiQVBWv3c9uyomWUtiF4055n1jH4OVt8Mcz9VVJ
    • smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQ+J0H+Ah3lymBGv9x1/pNtzQ6b7YIzX6mvErwYpXPDkdaTnysuaAVUhGUQT0Mwlx+eN0DSqWXiyIVw58YuMbV6wRAMEsytV8TTM+bV+nM4KSo24FsNJf31EF/vVvlYthbB/XCR422Z3nEEYLEXlyvRrRo00tCVjd8BiTTu/mxeGS1PEoVHTrtYenM8uLFG2TGEaOrrdE6PT+KqoEN7wJyP7LPWoIedaLzSRpXcUjRPlX+wGW9pnSRDybL9nWAKgy6GI1S9eTFEZ4R81kzpHmnbads1HXdZOl/YNZIVwHL0mlMwB05HAxR3g0wZ/8/ck7zliR77vaOgzd1IgWIoU4j
    • smithi019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvlmfu9WCCakd3MZPhOiZTd7aa/TJl49SuiIUysxIG8GrCAWGwGQb+L8C+b3/FxG3m6vqt8VtCPmpOkaMgu+ZXMz2shVi9mMkNwU5xVaVB0wSzFEkpfu0DXVW7IAZJnDiOaP4dsIF4KQtQXZazkqiar6CNvnIVD6QmDhQNE6X/ua+NKbohqcP6/KwfH7qVijsDh7EZOMtWlXf+jPrKF4h0yNHgrVPfUc4qZjHBHHxMU0sJaVRqmY/3+PZm0y6p7aZ9s4K/azOOnlAl/mXYqgXTRB8zFgFuKBkVkP576fYxNNiXxtI3LgSV2CRLS+vq63Yo4SyBxk9BOdmJOEInGN75
    • smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpHEa40iO8Zn/NHqTBH4/nJMjX8YdHy/vVsKzv9jAjnQenrpR1oERnEmTbLXb/nriT+OGhjEMKVz275KujNMm973U8QXrOoQz8JMr0oi4DfOIKQ4uUBEbLsi8gTlcc5jG0ZsU+MRmtwcbuhPIMk5gjmvXvrqhRq3ypjFB50ubyj8LXFPs/FqkYiNBgV82aEcj7UM+wd4wCcRXmMXXGKrBRa1nvEZhh779hU3gX+G9vDs40u9EUrSlewR5vhtp+oPA9zo2gozvwPdINS7vR/CPvngGPLDauiTw9K+FitfWDAh66d8jXMU9wJeJFNKOHgS9yPlBe3Ppf99RT+3oMopDr
    • smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEVKmcYZ/ejEZyW/rNJRGJV/L5iP3Di4QvXAtVaoMpvnCQ9QQC/JNKLYB3nvsEF5evgtNeo6jH0cnMNJeDucFO5NL6sQOPRGmNdv+h7u5tXcJ0YA4fkF1B2apsN50AzJZ9xxvLV6X7DJ4/8n3hiJeukGdFQyNB5UeiewJM2GXVJz1glS9b9RaH9V7+1OzIPDpOhdfJnNDLtg0gNyNPuHMydbNWRbevOpr3IFOKx7Fdj+XOQJ1VGex7YSNklLBLIPbppn9nOLPbK41rfeisnXb4Ua0OqrG12IeY8KRNOrLQbmqJsoeOS9u9/h3gt3e4ma+qKEYHfMFx3clK+IVSV5Tz
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 6
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • branch: testing
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
      • sha1: cd10f027a240a5c0e7ade8524232e57dfc1bd19d
    • ceph:
    • kclient:
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_journal_repair
  • teuthology_branch: py2
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-05-28 22:49:27
  • started: 2020-05-29 00:34:17
  • updated: 2020-05-29 06:34:26
  • status_class: success
  • runtime: 6:00:09
  • wait_time: 5:38:27