Pulpito

teuthology-2020-09-17_10:25:02-kcephfs-master-distro-basic-smithi/5443617

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2020-09-17 10:26:00 2020-09-17 10:39:42 2020-09-17 20:15:53 9:36:11 0:28:45 9:07:26 smithi master rhel 8.1 6 pass

Description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}

Log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-17_10:25:02-kcephfs-master-distro-basic-smithi/5443617/teuthology.log

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/teuthology-2020-09-17_10:25:02-kcephfs-master-distro-basic-smithi/5443617/teuthology.log
  • archive_path: /home/teuthworker/archive/teuthology-2020-09-17_10:25:02-kcephfs-master-distro-basic-smithi/5443617
  • description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
  • duration: 0:28:45
  • email: ceph-qa@ceph.io
  • failure_reason:
  • flavor: basic
  • job_id: 5443617
  • kernel:
    • client:
      • sha1: distro
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: teuthology-2020-09-17_10:25:02-kcephfs-master-distro-basic-smithi
  • nuke_on_error: True
  • os_type: rhel
  • os_version: 8.1
  • overrides:
    • ceph-deploy:
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • sha1: 499d0c7f2b021f292dffb4210e78d3b2db47094d
      • branch: master
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
      • fs: xfs
      • cephfs_ec_profile:
        • m=2
        • k=2
        • crush-failure-domain=osd
      • sha1: 36d67cf59e365a1802bd6cbd0c4cc744d7183ec8
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • mon osd full ratio: 0.9
          • debug ms: 20
          • bluestore fsck on mount: True
          • debug osd: 25
          • bluestore compression mode: aggressive
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • mon osd backfillfull_ratio: 0.85
          • osd op complaint time: 180
          • bluestore block size: 96636764160
          • osd shutdown pgref assert: True
          • debug filestore: 20
          • debug rocksdb: 10
          • mon osd nearfull ratio: 0.8
          • osd failsafe full ratio: 0.95
          • debug journal: 20
      • log-ignorelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
        • bad backtrace
        • object missing on disk
        • error reading table object
        • error reading sessionmap
        • unmatched fragstat
        • was unreadable, recreating it now
        • Scrub error on inode
        • Metadata damage detected
        • inconsistent rstat on inode
        • Error recovering journal
    • install:
      • ceph:
        • sha1: 36d67cf59e365a1802bd6cbd0c4cc744d7183ec8
    • admin_socket:
      • branch: master
    • thrashosds:
      • bdev_inject_crash_probability: 0.5
      • bdev_inject_crash: 2
  • owner: scheduled_teuthology@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
    • ['client.2']
    • ['client.3']
  • sentry_event:
  • status: pass
  • success: True
  • branch: master
  • seed:
  • sha1: 36d67cf59e365a1802bd6cbd0c4cc744d7183ec8
  • subset:
  • suite:
  • suite_branch: master
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 499d0c7f2b021f292dffb4210e78d3b2db47094d
  • targets:
    • smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbddCmT5+BrzbUQ8K2HvBbfrHSYYf3ehfxTUZ5CiKao9R/AOreJCBzDfGnatomIPt6lGrMoxRwVYV9p9o+z4bVRysUKcbr7yBhfvAkKUdAxadt0I2nmSYgeZ9o+x3S491VLsmbSVHydP0mb69z/rIoV/Df6QgLHyOoEZc/hFwM6PJn5JTh1at46FnduroGyxLr7Nd5E+cd63hdPX6BA5eC6rxXG5y9LjL7YXqN6SHQhaFdnf0AxGYYCms8ejEf85dBMDK2pG4jP4MfAqVtozKR++hQDv8JIwEJ6WlJbnYJ9lRtkjeFRmKYmVEFv7VxIDwhv1QF9c9NcN1YlGCGrdin/xDrFg29HOUC6QA7IRrH0bAR3hlZ+jjidrJFoDoMcA3VYEKXYzHr5CMUAnw06/oUcXLK8MyVR9muS4FoUIPLQEMGLzUMS92T9WODLJamyBg4G9A9t9u7FIEILVLLNpXGieJB1psnmAVMo3PHK6jvBA+WWIzrLXVlpndsepq+nU0=
    • smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFYkqk6AiSu5afnb8hhOWKJfR/HMbYIgIBIeDCJF5KcHmJlOQi3D15SPPzXXGrruDtgmGC57heEMnNHSLMxIs2Ne03jHud+QYyYcJJtXjWftFw7oFFMbje5QBOoqBLjjf3eAVDjie59UAqEBKoXz/XAkowWBvUI/qYEVppyZ7ttljh2xJv2X5DsAMOxvpoXLwOVGWLvq1sv33TDwG9C7dQ1jYP/Ic+eg2sGcLA25T0lsqnH5xwJWTzBarvKaa6ez5r2NKC/pUhslCGFP8edTuG34/VbwYC/RhHlYAQ0vgvBcLP5DMBMDcWA9OSC0GbBfME6EAAztJPybWECaOCYCo4yETNPj2C+AJCn55w5AQhfSFeqFyAdjkKh0HwHUOXe/HK0ZArHvevnCM4+X45Ix+um8Qkcaxmq2UwFbGf+DRJLo0pM0BEOP8o753xlRAIMobviDaOTwxEvZ4sx6cCtHsb7FUDL/Q/zAARsKDL4NQyJL5J68BHnTTgDCoVL3Oltxc=
    • smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdQGrCJttVwlQUJqdEraKvab0NUxWoQRESfjpM93XlxsPFir8VX372DOwcODd6cotXdgZeemUWrESDzblwf8XiKYLj2aRqAFPyjn9UpUIqCPBQJD+aqDoX8ibcLaB07Dr2sdSQGkE1dCC5d8R4I0Pq11OFyZE9vmO8apb3I+OXrYqMMOcwH5cQBKteo/w9RDwhsgxoofgkU1fNvxhazHmi3QxuNk652EZEVb5NsyLRMqNmxYeiS72QQeXYwezhHFlZEJAonrR0c1k4TOoEm+dQdnW2mcIs+pvKiTDBE2DuY5n3za2fvS63Im0R9khgd4qY//CFawEa6fAQYqSbfMF9EUN5KcURV4+jr9c068NGdUuGkadPbTW2odxmYkyH3d379Em3ntwlyoi6CzOYHcbcvx8CqcOvddOxFwx+Nb3lzWXNUKCcZ1+NMHNsm5zlvd9o/ncSbLqO5ltgXYVCvNjZ06OtVfBHRb8twtJsG4F+RUrnF4p9q3wV2bkIm0xrm+s=
    • smithi001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtR3aEPto6jBcUCT6HLU3n6aSXs5lPLpQium1ndX870sNEuPjYfrnVCGnRb6WPn9+HY38mWNnswppSlsf/zA6oBodRdUO2uo3XISq1iFrUeGDOGFa/9p9qDe6zpZ4t7zlvhHTEEGXDSYUuPQL2n68UDFtehHqw8PQ4Dc1wQByyXZI8v/9ISo6xsfjGJ98EHO1ERwwqjFGv/m5Sn0s9TSSCPqK6Nj3HFoeBk76FlA1KS8lsbdXMhBPnCgoPer/T+iekAmxHPqFbf4jIAIKDfFUwhGQHGVePvh27Qk9P1oH2Jv5edRs4/Rm2BtdWThZxbVQcKklzlNTCO3E+wF6kpWU+mJu/f5iMtrT7FhNVGzS0M+kRBB54ouM4zyynOO+QdHIsa8LDMcE5POkWFP3bRDVPOi/zKHBi0gGDkhQp1mDGSENTTIl+XoPnLb/QS0NUgVvZ7ojz+Cy4X+JTscabTji9m7eZ2D0WTG6JBQpWeuW21YpZIugBAnexgqgALPkoVmc=
    • smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5sKQr2tECsSXoNFyqtLGr3WvwBvqH5/SZtNs5GYVQ9aPG1XFBHMAVPgFNvKuvZ6O3QhyypAh975Uy4Z7UBnazZiuoshulMpx7zJ54GkCnEOu53CtZ8NpIkGtWoIVxsXUZdlk8hSDKDYpw24b5sVxhDndXNAKpiiOdIJB9qYrFwfgPOilM9jZznVE4Aye2LeSCBs0hoMCkvfpimKLWehGDs+vRQk8Af7u1v9O4SMypRIP5cmX37fcTp6PGQ5UYGnmN6iBBr0+woT24BmvAZLj3ucC7QPIJo2f53XHDzdJ6xpzuuQgRe/Tg1Hk7WlFJowAPB0MSfMYK4ExTWzd5Cti43egUBE2Y36xEJwiCo2i/5iQKtRq5Ciox1vc1rabWIJLtBdbZOiwoDFA93X5tDZtC9oXm4BKLLmjnt+ITip3QR0odJVXqXh3uKRkq7IRRWWCrePZzRPuj7JcV4FYW8rys1+/qoPuIbMAo1iE0kI51hNzJHRvdzojxm2IS7BI4IGc=
    • smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKibPUZUlFxTZqCPynAjUM/ZLN1eHrCfBVwtj0bBG4oAVv0g03Iz4Jx23OTwIVwPKkrtdFyirZyFeewsrLHn6fljXCLi3GtrgE4LZzZelX4TXXNERZdOWhtGm244jw5ljkWRWQ2n+rloSxKNIeVjaHfW2PlqNCVZelhQWVkv7OByfbqlSwBqRVvy99fXW7y1czbaP4Esjn7Nyl1LhKOk0We4C0TZmXZtotokf+DtF2uiBYtAByHi5JTtFfvWXVh18SM7DihfVVo1pHigS8i8pxLtSXDfXHECiRYbBgR2iBo9hbhuL07VEp80UFbSyi7HoL9vNp/x++rbP/GFZ0rOxj2JKH1W+FGOw+Ji62PCCkCD+VUim+sbFd+qXX9RLIum38F5josS3uFEOqa89jQVXtXukRlt1IL2iLMXpHfKl7A25F0w7QzE3OzgWsZsnwDNJvNhXVkUPTY5fZDUit+7FY2IsBfruZQTR8cv/CRYCaPxO/VN5SVW5LiYRV7UKwz18=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 6
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • sha1: distro
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • network-manager
          • iproute2
          • util-linux
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • NetworkManager
          • iproute
          • util-linux
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
      • sha1: 36d67cf59e365a1802bd6cbd0c4cc744d7183ec8
    • ceph:
    • kclient:
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_data_scan
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-09-17 10:26:00
  • started: 2020-09-17 10:39:42
  • updated: 2020-09-17 20:15:53
  • status_class: success
  • runtime: 9:36:11
  • wait_time: 9:07:26