Pulpito

yuriw-2020-06-16_18:33:04-kcephfs-wip-yuri-testing-2020-06-16-1607-octopus-distro-basic-smithi/5155530

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2020-06-16 18:33:39 2020-06-17 02:50:32 2020-06-17 05:02:34 2:12:02 0:18:00 1:54:02 smithi master rhel 8.1 6 pass

Description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-06-16_18:33:04-kcephfs-wip-yuri-testing-2020-06-16-1607-octopus-distro-basic-smithi/5155530/teuthology.log

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2020-06-16_18:33:04-kcephfs-wip-yuri-testing-2020-06-16-1607-octopus-distro-basic-smithi/5155530/teuthology.log
  • archive_path: /home/teuthworker/archive/yuriw-2020-06-16_18:33:04-kcephfs-wip-yuri-testing-2020-06-16-1607-octopus-distro-basic-smithi/5155530
  • description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
  • duration: 0:18:00
  • email: ceph-qa@ceph.io
  • failure_reason:
  • flavor: basic
  • job_id: 5155530
  • kernel:
    • client:
      • sha1: distro
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: yuriw-2020-06-16_18:33:04-kcephfs-wip-yuri-testing-2020-06-16-1607-octopus-distro-basic-smithi
  • nuke_on_error: True
  • os_type: rhel
  • os_version: 8.1
  • overrides:
    • ceph-deploy:
      • fs: xfs
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
        • osd:
          • mon osd full ratio: 0.9
          • mon osd backfillfull_ratio: 0.85
          • bluestore fsck on mount: True
          • mon osd nearfull ratio: 0.8
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • bluestore block size: 96636764160
          • debug rocksdb: 10
          • osd failsafe full ratio: 0.95
      • bluestore: True
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
      • branch: wip-yuri-testing-2020-06-16-1607-octopus
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
        • force file system read-only
        • bad backtrace
        • MDS in read-only mode
        • \(MDS_READ_ONLY\)
      • sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
      • fs: xfs
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • mon osd full ratio: 0.9
          • debug ms: 20
          • debug journal: 20
          • debug osd: 25
          • debug bluestore: 20
          • debug bluefs: 20
          • osd objectstore: bluestore
          • mon osd backfillfull_ratio: 0.85
          • osd op complaint time: 180
          • bluestore block size: 96636764160
          • osd shutdown pgref assert: True
          • debug filestore: 20
          • debug rocksdb: 10
          • mon osd nearfull ratio: 0.8
          • osd failsafe full ratio: 0.95
          • bluestore fsck on mount: True
      • cephfs_ec_profile:
        • m=2
        • k=2
        • crush-failure-domain=osd
    • install:
      • ceph:
        • sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
    • admin_socket:
      • branch: wip-yuri-testing-2020-06-16-1607-octopus
    • thrashosds:
      • bdev_inject_crash_probability: 0.5
      • bdev_inject_crash: 2
  • owner: scheduled_yuriw@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
    • ['client.2']
    • ['client.3']
  • sentry_event:
  • status: pass
  • success: True
  • branch: wip-yuri-testing-2020-06-16-1607-octopus
  • seed:
  • sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
  • subset:
  • suite:
  • suite_branch: wip-yuri-testing-2020-06-16-1607-octopus
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
  • targets:
    • smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9LbmzoLSi2HqYzM13e1XPS8CreDcPZclIEnlP/8xpaIrtoL7Alh95FqMFh9Pl85erBTMeb+YQ6NmaLwOTKQeIy1dv1ln96yQ9H7rkAPbY52MyCMjX1U+2b7Mb6Fj0SQ8UxrJ95p7h0NbeeURdE4HFlPrSeq9npIThyOpE/uTMjr9zUN38jLfNy913Lo6+9zoemt53WsSfXg11nIhs0vKcDJnZJWkglwUuaKhdruXziIiH3Ap/t24IA3yFG7IUIlMwua4CVHawrJ10kAAHIrWj1tUhTe9xabR8rM39ws6ZEo+c9/okfIFdJZus/VPOdg54eLvM+SyULHyJHCa8j+A1B2FE6mHSpuQHkfq4g/phwlo7RxmG1xb6LIq1TzlVcuGHzY5lSy+mur6OnXhw+7QaAc7EG0HrEwpK1RmGQ1aotKy99jxvDs15JOCobTrVnPq1YsUzAqegzrrTkwf7+MKc2oqLpU7J/Kvk5yKTBfa1kqnvpMQMOtNSCc85jsVWIts=
    • smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+yR073kllUGPmGJVUeCRyP+7YyssnxJYWAMllMf0O2mr7dblxz3sQywMcjeQk3geBfPW+IdsDxB8xrxsTWoFxMOkP7YIlqg0EEpraok6BbG1RljBMjSzvcaq9f8SmH/WTwogHUJbLPnCNRIukPKuyKZ815xqsdfNgyKU2n6tzwxP4mSLKgVuUzrUweubT5gs5rebJrpB18B6B6jwl0/poRePE+uW6wZ+L07T8pDRfDgDhXbpAkkpI3kYzsL9r6JR1DuPKlehoslUxrLTnkCdW9uZPc8gRGelzF1tEs1wdwHtki7is3D81ah++A0YwQkHaBU6d0dA0478CTph0MlQEjdAtU7ZgdODs6Pvh42SvFRw4RJzTgxKmjWyQ+hvzJTC7LjtkgR9LM/W1nSWBYp1k1oRDB9fxtJ7SPc2kBc2nyZBTbFGA4k8vffHGKNHW5J32JXwaAdQWJptTewMW2Bi/2u6HcioP5Muc6+6CN4rRw/GODpgvX13C+MLBxzN8QD8=
    • smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDWpx2zFMUXPgh2YpjmBGxEXTRbrkqm3LrumLDH4BxM01aIB7S2JVEs41ZV9dMSCJGObsZ6sG5rTQeiRS3tILleYOzEqdUlHvyHE/bDypl8fn+mK7OOYrxSzvpPgpJnWnVRHdoSW4l/1HXkbYFN653dS5+YbCQ709VBc1Nm7QDpj1x7HfNAPGsOrQFKClbV5G8FTE3yWIM0/XnHnejSeffoeRtAJnvFe5tu6AA/nbMTS//kuE1+nEkOS8/vTxhgZPDbQog6bw14gc7YTTRjqgInEAqZVbaRwkYrZkoNt5qneQ+6bSo01nfwWn2ivyh1SPIPCwRx0/aTneQj9cCMZqobx1zHkEZ/5jQgv5iuW0sfUXlloh6SyatWDRMl+H8MtKCZ/uU12TSX6gzDQnDwKLKdYkkjA3dK7a01DtFVyhT7DPktEtV501j+3J8MPDwk+8UtFiLGYjAi8pWPcvgXwS3boS5v9wAztt7P6KM45DEX834G7o+LTToMQqJtYXgiYk=
    • smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy/oqaydNIhj+gq2P/x+Y9Oy9V9OnYdZzaYMIrivpdE0ukxVE+V8nHL1djxZTIXQNxeKgruXnv7+pmlXIFK+0/58tqoYV8+G//5619YubTt5yymI/DK6m5BIZi+2g3F9K2bru7fROTh6Y4nQjUQ8z0R8wBEpKSo/XaJmvtBEc0CAFz+1K084Z9zUBFjyBPxeSxRRpY/SI+zOaDwHjrd0OigMLYOmIaTDW4sRzvRki2xhphAp2HecpenQaGh2VmoCbjf6k9cGJxEzcGtQtrBuc6sV/bMMhPTDRrNGQINW2Ku3XztwgwSvFFj9PON6QCpJgUgAi9JnP6ZN1m204f02aWormGXo/yrrg6+sjfUYoMfS685s3l6j9tG2ZD5dTPlG1HA/7MduERP15GTpMAaPeJHtttSQkGk1F+uwCt56rSdTaLRBmy3vBLmL//FdAoS0ZkdLvJLju3GDHwQ+0ExNjwWaouMs2455bKxZlYkWvFcHvkCmdBMYceA8riZD9cLSs=
    • smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+f4B9HVrDCwxHPGZG6XPsZedNMAKB+FOKiHhDKIEX6L9n2YKl/spZD02BJ4UkebW10RXzoWSt0rwB0nU7NoEzlCIOZHIqp4lu/rRoCeRefFW3c0PDvnxydGeRlhL07AYNioy0+ESC3E2BdleH95K88z9I432sFBJ+oVTx4zB0k/zCYFQ3JKcXBGU52KKANArEcyH5NmXXwWFWlmHUSzHhw6cuhcy1isSnb0WvEcCnvuLRsMnacYpAo4AFKSqFErPHoAat+cCSAS+UDvrksWbYf9NBtqNPwazthtXQIevVVcpxIrmRPBSt8aS7wEokroYZlN6HiPYbl9sGf+ED8qQaHoCpz8mWTMZMrYRxAqQQBfC5oIUot3T61wTZYOS9aaCNEUuxXkotMU2lgXY/LKVjV+SO9RQQiQKw/antWrT/yzoXRTzBPVMXGc4u1pelSBM+hmLOfdvsDtAzkQ/QbY0jrlRvUbr6p21OwXcifsA2p2HlXMN/SLX0tf674EyeR1M=
    • smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBTpzP3s0QxTT9NrLnO8a03neMaOrl2Ij+wnfhhRFk1k0ALcC2RY9Rt4+4yxbvEjLG0j+NQBVcFbdEcTpTS1Vyd8AJw+4DnMpwWz5RymasrQ33GRgqDbMAoAk5EcM1Nz8wYUu2ovInrQCHcsEdUPEmb6qAXNn/8XZgFJRhsbdd8ZpwQV957tCtEVlqifW2HELyYiTZz97HdIfILX4alXCWLIEpZXyqhowggTOSYS8lFw1kLe99HSN2udolrk32Hwf8iNzgkWEDvFZCodsciCFlEzTRiwOM0jBPD16GQJkIvCBJYnOY+TQQM3CAG3i3RlMV0WJeJCG9OsQDei+W+7BR2aG52QWhsoZ7Vo+1/vsQ/nIH/tFkPXQmj+rj08BibN7E60VmwnI/ADefVzCZ6YlnrnRP44k7diPxthKCb5KtxTtjC6h1sRbUovxpQ2OVZRT3+EncNHaEJ7yKdkL3rud1P3r1nl0wbC2GwG/qKpiK4Q38ayCQnf4XJQFc5VgJr6E=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 6
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • sha1: distro
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
      • sha1: 0f5e2b7c9f23cdcc704a744f5bcfb6592442cdf5
    • ceph:
    • kclient:
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_auto_repair
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-06-16 18:33:39
  • started: 2020-06-17 02:50:32
  • updated: 2020-06-17 05:02:34
  • status_class: success
  • runtime: 2:12:02
  • wait_time: 1:54:02