Pulpito

yuriw-2020-08-18_16:58:37-kcephfs-wip-yuri2-testing-2020-08-18-1403-octopus-distro-basic-smithi/5357588

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2020-08-18 16:59:38 2020-08-18 22:56:58 2020-08-19 04:01:06 5:04:08 0:32:11 4:31:57 smithi master rhel 8.1 6 pass

Description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover}

Log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-08-18_16:58:37-kcephfs-wip-yuri2-testing-2020-08-18-1403-octopus-distro-basic-smithi/5357588/teuthology.log

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/yuriw-2020-08-18_16:58:37-kcephfs-wip-yuri2-testing-2020-08-18-1403-octopus-distro-basic-smithi/5357588/teuthology.log
  • archive_path: /home/teuthworker/archive/yuriw-2020-08-18_16:58:37-kcephfs-wip-yuri2-testing-2020-08-18-1403-octopus-distro-basic-smithi/5357588
  • description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/failover}
  • duration: 0:32:11
  • email: ceph-qa@ceph.io
  • failure_reason:
  • flavor: basic
  • job_id: 5357588
  • kernel:
    • client:
      • sha1: distro
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: yuriw-2020-08-18_16:58:37-kcephfs-wip-yuri2-testing-2020-08-18-1403-octopus-distro-basic-smithi
  • nuke_on_error: True
  • os_type: rhel
  • os_version: 8.1
  • overrides:
    • ceph-deploy:
      • fs: xfs
      • filestore: True
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
        • osd:
          • osd sloppy crc: True
          • osd objectstore: filestore
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • sha1: 3ba206ad6320b733ad8b02cf9270e94d5e3a0d6f
      • branch: wip-yuri2-testing-2020-08-18-1403-octopus
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
        • Replacing daemon mds
        • \(MDS_INSUFFICIENT_STANDBY\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
      • fs: xfs
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • debug ms: 20
          • debug journal: 20
          • debug osd: 25
          • osd objectstore: filestore
          • osd sloppy crc: True
          • debug filestore: 20
          • osd shutdown pgref assert: True
          • osd op complaint time: 180
      • sha1: 4b6fd93b7ccc54e72f3503a183be5bc60c76a4fa
    • install:
      • ceph:
        • sha1: 4b6fd93b7ccc54e72f3503a183be5bc60c76a4fa
    • admin_socket:
      • branch: wip-yuri2-testing-2020-08-18-1403-octopus
  • owner: scheduled_yuriw@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
    • ['client.2']
    • ['client.3']
  • sentry_event:
  • status: pass
  • success: True
  • branch: wip-yuri2-testing-2020-08-18-1403-octopus
  • seed:
  • sha1: 4b6fd93b7ccc54e72f3503a183be5bc60c76a4fa
  • subset:
  • suite:
  • suite_branch: wip-yuri2-testing-2020-08-18-1403-octopus
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: 3ba206ad6320b733ad8b02cf9270e94d5e3a0d6f
  • targets:
    • smithi047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkEV2OWThn4FDXAAAqSjvz8G3GsHzg6Nljli3gQ/6QYoiu42tbfq5eV8Rwrecx2jBOIHR1XO3n24ohUBhtCfwo1Q96FpevDrstMJhvCdtUaO4zEsJedgNunYSM8p7yuzq618dwuhSXzO5vIC3GxXb5VMFE2Rqd6l8lqCy9sFRr6i7hHFIVgSf2U3FJbacKBwwmU6OOoyjE1OxXcoqvpjX3P5fdlViWzTDEjx5OtU4lYNZ3oDERcbyqFa9NcynS9jr/n2s0R9JeyFKQwK2QdooE+TNc5twQtj9K6AZh9dVpe8eN0lYNjU6TFF2q+7Gi6l+1RBoAyYkQT4Q+BfaXvxZHJCzcyVi0jB7XMw5r45GiDiAjD8ibRxz95lpT2f4REwtduChZR6DfwGjiz6Moz8fzdkFX3kMSF2a36pxIbgR1ozBotQ83Z9jw6bIEww+zOgTJpeEXanzgEXXOu1T9VI+5wp9m9B7zWa2o/xi0IQKA3xYyTqQIxhtbJ56NI/2fz48=
    • smithi203.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/8RIg5MsGX1kbVNATPq3D+diWKpZJknjSsghj/6ph0+RKD1zGf7YXYjUfRtUaXWugb7JJ6Y5CFKDi17XWLTWQbs+H8m3Fy+khSi8PO5eapDTTirjjFwiXDod6Vql9RsHOE6sDbax1ZSR4er9mv+YMGSn6Ji0Xp0oPF/REkE2in/cwhyU5muUmV7D2uqmegpcNJuN8XNGd/ay1cloDG/TFkfByXiroUjWq4PQF/TqYncpseg0X17sU7IBQJ+UpJDko7Nj5QqnBNQRKh4PhfpZPlVhvLG1JJPOoRsf/KE6RWWVYxPspBSQyzn3dfm2M1bce/YcwCoUQXHNc+j/jTpJvXKWna4nCizO0HjCCoiDW419ywMjl6aL2Yn0EWdmkBAO1HLhAxaimfoNhrH29y0psHjGnu+fce+hr5aJ2rBqSRtl4jPWrbhJjecRKY6kfZ6U1kd9xV6ErF2yw+YXfT1CGJriixtGZnCc6lc5Iui61kfW+hjgSg/uOSj4hGDCfqs=
    • smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5Eww/tRybwcBquoO9iA5Hf5SEYcAPPyJedAe8soq4qBwlCWRS0jdhIfO9xqj7OsO5yzThf8SIArXj183n23HYqhQkU10hEF/L1lJtpLIOlAdCBFFrWnvXk1RY3NhmabGCW4kL1xHReEVLz3PpcdXALl3llqoGzuxi8BvC4iV+fHV1RDhdp/JRjo6/Nq0pXm48FQbu+ucph7Ban3xOGnLmSDTJdOyosnh+Q4hSKDLU42TNEE79GEMR1WBteX/qzEbcpJBZL6hDBjRxjdw7LcbtW9e7ZeWn8+UPV3EGxsr9FjE5+FLHLrIvnAKqIrCqtM0fYEWCGxO2BjZWZxEMmoI7suiY22kgFMxO7Yvb+r4phevEGi1y1kpQikXQq1rBagKg4uHfGXjqNglSN1s8BszENXihn8M7nLKdaOOOpFBNyFnY/y5T7VNbAGkDKILrEC2ocrXXct8hBKnWv8gqHwKcpV0kLfqwRCc9mB4b+5D9V6vi8AqEvTu/aYf3QmhOhTs=
    • smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAoKzSiY+9qeXQXw72P22mrEWHaXOFxb41SGfvZmYsZxUYc6CVHvItmGEX9ojwCrZTAsrNaDbMcJBz5s5AxPzJq865Sjl7YIGxL+f7UDCj8yLHkhnOhLXcq+vqYbDoMawfvHrhUvIkTQDVoQuyJr9hSzkomTMrVb4KIMf2KmiNY/3PSEmwrFS2ppR6S901vgg3nH/IlHj4ueu/e+zW6f6SUhlAWm2LgAIrwUAGVoeM+hM69j8dXAYQYkOH54j3WhV7Ix6ZpdPzWhTJdS72UszE/CHB3HzfBX9pL0plYUaNCM/PXjZyBEPHcDrW6Ccja1WkKr03ontXiqSzUZVX+3pVNnFq+4PSaIdrGl6jSbDFGsbLd1MHD3fysnPv6w7iN4tedVodNcReu6Aq6Mh5r435WN/r1aXmLPq0v+VNlr3NoA7KNLj8KJgg7+T1bc22b0AFM1UhJlq8x8OLlSx1Ao6pwkZCSnrob5yuTKHQsTf9RU5jHRv31nfyiggm7WXphL8=
    • smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9+VR+nufBrXZvh7ciIkOfXmc1MrQ9iSGCIZMfYhEYB/BAWVJ1vQOOswspZDVmxBDkS2sfZIOrCV8b9VO9zNE83WhW/jp8WUnq3CsHLeZG8EZQ3W3DDqEjlhHhRSOHVKxTbKbxdu8PHu7K1QeXX9UHGzFUk+rDppNnBX6Fk8K46ddMij2uclqzrfaPTdIqUE3FIe9NCvernKbNqyReucJlLvHKQ4kI8IP6qYgHZp6RJYl7Fz+fc2++YE7mThQqUEFAya7FvfXEESi92hNpWI0oDBGFRBnA7EcgQXPnYMB9H0v1swHPn3Kmte+fgv38ryJ1f7on2DIeWl48/ZJPpmx4wg9Zue8/R3Fi+o9MwHnlLmgse5hPFa5YDKyNC5d9NxVm4odDEd9ye1q7XmmQlzPYWnQ3LCrDfTdbDJVQX5rm4hQnn2vsyw3xTaMV+1mRXQQP1RmFUw9S05Zv3CX/Iqb4UlDin5ri1AAfAGjkDax9C2I99qHXCjljnyoYcof32VM=
    • smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT3jU8TyO6/bUPEaKr3FgYW2Nr+leaTtGF2xcySFs284ynGra2VVPHnnNwq4pHjf2cQlygfL4atAyIEIM6ppr1sacCd3/vcVI0fcnsHGEun6sZkooo0m2v1WDUvOmyqHazHFzk0WFQB792Id5hHEUroFq9ZES5vS3FKfUqCZgFMVJQ7PBx7JjHCoSuRw44R/q9wiZyEY1Re46IxpzUgcnoG+hF5kJWroUD8ZeLFZt5kq8qFnLDyXgC3vBq46ft4LnbgOKKr1EeSqaTueEScUOtiwgTQhaXZKTTCvvQts50Keoh55w2nojD/SnnW3/fR5Zm4c5u/Eyf9WfV0x9VFnaVcidqxfznafcraeXCViXtUoN8aB/zk6rF89g08FAl2k5ITdwVQ2iAhFNm4tiJa4ruccOuftsSrkqAb9pv0z+WGgsu1B6JWsY4PS6s4OVaZWRQ9LKj+SWGfLtT7ytTsmVr8otV2XLIk1/tvIfX/rG+VbANLzacNwl1e+1U2m6zpu8=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 6
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • sha1: distro
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
      • sha1: 4b6fd93b7ccc54e72f3503a183be5bc60c76a4fa
    • ceph:
    • kclient:
    • exec:
      • mon.a:
        • ceph config set mgr mgr/crash/warn_recent_interval 0
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_failover
      • fail_on_skip: False
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-08-18 16:59:38
  • started: 2020-08-18 22:56:58
  • updated: 2020-08-19 04:01:06
  • status_class: success
  • runtime: 5:04:08
  • wait_time: 4:31:57