Pulpito

pdonnell-2020-07-30_21:17:25-kcephfs-wip-pdonnell-testing-20200730.193838-distro-basic-smithi/5271549

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2020-07-30 21:17:50 2020-07-31 11:29:30 2020-07-31 18:03:39 6:34:09 0:05:56 6:28:13 smithi master centos 8.1 6 fail

Description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}

Log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-30_21:17:25-kcephfs-wip-pdonnell-testing-20200730.193838-distro-basic-smithi/5271549/teuthology.log

Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=bfc2232cca354f01b852031b7e2fee60

Failure Reason:

Command failed on smithi109 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-30_21:17:25-kcephfs-wip-pdonnell-testing-20200730.193838-distro-basic-smithi/5271549/teuthology.log
  • archive_path: /home/teuthworker/archive/pdonnell-2020-07-30_21:17:25-kcephfs-wip-pdonnell-testing-20200730.193838-distro-basic-smithi/5271549
  • description: kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
  • duration: 0:05:56
  • email: pdonnell@redhat.com
  • failure_reason: Command failed on smithi109 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
  • flavor: basic
  • job_id: 5271549
  • kernel:
    • client:
      • branch: testing
    • kdb: True
    • sha1: distro
  • last_in_suite: False
  • machine_type: smithi
  • name: pdonnell-2020-07-30_21:17:25-kcephfs-wip-pdonnell-testing-20200730.193838-distro-basic-smithi
  • nuke_on_error: True
  • os_type: centos
  • os_version: 8.1
  • overrides:
    • ceph-deploy:
      • fs: xfs
      • filestore: True
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
        • osd:
          • osd sloppy crc: True
          • osd objectstore: filestore
    • selinux:
      • whitelist:
        • scontext=system_u:system_r:logrotate_t:s0
    • workunit:
      • sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
      • branch: wip-pdonnell-testing-20200730.193838
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
        • MON_DOWN
      • fs: xfs
      • conf:
        • global:
          • ms die on skipped message: False
        • mgr:
          • debug ms: 1
          • debug mgr: 20
        • client:
          • debug ms: 1
          • debug client: 20
          • client mount timeout: 600
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • mds debug scatterstat: True
          • mds debug frag: True
        • osd:
          • debug ms: 20
          • debug journal: 20
          • debug osd: 25
          • osd objectstore: filestore
          • osd sloppy crc: True
          • debug filestore: 20
          • osd shutdown pgref assert: True
          • osd op complaint time: 180
      • sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
    • install:
      • ceph:
        • sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
    • admin_socket:
      • branch: wip-pdonnell-testing-20200730.193838
  • owner: scheduled_pdonnell@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.c', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
    • ['client.2']
    • ['client.3']
  • sentry_event: http://sentry.ceph.com/sepia/teuthology/?q=bfc2232cca354f01b852031b7e2fee60
  • status: fail
  • success: False
  • branch: wip-pdonnell-testing-20200730.193838
  • seed:
  • sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
  • subset:
  • suite:
  • suite_branch: wip-pdonnell-testing-20200730.193838
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
  • targets:
    • smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDF1gF9QqgqAdUU20WEeto4ftR/BjAClf6KWf9imGGmHGngPkJ7Ng03tEi/S4pXlA3gShfInJgrxcq6URVbfPTZhxh1SZXyqhGlxNnLgnIf9BEv4SNfY1VKmvUR4m1g8VcE/4kXxQd48GenPdMlWhRcUa24HMCl60Vw+HJWSjXcg1NLdzlf3DhG8Ht2iHZYWpp6W6ICg0l2rou1dDmnCCUJ6FLMG7zMnBKx7rM0ynK2dU0PqSrDbhcmpbwXzuyiJCEaakMWsPxmC0XBZPQ+dEt6MaM8/rUIbs31WjJY7E/NerAgER5yDBsHZUhV5xbC7SDaA+F191puTPCX+xcSXsRESFGnOClDjS3K1RU8lVxgNawqz9Orw6cQPaJzzr0bm4fBQA9qZ3xKZTVBch6natp50W26z0RZ06es77M4WrssWAtiMxsZdiPxtMkbrNpcYDX5g87rFgNWK+u8AfSdKL6LGxz1Mq6/1k92NLRyu5TcyqzjKfJ/EX0zt30/vOWVrYs=
    • smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8cmq2SpM1QQLS2jGlxnJxWhYQxmYss5La1K/ws3CK/sZFf1WFx4GphVPIEA4XwNZA2HmDokmi98gvQ55WUHyU1LXkqrgUtA2J6ElFv17wp8YpWu7pUDgnWFwOSJ/9KskBZ9KtJ/bYtYV7ZoWF7mNynWI+oqfbFHKeWrdrWyhf2RqUoVo6pvRpvMndCeKm5/xPB/bwkEK15pjImQxwsiGB3v5n/cxCvHyc3G9Pc1bIOQGgVsoVT5dMLKbPsmJdflqx+V7ZoZZb7ymt5prMFdiX2aBDveN8ZlCkzy5P9XXfxUSFGxIw+liUTKLr/1DaIurq+E00Bl0/v1wQkHbnKmpirytJaR8N8HZp5ySw+InrQ5U5HPp0o/PO6YOkLJZP1rA3QlLqB6Dtp18I8gEAUx0srqhCZfmjlsROekw+tH1EHNL8Os3cpSgkrpVNmOGjTVHIqQPuRX/HuRdYqP2NI/Kgd1U+lngrznpY4apwYySePq7pJIfkW0keotzVO6+lRYc=
    • smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1LQwxzfd21gdbzj88HpWz564m7hQ1uJXs6tbliRVolB8nHeszivLL0z2XwqBikxeyGlmQfNKmcLLn5sNCXdUPJwwagHkd86/y8hHdYGk7LoKfnYaxY5f905oO2UmaXreJ6y36bF8ykhHmCV6JZbV7jH9IW0vi0tj15DVxeW6AaTj6y9A2+tgh0xnOU/8yGGOhYtzK1e/gRLr9ck+UKfJd7EnZyRrsBf7wtxXrQT4D1J0rYRoNELYemQLkUtc0vr8xzKLMDcj44axx5vvx6cJrfmYDLNYLYF1Ym9lam36il+Rm7oQfi4TKbpEN/IqE1+j5bHU7II7YwciAgE7zgCdg33P8L46HGsUNTHiVhgc3zW5usGDEIUNhFEd4+0HN+v/qfxCVmMcnEu9irgEz459WSxkusbu4LGfdJizgfmXBy6QW8HuEbxzVxDFGhh/Qo3gCxgDA4EjMOgmxR/qviHaSGVxOj1MpCEFMJUigpGC5p2yw7PDQKl/PLif4qKDHzhk=
    • smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaASFaEpdMWXhEdPCNOwa9AFRWETZSxoW/RupCFwr1jlxm4ZOPTzi7DeoALX0QT5I9nh5EUFBosyUpU8Tp7ebBqBg12vme5cvBpubXVFEesxtbc7ECSl5YJIPDfh6/58ZHMK4RqW0dBuhiUuwHYKqLuRqFH/bg6vUAFgBmLFUKqg83UUYV2opYJBsRw96FhYqdZb8NS1AqEwPl3gKEw2/oUUneHOdc6UlgPZNzLDwKGN7ShlhhzcBtAPsak68GKmLRtF6FlGPF+Rm2TSJir/90y+wu3+3a78yHMnM8i4A4R4e6333u5/hoC3q1CxDs3Y4EuapIZvKb1sFVkWvUI9F89xA1bRYE96Ijg5iHnt2XJgR+AeoIKeI69Fpt0fSlOY/1qTdSXPhJ07zdqEdnDbut57AC6fmQP8fnl/zzN//iqZii+cMbOynzVCdjUtN4+DMzLcCOgIVrSLh3qOjFXJbrAWiCcSfQQunZEJ9XZnZuVh2HpjFQlyXUYgu5BJJ3EnM=
    • smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYhpwvFgmguXVDdP/hTvARc7nAayN5QeUt+zDOcW9GPK3J+i4QPezUlHfbTVDFAtZoezTYNVD7c0PtPGle6Y3w72gvWwchFckYG+kcBmMdKMhPAjuvXAg88DEBCygX8B+SXQ9c6l+GKnBbHtoOnqZTHqOaTWaI0wCm1KMl8Hm8nuHn25rK2c8z84SEpc3PECTBdclQwHzUo1PbI7PIDf6gVrNUjYYilIinHKI+cBf7Nj6QeRfyMXB511qn/5vAnbOceIEvowJ2SaDeCxpL3VxPshhyFndMvwfJxgJ6DSrdmnF4clfKAk0ZrVLg+zMOs9fsht4b4LEp0t+dhABYu1vMd1il0zsjrrZRexfRChj/J4t8Bhn+5epnB9g3wp391O2GNUOUWzle6eMWwAIKcjaCF80ADBytQPuJNHi4+2Ai1tD3HyIUI57MlD4W0aJY+G56mc67DxWMoJUKXVdi2/4K6qOR3LYGP/CGdHO24miEY1+ssj5PEN7qUAlNMQqVPtk=
    • smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSXs6MwoVy6kIIPMZo5cwjvGU9bhu4gSqTKjfyxh5PhRt1LRytW/iGWFKKQt2TmZvsRrTmnzFHo6EY9St4cxCll2PTUpGbMRXBY4keXWhCUmrBSn0LybRxJZ3BWQ5mFvGE4NI90ifiMXDISrFXpHbKwYIOf5SakD6cxDWrysCyUbG31ysA70pDgY5y+QEKHvEwab4pp++fb0lQNvnbV6wwIT3m9yL7hoctxH1rZLnBeUxAEiFM0y+ygUjFv3MAHGHPFlyfhwM/Gia6DAv46Sa8A0XpKF8Tn0BerKwWX+fgRs3K6AHoQS+uCDvwuMw30E0ILoxx8BJjKwUJbwIvC/sccGpuBr0jokXVM5jejGTlT7M//fXcVEnn24Qouc9Sezv/fGgUSWYWQ2xIUPxHOGoX0uBqfMw2/MxRjQFumf8Qa/nSdzcdgQ7cHcznuja4UuPaHfE5Mx0zmxeS6qjrXgqJC5rsh8C78f+mbQw89oV/Sv8zujNe39NLSUzzARniuZk=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.lock_machines:
      • 6
      • smithi
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • client:
        • branch: testing
      • kdb: True
      • sha1: distro
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • network-manager
          • iproute2
          • util-linux
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • NetworkManager
          • iproute
          • util-linux
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
        • rpm:
          • python3-cephfs
      • sha1: d9d8749ee795b82c178953ec4b7f8c0e21c52f9c
    • ceph:
    • kclient:
    • cephfs_test_runner:
      • modules:
        • tasks.cephfs.test_volume_client
      • fail_on_skip: False
  • teuthology_branch: master
  • verbose: False
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2020-07-30 21:17:50
  • started: 2020-07-31 11:29:30
  • updated: 2020-07-31 18:03:39
  • status_class: danger
  • runtime: 6:34:09
  • wait_time: 6:28:13