Pulpito

teuthology-2021-05-11_04:17:02-fs-pacific-distro-basic-smithi/6108622

Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Nodes Status
2021-05-11 04:20:11 2021-05-11 05:54:35 2021-05-11 06:06:43 0:12:08 smithi master ubuntu 20.04 4 fail

Description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}

Log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-11_04:17:02-fs-pacific-distro-basic-smithi/6108622/teuthology.log

Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bfaa7eb8631e41fc8938c58d4f5d49a7

Failure Reason:

Command failed on smithi072 with status 100: 'sudo apt-get update'

All Details...

  • log_href: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-11_04:17:02-fs-pacific-distro-basic-smithi/6108622/teuthology.log
  • archive_path: /home/teuthworker/archive/teuthology-2021-05-11_04:17:02-fs-pacific-distro-basic-smithi/6108622
  • description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
  • duration:
  • email: ceph-qa@ceph.io
  • failure_reason: Command failed on smithi072 with status 100: 'sudo apt-get update'
  • flavor:
  • job_id: 6108622
  • kernel:
    • sha1: distro
    • kdb: True
  • last_in_suite: False
  • machine_type: smithi
  • name: teuthology-2021-05-11_04:17:02-fs-pacific-distro-basic-smithi
  • nuke_on_error: True
  • os_type: ubuntu
  • os_version: 20.04
  • overrides:
    • ceph-deploy:
      • fs: xfs
      • conf:
        • client:
          • log file: /var/log/ceph/ceph-$name.$pid.log
        • mon:
          • osd default pool size: 2
        • osd:
          • mon osd full ratio: 0.9
          • mon osd backfillfull_ratio: 0.85
          • bluestore fsck on mount: True
          • mon osd nearfull ratio: 0.8
          • debug bluestore: 1/20
          • debug bluefs: 1/20
          • osd objectstore: bluestore
          • bluestore block size: 96636764160
          • debug rocksdb: 4/10
          • bdev enable discard: True
          • osd failsafe full ratio: 0.95
          • bdev async discard: True
      • bluestore: True
    • workunit:
      • sha1: d217eade5ef4b82ba8bc601cabfeb8d8fa37972d
      • branch: pacific
    • ceph:
      • log-whitelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
      • sha1: df487331eefb15b716b05118803c8aa8f9ad6ffb
      • fs: xfs
      • conf:
        • mds:
          • mds bal split bits: 3
          • mds bal split size: 100
          • osd op complaint time: 180
          • debug mds: 20
          • mds bal merge size: 5
          • debug ms: 1
          • mds bal frag: True
          • mds verify scatter: True
          • mds bal fragment size max: 10000
          • mds op complaint time: 180
          • rados mon op timeout: 15m
          • rados osd op timeout: 15m
          • mds debug scatterstat: True
          • mds debug frag: True
        • client:
          • rados osd op timeout: 15m
          • debug ms: 1
          • rados mon op timeout: 15m
          • debug client: 20
          • client mount timeout: 600
        • osd:
          • mon osd full ratio: 0.9
          • bluestore allocator: bitmap
          • bluestore fsck on mount: True
          • debug osd: 20
          • osd op complaint time: 180
          • debug bluestore: 1/20
          • debug bluefs: 1/20
          • osd objectstore: bluestore
          • debug ms: 1
          • mon osd nearfull ratio: 0.8
          • osd failsafe full ratio: 0.95
          • bluestore block size: 96636764160
          • debug rocksdb: 4/10
          • bdev enable discard: True
          • mon osd backfillfull_ratio: 0.85
          • bdev async discard: True
        • mon:
          • debug paxos: 20
          • debug mon: 20
          • debug ms: 1
          • mon op complaint time: 120
        • mgr:
          • debug ms: 1
          • debug mgr: 20
      • log-ignorelist:
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • overall HEALTH_
        • \(FS_DEGRADED\)
        • \(MDS_FAILED\)
        • \(MDS_DEGRADED\)
        • \(FS_WITH_FAILED_MDS\)
        • \(MDS_DAMAGE\)
        • \(MDS_ALL_DOWN\)
        • \(MDS_UP_LESS_THAN_MAX\)
        • \(FS_INLINE_DATA_DEPRECATED\)
        • overall HEALTH_
        • \(OSD_DOWN\)
        • \(OSD_
        • but it is still running
        • is not responding
    • install:
      • ceph:
        • sha1: df487331eefb15b716b05118803c8aa8f9ad6ffb
    • admin_socket:
      • branch: pacific
    • thrashosds:
      • bdev_inject_crash_probability: 0.5
      • bdev_inject_crash: 2
  • owner: scheduled_teuthology@teuthology
  • pid:
  • roles:
    • ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3']
    • ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
    • ['client.0']
    • ['client.1']
  • sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bfaa7eb8631e41fc8938c58d4f5d49a7
  • status: fail
  • success: False
  • branch: pacific
  • seed:
  • sha1: df487331eefb15b716b05118803c8aa8f9ad6ffb
  • subset:
  • suite:
  • suite_branch: pacific
  • suite_path:
  • suite_relpath:
  • suite_repo:
  • suite_sha1: d217eade5ef4b82ba8bc601cabfeb8d8fa37972d
  • targets:
    • smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfVPHLJ8W3jnWu97xNggGt1YcgaIi+Yxx/Nwbey/8KSLI7zuXhykvNp8n4i+xyo/uyjzHtMmGX6XaiYEJHTeYUzhhffe60EK1WZ6PoYzQ3uKKYsRNme7OyMV4GiT8jUEW6eNhZoLHZjH/Hb75M5fasPiKOzeQ9LJFx4IhDU3C3PH/2z4b8VdniMwnCQjvWAjWAL4vLyn0KitzDgmO+ddrOAzeM54SjPX5Dt4Kx1oMr2csueWvl3mmqKmXT09fBkKTgA8QNAztc8EwvpoSq6SpSpyIOuWF+f+BabRyHIHdYi8U63mInq/w8l6NRMXxsG3gLUmYwJuwra1D+wWSGKiO/JNoFmjnrn6TOZfKrV3CJziF3axgG5XRcDG6uEF7wmgXnhjV65JOc9zAKxMvzmTKJRCUK1uVyizLiNuBEmmL0B8b1cj6NzSU1xdFHs2SNAoy5Dh74IbYLmDVBFzB/irb35DzfFp+6oyol2mYWKJCrNTLQRWBORCvVO+cSynaK9ZE=
    • smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkrktkBaKxyKBdvlWpa02KmXdjqwUe26xYABy6QD9zoz28NWwOJ6L8xhbq7vW+wREp0FSBEZqJBm53VYyBufDL1iFfYvZF4P1+j/r+VYUTAzQbdY+2kbDIZReTVxxsCUK57JTEC3xxvMPq+cL8jt0ECCfg3yLLh8snEPSy0J0GkpQwKcY4/C5hOxMEcGt6FgkfTjuR9wUNBkJfOQdPungZQy+QVMfewhAwoN0rnuTnX/Bg2u9rrp9e2X/9wv70+il6IZ4LtwkY+ODKtRVlDIFUoKVMJG3vwmH1C1WkiD73KXYV8MtkCDiCZ51C/yVo1Bn8Fa31KTZNkX8B+zny3PqhGSjeS956L75oLrolMruXon93WHY2PdGBK75gV4cmEHjHKnwOkV1n1EwSf2WfK7xZCyv1EnJa1NMvAkBnUvOCpmb4dS46fkeuZGopp8l5Q5TomRajofFEcUrWJT2N58vZMom93/Tn7XVjV/7Y6ezcYcFFvIV/Pm3qJALE4CZYod8=
    • smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQs7XY3VMFlgNadYIVvak2RXPXLsSSHeSMQGIb/FXIYLhcrE5aWNmzzVejhwn4F2MafWEkX9grdneOfvXwzxTMCGyWYXQ29SkKpIVe2ZJPp9drM1gx+sb4cW/bz05Nrf0YriCaHRnVPaMx5YQz3Kqr5bbuooP2dawwsbqti9L0JQ84VvOjsoquM2u1Si85P64VbolS28uzNXDyhu4Xf4EhCLJK8ti+22I9GaBjUp6HZ3ZAX+/uMgj5LmzGN5lk1J9cnz8HYiueflKODBKBKIWLwRFjAWLnCchb7krGr3Bktj9WoNeUlaQlXe1OG78xz1JJL9a7asEH3V8rFysaOCDNbqgMl4rQY9ARSf2jJcswL+PFWN2isIh3QpjXg6qwSwI5MYaKqelVkHH1xpjDfxHmupsGGm3knf/8EbBgUpMFhU46W7JoEuTKxbGUyqcIb0HRtb6TUaZ8bMIflB0v1EFwTs3ygIr8ExHUqfmJZ6XTHb+3A497+fXr/T3YnulU4R0=
    • smithi175.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrW+cabQ9ho0nXhUAU5YoRRpnAnKyEDaCrV8Fh7n3o+c/kM+41pDTn8Awz6AXGZErjcB3T0Yx68Dt+63BSQOg16mUbT+J/VYpCQaAAbFSTvHeR87WsC19judmoX1IOBxs2WGbmhpPEuK6t6DbDrKMU4c0Cy1y072CbytYHoxnKCUWmKcdb5mUWZflOgLnkGHpDnP0n3QMFmskM2UXWzhQqatkSloiQreIEvq9tX/lcBcPImL9rVxH7uJ/YpiVSVHSjruXy/znj8uDD+co8Xek/RQmDnXD9oE8QaW1fXgB0lDg4rZxSxbB28WAj/4tqLC25QiVmatpcFyCB74BLd5SuzsE3S6zj+F8QVqbUKUQTvb7Ok8Ac3CzTTvMbQ/oTqTG5nB880GVo6c/uWfNiVaINccgSj95G1iSWsNkLH8NunG7pTtNp6xEmz06Bk1ugP40esqQONVC7k6wNXJjw96+zNTyIy8ebXKCt/jC4ZHyq3MG61WNGCtPMLqMblzr6sJ8=
  • tasks:
    • internal.check_packages:
    • internal.buildpackages_prep:
    • internal.save_config:
    • internal.check_lock:
    • internal.add_remotes:
    • console_log:
    • internal.connect:
    • internal.push_inventory:
    • internal.serialize_remote_roles:
    • internal.check_conflict:
    • internal.check_ceph_data:
    • internal.vm_setup:
    • kernel:
      • sha1: distro
      • kdb: True
    • internal.base:
    • internal.archive_upload:
    • internal.archive:
    • internal.coredump:
    • internal.sudo:
    • internal.syslog:
    • internal.timer:
    • pcp:
    • selinux:
    • ansible.cephlab:
    • clock:
    • install:
      • extra_system_packages:
        • deb:
          • bison
          • flex
          • libelf-dev
          • libssl-dev
          • network-manager
          • iproute2
          • util-linux
          • dump
          • indent
          • libaio-dev
          • libtool-bin
          • uuid-dev
          • xfslibs-dev
        • rpm:
          • bison
          • flex
          • elfutils-libelf-devel
          • openssl-devel
          • NetworkManager
          • iproute
          • util-linux
          • libacl-devel
          • libaio-devel
          • libattr-devel
          • libtool
          • libuuid-devel
          • xfsdump
          • xfsprogs
          • xfsprogs-devel
          • libaio-devel
          • libtool
          • libuuid-devel
          • xfsprogs-devel
      • extra_packages:
        • deb:
          • python3-cephfs
          • cephfs-shell
          • cephfs-top
          • cephfs-mirror
        • rpm:
          • python3-cephfs
          • cephfs-top
          • cephfs-mirror
    • ceph:
    • ceph-fuse:
    • pexec:
      • clients:
        • cd $TESTDIR
        • wget http://download.ceph.com/qa/ior.tbz2
        • tar xvfj ior.tbz2
        • cd ior
        • ./configure
        • make
        • make install DESTDIR=$TESTDIR/binary/
        • cd $TESTDIR/
        • rm ior.tbz2
        • rm -r ior
        • ln -s $TESTDIR/mnt.* $TESTDIR/gmnt
    • ssh_keys:
    • mpi:
      • exec: $TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile
    • pexec:
      • clients:
        • rm -f $TESTDIR/gmnt/ior.testfile
        • rm -f $TESTDIR/gmnt
        • rm -rf $TESTDIR/binary
  • teuthology_branch: master
  • verbose: True
  • pcp_grafana_url:
  • priority:
  • user:
  • queue:
  • posted: 2021-05-11 04:20:11
  • started: 2021-05-11 05:54:35
  • updated: 2021-05-11 06:06:43
  • status_class: danger
  • runtime: 0:12:08