Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5173633 2020-06-23 15:16:11 2020-06-23 23:12:54 2020-06-23 23:34:53 0:21:59 0:14:11 0:07:48 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2020-06-23T23:28:12.761301+0000 mon.b (mon.0) 320 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log

fail 5173634 2020-06-23 15:16:12 2020-06-23 23:14:28 2020-06-23 23:16:27 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

fail 5173635 2020-06-23 15:16:12 2020-06-23 23:14:45 2020-06-23 23:24:44 0:09:59 0:02:12 0:07:47 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04_podman} fixed-2} 2
Failure Reason:

Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-a54c28d2-b5a8-11ea-a06d-001a4aab830c@mon.a'

pass 5173636 2020-06-23 15:16:13 2020-06-23 23:14:52 2020-06-23 23:42:52 0:28:00 0:20:42 0:07:18 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} 2
fail 5173637 2020-06-23 15:16:14 2020-06-23 23:14:58 2020-06-23 23:16:57 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173638 2020-06-23 15:16:15 2020-06-23 23:16:27 2020-06-24 00:04:27 0:48:00 0:40:30 0:07:30 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
fail 5173639 2020-06-23 15:16:16 2020-06-23 23:16:27 2020-06-23 23:50:27 0:34:00 0:26:25 0:07:35 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
Failure Reason:

"2020-06-23T23:40:18.215017+0000 mds.b (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi150:z (7269), after 302.787 seconds" in cluster log

fail 5173640 2020-06-23 15:16:17 2020-06-23 23:16:28 2020-06-24 02:06:31 2:50:03 2:42:28 0:07:35 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
Failure Reason:

Command failed (workunit test osd/osd-recovery-stats.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-stats.sh'

dead 5173641 2020-06-23 15:16:17 2020-06-23 23:16:36 2020-06-24 11:19:05 12:02:29 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
fail 5173642 2020-06-23 15:16:18 2020-06-23 23:16:52 2020-06-23 23:18:51 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173643 2020-06-23 15:16:19 2020-06-23 23:16:58 2020-06-23 23:34:58 0:18:00 0:12:15 0:05:45 smithi master rhel 8.1 rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5173644 2020-06-23 15:16:20 2020-06-23 23:16:59 2020-06-23 23:42:58 0:25:59 0:19:01 0:06:58 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
dead 5173645 2020-06-23 15:16:21 2020-06-23 23:18:18 2020-06-24 11:20:47 12:02:29 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
pass 5173646 2020-06-23 15:16:21 2020-06-23 23:18:23 2020-06-23 23:54:23 0:36:00 0:29:35 0:06:25 smithi master rhel 8.1 rados/singleton/{all/random-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
pass 5173647 2020-06-23 15:16:22 2020-06-23 23:18:37 2020-06-23 23:44:37 0:26:00 0:18:25 0:07:35 smithi master rhel 8.1 rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
fail 5173648 2020-06-23 15:16:23 2020-06-23 23:18:52 2020-06-23 23:38:51 0:19:59 0:13:52 0:06:07 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

fail 5173649 2020-06-23 15:16:24 2020-06-23 23:18:52 2020-06-23 23:20:51 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173650 2020-06-23 15:16:25 2020-06-23 23:18:52 2020-06-24 00:40:53 1:22:01 1:15:51 0:06:10 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
fail 5173651 2020-06-23 15:16:26 2020-06-23 23:18:52 2020-06-24 00:06:53 0:48:01 0:40:20 0:07:41 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

"2020-06-23T23:30:40.409223+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

fail 5173652 2020-06-23 15:16:26 2020-06-23 23:20:35 2020-06-23 23:22:34 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173653 2020-06-23 15:16:27 2020-06-23 23:20:35 2020-06-23 23:34:35 0:14:00 0:07:20 0:06:40 smithi master centos 8.1 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} 1
fail 5173654 2020-06-23 15:16:28 2020-06-23 23:20:35 2020-06-24 02:46:40 3:26:05 3:20:07 0:05:58 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi141 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

fail 5173655 2020-06-23 15:16:29 2020-06-23 23:20:36 2020-06-24 03:00:41 3:40:05 3:31:26 0:08:39 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
Failure Reason:

"2020-06-24T01:17:35.259834+0000 mon.c (mon.0) 60 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

fail 5173656 2020-06-23 15:16:30 2020-06-23 23:20:42 2020-06-23 23:22:41 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

dead 5173657 2020-06-23 15:16:31 2020-06-23 23:20:44 2020-06-24 11:23:18 12:02:34 11:54:37 0:07:57 smithi master centos 8.1 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=24693)

pass 5173658 2020-06-23 15:16:31 2020-06-23 23:20:52 2020-06-24 00:02:52 0:42:00 0:35:14 0:06:46 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} 1
fail 5173659 2020-06-23 15:16:32 2020-06-23 23:22:15 2020-06-23 23:24:14 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

fail 5173660 2020-06-23 15:16:33 2020-06-23 23:22:15 2020-06-23 23:24:14 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173661 2020-06-23 15:16:34 2020-06-23 23:22:35 2020-06-23 23:40:35 0:18:00 0:10:42 0:07:18 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
pass 5173662 2020-06-23 15:16:35 2020-06-23 23:22:42 2020-06-23 23:40:42 0:18:00 0:11:16 0:06:44 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
fail 5173663 2020-06-23 15:16:36 2020-06-23 23:22:43 2020-06-23 23:24:42 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353

pass 5173664 2020-06-23 15:16:36 2020-06-23 23:23:51 2020-06-23 23:37:50 0:13:59 0:08:18 0:05:41 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} 1
fail 5173665 2020-06-23 15:16:37 2020-06-23 23:24:15 2020-06-23 23:26:14 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1353