Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5171923 2020-06-23 07:50:05 2020-06-23 07:52:08 2020-06-23 08:06:07 0:13:59 0:07:56 0:06:03 smithi master centos 8.1 rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5171924 2020-06-23 07:50:05 2020-06-23 07:53:53 2020-06-23 08:21:53 0:28:00 0:14:18 0:13:42 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 5171925 2020-06-23 07:50:06 2020-06-23 07:53:53 2020-06-23 08:23:53 0:30:00 0:14:14 0:15:46 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2020-06-23T08:17:39.452927+0000 mon.b (mon.0) 386 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 5171926 2020-06-23 07:50:07 2020-06-23 07:53:53 2020-06-23 08:09:52 0:15:59 0:10:10 0:05:49 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5171927 2020-06-23 07:50:08 2020-06-23 07:53:53 2020-06-23 08:11:52 0:17:59 0:07:49 0:10:10 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} 2
pass 5171928 2020-06-23 07:50:09 2020-06-23 07:53:55 2020-06-23 08:11:54 0:17:59 0:10:53 0:07:06 smithi master ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
pass 5171929 2020-06-23 07:50:10 2020-06-23 07:54:07 2020-06-23 08:26:07 0:32:00 0:24:21 0:07:39 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5171930 2020-06-23 07:50:11 2020-06-23 07:55:40 2020-06-23 08:09:39 0:13:59 0:08:25 0:05:34 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5171931 2020-06-23 07:50:12 2020-06-23 07:55:40 2020-06-23 08:17:39 0:21:59 0:13:21 0:08:38 smithi master rhel 8.1 rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
pass 5171932 2020-06-23 07:50:13 2020-06-23 07:58:05 2020-06-23 08:18:04 0:19:59 0:09:08 0:10:51 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5171933 2020-06-23 07:50:13 2020-06-23 07:58:05 2020-06-23 08:32:05 0:34:00 0:15:11 0:18:49 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} 2
pass 5171934 2020-06-23 07:50:14 2020-06-23 07:58:05 2020-06-23 08:38:05 0:40:00 0:20:25 0:19:35 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} 2
pass 5171935 2020-06-23 07:50:15 2020-06-23 07:58:05 2020-06-23 08:42:05 0:44:00 0:24:46 0:19:14 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5171936 2020-06-23 07:50:16 2020-06-23 07:58:09 2020-06-23 08:18:08 0:19:59 0:11:18 0:08:41 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 5171937 2020-06-23 07:50:17 2020-06-23 08:00:09 2020-06-23 08:22:08 0:21:59 0:11:55 0:10:04 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
fail 5171938 2020-06-23 07:50:18 2020-06-23 08:00:09 2020-06-23 08:02:08 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5171939 2020-06-23 07:50:18 2020-06-23 08:02:15 2020-06-23 08:20:15 0:18:00 0:08:22 0:09:38 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} 1
pass 5171940 2020-06-23 07:50:19 2020-06-23 08:02:15 2020-06-23 08:22:15 0:20:00 0:12:26 0:07:34 smithi master centos 8.1 rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5171941 2020-06-23 07:50:20 2020-06-23 08:03:58 2020-06-23 08:27:58 0:24:00 0:10:48 0:13:12 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5171942 2020-06-23 07:50:21 2020-06-23 08:05:31 2020-06-23 08:43:31 0:38:00 0:32:09 0:05:51 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5171943 2020-06-23 07:50:22 2020-06-23 08:05:32 2020-06-23 08:35:32 0:30:00 0:23:45 0:06:15 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5171944 2020-06-23 07:50:23 2020-06-23 08:05:50 2020-06-23 08:39:50 0:34:00 0:14:19 0:19:41 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 5171945 2020-06-23 07:50:24 2020-06-23 08:05:53 2020-06-23 14:34:03 6:28:10 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04_podman} fixed-2} 2
pass 5171946 2020-06-23 07:50:25 2020-06-23 08:06:01 2020-06-23 09:16:02 1:10:01 1:00:32 0:09:29 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5171947 2020-06-23 07:50:26 2020-06-23 08:06:08 2020-06-23 08:22:08 0:16:00 0:10:28 0:05:32 smithi master rhel 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
pass 5171948 2020-06-23 07:50:26 2020-06-23 08:08:07 2020-06-23 08:38:07 0:30:00 0:22:49 0:07:11 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5171949 2020-06-23 07:50:27 2020-06-23 08:08:07 2020-06-23 08:28:07 0:20:00 0:11:55 0:08:05 smithi master rhel 8.1 rados/singleton/{all/mon-config msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5171950 2020-06-23 07:50:28 2020-06-23 08:09:23 2020-06-23 08:25:22 0:15:59 0:07:03 0:08:56 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5171951 2020-06-23 07:50:29 2020-06-23 08:09:40 2020-06-23 09:01:40 0:52:00 0:43:49 0:08:11 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
pass 5171952 2020-06-23 07:50:30 2020-06-23 08:09:51 2020-06-23 08:57:52 0:48:01 0:39:06 0:08:55 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5171953 2020-06-23 07:50:31 2020-06-23 08:09:54 2020-06-23 08:49:54 0:40:00 0:31:53 0:08:07 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 5171954 2020-06-23 07:50:32 2020-06-23 08:12:09 2020-06-23 08:50:09 0:38:00 0:23:56 0:14:04 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5171955 2020-06-23 07:50:32 2020-06-23 08:12:09 2020-06-23 08:46:08 0:33:59 0:20:43 0:13:16 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
pass 5171956 2020-06-23 07:50:33 2020-06-23 08:12:18 2020-06-23 08:50:18 0:38:00 0:28:45 0:09:15 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5171957 2020-06-23 07:50:34 2020-06-23 08:12:20 2020-06-23 08:34:20 0:22:00 0:09:56 0:12:04 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 5171958 2020-06-23 07:50:35 2020-06-23 08:14:05 2020-06-23 08:36:05 0:22:00 0:14:17 0:07:43 smithi master ubuntu 18.04 rados/singleton/{all/osd-backfill msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5171959 2020-06-23 07:50:36 2020-06-23 08:14:05 2020-06-23 08:30:05 0:16:00 0:07:46 0:08:14 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_latest}} 1
fail 5171960 2020-06-23 07:50:37 2020-06-23 08:17:18 2020-06-23 08:47:18 0:30:00 0:21:31 0:08:29 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} 2
Failure Reason:

"2020-06-23T08:30:19.097498+0000 mon.a (mon.0) 98 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5171961 2020-06-23 07:50:38 2020-06-23 08:17:38 2020-06-23 08:43:38 0:26:00 0:17:52 0:08:08 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5171962 2020-06-23 07:50:38 2020-06-23 08:17:40 2020-06-23 08:31:40 0:14:00 0:06:30 0:07:30 smithi master centos 8.1 rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 5171963 2020-06-23 07:50:39 2020-06-23 08:17:50 2020-06-23 08:57:50 0:40:00 0:27:03 0:12:57 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 5171964 2020-06-23 07:50:40 2020-06-23 08:17:55 2020-06-23 08:51:55 0:34:00 0:26:41 0:07:19 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5171965 2020-06-23 07:50:41 2020-06-23 08:17:56 2020-06-23 08:43:55 0:25:59 0:11:20 0:14:39 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 5171966 2020-06-23 07:50:42 2020-06-23 08:18:05 2020-06-23 08:36:05 0:18:00 0:11:40 0:06:20 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5171967 2020-06-23 07:50:43 2020-06-23 08:18:09 2020-06-23 09:10:10 0:52:01 0:28:06 0:23:55 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5171968 2020-06-23 07:50:44 2020-06-23 08:20:14 2020-06-23 08:50:14 0:30:00 0:23:47 0:06:13 smithi master rhel 8.1 rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
fail 5171969 2020-06-23 07:50:45 2020-06-23 08:20:14 2020-06-23 08:22:14 0:02:00 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5171970 2020-06-23 07:50:46 2020-06-23 08:20:16 2020-06-23 08:40:16 0:20:00 0:10:21 0:09:39 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5171971 2020-06-23 07:50:46 2020-06-23 08:21:11 2020-06-23 08:55:11 0:34:00 0:26:11 0:07:49 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5171972 2020-06-23 07:50:47 2020-06-23 08:21:34 2020-06-23 10:21:37 2:00:03 0:10:22 1:49:41 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5171973 2020-06-23 07:50:48 2020-06-23 08:21:36 2020-06-23 08:41:36 0:20:00 0:13:55 0:06:05 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5171974 2020-06-23 07:50:49 2020-06-23 08:21:54 2020-06-23 08:39:53 0:17:59 0:12:01 0:05:58 smithi master ubuntu 18.04 rados/singleton/{all/osd-recovery msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 5171975 2020-06-23 07:50:50 2020-06-23 08:22:09 2020-06-23 08:48:09 0:26:00 0:09:09 0:16:51 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5171976 2020-06-23 07:50:51 2020-06-23 08:22:09 2020-06-23 09:06:09 0:44:00 0:28:13 0:15:47 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5171977 2020-06-23 07:50:52 2020-06-23 08:22:15 2020-06-23 08:46:14 0:23:59 0:17:28 0:06:31 smithi master rhel 8.1 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} 1
pass 5171978 2020-06-23 07:50:52 2020-06-23 08:22:16 2020-06-23 08:32:16 0:10:00 0:03:23 0:06:37 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5171979 2020-06-23 07:50:53 2020-06-23 08:23:45 2020-06-23 08:39:44 0:15:59 0:09:31 0:06:28 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5171980 2020-06-23 07:50:54 2020-06-23 08:23:54 2020-06-23 09:33:55 1:10:01 1:00:17 0:09:44 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5171981 2020-06-23 07:50:55 2020-06-23 08:23:55 2020-06-23 08:41:55 0:18:00 0:11:47 0:06:13 smithi master centos 8.1 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 5171982 2020-06-23 07:50:56 2020-06-23 08:25:39 2020-06-23 08:51:38 0:25:59 0:18:03 0:07:56 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5171983 2020-06-23 07:50:57 2020-06-23 08:26:07 2020-06-23 08:56:07 0:30:00 0:21:37 0:08:23 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 5171984 2020-06-23 07:50:58 2020-06-23 08:26:08 2020-06-23 08:44:09 0:18:01 0:11:40 0:06:21 smithi master rhel 8.1 rados/singleton/{all/peer msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5171985 2020-06-23 07:50:59 2020-06-23 08:28:15 2020-06-23 09:16:15 0:48:00 0:14:07 0:33:53 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5171986 2020-06-23 07:50:59 2020-06-23 08:28:15 2020-06-23 09:00:15 0:32:00 0:19:14 0:12:46 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 5171987 2020-06-23 07:51:00 2020-06-23 08:30:05 2020-06-23 09:02:04 0:31:59 0:24:46 0:07:13 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5171988 2020-06-23 07:51:01 2020-06-23 08:30:06 2020-06-23 09:32:07 1:02:01 0:25:36 0:36:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
fail 5171989 2020-06-23 07:51:02 2020-06-23 08:31:48 2020-06-23 09:27:49 0:56:01 0:40:31 0:15:30 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 5171990 2020-06-23 07:51:03 2020-06-23 08:31:48 2020-06-23 09:01:48 0:30:00 0:14:28 0:15:32 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5171991 2020-06-23 07:51:04 2020-06-23 08:32:06 2020-06-23 09:34:06 1:02:00 0:06:40 0:55:20 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 5171992 2020-06-23 07:51:04 2020-06-23 08:32:17 2020-06-23 09:00:17 0:28:00 0:13:48 0:14:12 smithi master rhel 8.1 rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 2
fail 5171993 2020-06-23 07:51:05 2020-06-23 08:34:35 2020-06-23 09:08:35 0:34:00 0:27:05 0:06:55 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
Failure Reason:

"2020-06-23T08:58:20.568227+0000 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi061:z (5798), after 302.75 seconds" in cluster log

pass 5171994 2020-06-23 07:51:06 2020-06-23 08:35:34 2020-06-23 09:11:33 0:35:59 0:24:54 0:11:05 smithi master rhel 8.1 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} 2
pass 5171995 2020-06-23 07:51:07 2020-06-23 08:36:05 2020-06-23 09:10:05 0:34:00 0:21:13 0:12:47 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5171996 2020-06-23 07:51:08 2020-06-23 08:36:06 2020-06-23 09:08:06 0:32:00 0:14:04 0:17:56 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5171997 2020-06-23 07:51:09 2020-06-23 08:36:06 2020-06-23 09:18:06 0:42:00 0:27:47 0:14:13 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
fail 5171998 2020-06-23 07:51:10 2020-06-23 08:38:21 2020-06-23 11:20:25 2:42:04 2:34:25 0:07:39 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
Failure Reason:

Command failed (workunit test osd/osd-recovery-stats.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-stats.sh'

dead 5171999 2020-06-23 07:51:11 2020-06-23 08:38:21 2020-06-23 14:34:30 5:56:09 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
pass 5172000 2020-06-23 07:51:11 2020-06-23 08:39:37 2020-06-23 08:59:36 0:19:59 0:11:53 0:08:06 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
fail 5172001 2020-06-23 07:51:12 2020-06-23 08:39:45 2020-06-23 08:41:44 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

fail 5172002 2020-06-23 07:51:13 2020-06-23 08:39:51 2020-06-23 09:31:52 0:52:01 0:44:39 0:07:22 smithi master rhel 8.1 rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 5172003 2020-06-23 07:51:14 2020-06-23 08:39:54 2020-06-23 09:07:54 0:28:00 0:16:16 0:11:44 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172004 2020-06-23 07:51:15 2020-06-23 08:40:17 2020-06-23 09:38:17 0:58:00 0:33:08 0:24:52 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
pass 5172005 2020-06-23 07:51:16 2020-06-23 08:41:52 2020-06-23 09:09:51 0:27:59 0:22:42 0:05:17 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5172006 2020-06-23 07:51:16 2020-06-23 08:41:52 2020-06-23 09:01:51 0:19:59 0:13:58 0:06:01 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
fail 5172007 2020-06-23 07:51:17 2020-06-23 08:41:56 2020-06-23 09:33:56 0:52:00 0:45:07 0:06:53 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
Failure Reason:

"2020-06-23T09:00:00.000175+0000 mon.b (mon.0) 109 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log

pass 5172008 2020-06-23 07:51:18 2020-06-23 08:41:56 2020-06-23 09:01:56 0:20:00 0:14:00 0:06:00 smithi master ubuntu 18.04 rados/singleton/{all/radostool msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172009 2020-06-23 07:51:19 2020-06-23 08:42:06 2020-06-23 09:06:06 0:24:00 0:13:22 0:10:38 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
pass 5172010 2020-06-23 07:51:20 2020-06-23 08:43:33 2020-06-23 09:11:32 0:27:59 0:21:34 0:06:25 smithi master rhel 8.1 rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} 1
pass 5172011 2020-06-23 07:51:21 2020-06-23 08:43:33 2020-06-23 09:23:33 0:40:00 0:31:31 0:08:29 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5172012 2020-06-23 07:51:22 2020-06-23 08:43:39 2020-06-23 12:17:44 3:34:05 3:21:36 0:12:29 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
dead 5172013 2020-06-23 07:51:22 2020-06-23 08:43:57 2020-06-23 14:34:06 5:50:09 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
pass 5172014 2020-06-23 07:51:23 2020-06-23 08:44:10 2020-06-23 09:24:10 0:40:00 0:12:12 0:27:48 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5172015 2020-06-23 07:51:24 2020-06-23 08:46:28 2020-06-23 10:02:29 1:16:01 1:05:17 0:10:44 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5172016 2020-06-23 07:51:25 2020-06-23 08:46:28 2020-06-23 09:20:28 0:34:00 0:26:21 0:07:39 smithi master rhel 8.1 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 5172017 2020-06-23 07:51:26 2020-06-23 08:47:12 2020-06-23 09:21:12 0:34:00 0:25:10 0:08:50 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5172018 2020-06-23 07:51:27 2020-06-23 08:47:20 2020-06-23 09:19:19 0:31:59 0:24:06 0:07:53 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
fail 5172019 2020-06-23 07:51:27 2020-06-23 08:48:25 2020-06-23 09:42:26 0:54:01 0:45:32 0:08:29 smithi master rhel 8.1 rados/singleton/{all/random-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
Failure Reason:

"2020-06-23T09:06:09.488709+0000 mon.a (mon.0) 146 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 5172020 2020-06-23 07:51:28 2020-06-23 08:48:25 2020-06-23 09:26:25 0:38:00 0:26:10 0:11:50 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 5172021 2020-06-23 07:51:29 2020-06-23 08:50:10 2020-06-23 09:06:10 0:16:00 0:08:47 0:07:13 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5172022 2020-06-23 07:51:30 2020-06-23 08:50:10 2020-06-23 09:28:10 0:38:00 0:23:34 0:14:26 smithi master centos 8.1 rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5172023 2020-06-23 07:51:31 2020-06-23 08:50:16 2020-06-23 09:14:15 0:23:59 0:13:01 0:10:58 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} 2
pass 5172024 2020-06-23 07:51:32 2020-06-23 08:50:19 2020-06-23 09:22:19 0:32:00 0:21:34 0:10:26 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_python} 2
pass 5172025 2020-06-23 07:51:32 2020-06-23 08:51:54 2020-06-23 09:25:54 0:34:00 0:27:42 0:06:18 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5172026 2020-06-23 07:51:33 2020-06-23 08:51:56 2020-06-23 09:21:56 0:30:00 0:21:26 0:08:34 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 5172027 2020-06-23 07:51:34 2020-06-23 08:52:01 2020-06-23 09:20:01 0:28:00 0:17:40 0:10:20 smithi master rhel 8.1 rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-06-23T09:11:08.370165+0000 mon.a (mon.0) 149 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5172028 2020-06-23 07:51:35 2020-06-23 08:55:27 2020-06-23 09:25:27 0:30:00 0:22:01 0:07:59 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 5172029 2020-06-23 07:51:36 2020-06-23 08:55:27 2020-06-23 09:13:27 0:18:00 0:12:06 0:05:54 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5172030 2020-06-23 07:51:37 2020-06-23 08:55:56 2020-06-23 09:09:56 0:14:00 0:06:49 0:07:11 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172031 2020-06-23 07:51:38 2020-06-23 08:55:56 2020-06-23 09:15:56 0:20:00 0:11:29 0:08:31 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5172032 2020-06-23 07:51:39 2020-06-23 08:56:08 2020-06-23 10:24:10 1:28:02 0:10:02 1:18:00 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 5172033 2020-06-23 07:51:39 2020-06-23 08:56:11 2020-06-23 09:40:12 0:44:01 0:32:47 0:11:14 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

fail 5172034 2020-06-23 07:51:40 2020-06-23 08:58:06 2020-06-23 09:00:05 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172035 2020-06-23 07:51:41 2020-06-23 08:58:06 2020-06-23 09:24:06 0:26:00 0:10:55 0:15:05 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5172036 2020-06-23 07:51:42 2020-06-23 08:59:52 2020-06-23 09:31:52 0:32:00 0:23:37 0:08:23 smithi master rhel 8.1 rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5172037 2020-06-23 07:51:43 2020-06-23 09:00:06 2020-06-23 10:50:08 1:50:02 1:43:08 0:06:54 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5172038 2020-06-23 07:51:44 2020-06-23 09:00:16 2020-06-23 09:32:16 0:32:00 0:24:56 0:07:04 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5172039 2020-06-23 07:51:45 2020-06-23 09:00:18 2020-06-23 09:18:17 0:17:59 0:12:11 0:05:48 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
fail 5172040 2020-06-23 07:51:46 2020-06-23 09:01:57 2020-06-23 09:27:57 0:26:00 0:14:05 0:11:55 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
Failure Reason:

Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh'

pass 5172041 2020-06-23 07:51:47 2020-06-23 09:01:57 2020-06-23 09:47:58 0:46:01 0:31:32 0:14:29 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 5172042 2020-06-23 07:51:48 2020-06-23 09:01:57 2020-06-23 09:23:57 0:22:00 0:14:33 0:07:27 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 5172043 2020-06-23 07:51:48 2020-06-23 09:01:58 2020-06-23 09:55:58 0:54:00 0:40:29 0:13:31 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

"2020-06-23T09:21:28.101729+0000 mon.a (mon.0) 132 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 5172044 2020-06-23 07:51:49 2020-06-23 09:02:06 2020-06-23 09:20:05 0:17:59 0:08:04 0:09:55 smithi master ubuntu 18.04 rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 5172045 2020-06-23 07:51:50 2020-06-23 09:03:13 2020-06-23 09:25:12 0:21:59 0:12:52 0:09:07 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5172046 2020-06-23 07:51:51 2020-06-23 09:06:21 2020-06-23 09:44:21 0:38:00 0:32:11 0:05:49 smithi master rhel 8.1 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} 1
pass 5172047 2020-06-23 07:51:52 2020-06-23 09:06:22 2020-06-23 09:44:21 0:37:59 0:19:35 0:18:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 5172048 2020-06-23 07:51:53 2020-06-23 09:06:22 2020-06-23 09:36:21 0:29:59 0:13:12 0:16:47 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5172049 2020-06-23 07:51:54 2020-06-23 09:08:11 2020-06-23 09:48:11 0:40:00 0:33:48 0:06:12 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} 2
pass 5172050 2020-06-23 07:51:55 2020-06-23 09:08:11 2020-06-23 10:26:12 1:18:01 1:01:34 0:16:27 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172051 2020-06-23 07:51:55 2020-06-23 09:08:25 2020-06-23 14:04:32 4:56:07 4:40:45 0:15:22 smithi master ubuntu 18.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} 1
pass 5172052 2020-06-23 07:51:56 2020-06-23 09:08:37 2020-06-23 09:26:36 0:17:59 0:09:57 0:08:02 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
pass 5172053 2020-06-23 07:51:57 2020-06-23 09:10:08 2020-06-23 09:26:07 0:15:59 0:06:28 0:09:31 smithi master centos 8.1 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 5172054 2020-06-23 07:51:58 2020-06-23 09:10:08 2020-06-23 09:28:07 0:17:59 0:12:32 0:05:27 smithi master rhel 8.1 rados/singleton/{all/test-crash msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5172055 2020-06-23 07:51:59 2020-06-23 09:10:08 2020-06-23 09:32:07 0:21:59 0:11:20 0:10:39 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5172056 2020-06-23 07:52:00 2020-06-23 09:10:11 2020-06-23 09:58:12 0:48:01 0:36:14 0:11:47 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172057 2020-06-23 07:52:01 2020-06-23 09:11:48 2020-06-23 09:37:48 0:26:00 0:14:56 0:11:04 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 5172058 2020-06-23 07:52:01 2020-06-23 09:11:48 2020-06-23 09:23:48 0:12:00 0:03:26 0:08:34 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5172059 2020-06-23 07:52:02 2020-06-23 09:13:44 2020-06-23 09:35:44 0:22:00 0:15:18 0:06:42 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} 2
pass 5172060 2020-06-23 07:52:03 2020-06-23 09:14:17 2020-06-23 09:48:17 0:34:00 0:27:29 0:06:31 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5172061 2020-06-23 07:52:04 2020-06-23 09:16:04 2020-06-23 09:54:04 0:38:00 0:11:50 0:26:10 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172062 2020-06-23 07:52:05 2020-06-23 09:16:04 2020-06-23 09:42:03 0:25:59 0:19:39 0:06:20 smithi master rhel 8.1 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5172063 2020-06-23 07:52:06 2020-06-23 09:16:04 2020-06-23 09:34:03 0:17:59 0:09:45 0:08:14 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5172064 2020-06-23 07:52:07 2020-06-23 09:16:16 2020-06-23 09:56:16 0:40:00 0:29:30 0:10:30 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
fail 5172065 2020-06-23 07:52:07 2020-06-23 09:18:22 2020-06-23 09:20:21 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

dead 5172066 2020-06-23 07:52:08 2020-06-23 09:18:22 2020-06-23 09:26:21 0:07:59 0:01:35 0:06:24 smithi master centos 8.1 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} 1
Failure Reason:

{'Failure object was': {'smithi104.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/qemu-kvm-block-rbd-2.12.0-88.module_el8.1.0+297+df420408.3.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 0, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}

pass 5172067 2020-06-23 07:52:09 2020-06-23 09:19:21 2020-06-23 09:47:20 0:27:59 0:20:14 0:07:45 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5172068 2020-06-23 07:52:10 2020-06-23 09:20:08 2020-06-23 09:40:07 0:19:59 0:12:06 0:07:53 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5172069 2020-06-23 07:52:11 2020-06-23 09:20:08 2020-06-23 09:40:07 0:19:59 0:11:12 0:08:47 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup_tier} 2
pass 5172070 2020-06-23 07:52:12 2020-06-23 09:20:08 2020-06-23 10:54:10 1:34:02 1:24:42 0:09:20 smithi master rhel 8.1 rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 2
pass 5172071 2020-06-23 07:52:13 2020-06-23 09:20:22 2020-06-23 09:40:22 0:20:00 0:11:05 0:08:55 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5172072 2020-06-23 07:52:14 2020-06-23 09:20:29 2020-06-23 10:06:29 0:46:00 0:28:50 0:17:10 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 5172073 2020-06-23 07:52:15 2020-06-23 09:21:28 2020-06-23 10:49:30 1:28:02 1:20:41 0:07:21 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5172074 2020-06-23 07:52:16 2020-06-23 09:21:57 2020-06-23 09:39:57 0:18:00 0:11:01 0:06:59 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5172075 2020-06-23 07:52:17 2020-06-23 09:22:20 2020-06-23 09:58:20 0:36:00 0:29:46 0:06:14 smithi master ubuntu 18.04 rados/singleton/{all/thrash-eio msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 5172076 2020-06-23 07:52:17 2020-06-23 09:23:50 2020-06-23 09:39:50 0:16:00 0:10:03 0:05:57 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5172077 2020-06-23 07:52:18 2020-06-23 09:23:50 2020-06-23 09:59:50 0:36:00 0:27:38 0:08:22 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5172078 2020-06-23 07:52:19 2020-06-23 09:23:58 2020-06-23 09:51:58 0:28:00 0:21:11 0:06:49 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} 2
pass 5172079 2020-06-23 07:52:20 2020-06-23 09:24:07 2020-06-23 09:42:06 0:17:59 0:11:48 0:06:11 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 5172080 2020-06-23 07:52:21 2020-06-23 09:24:11 2020-06-23 09:40:11 0:16:00 0:06:26 0:09:34 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5172081 2020-06-23 07:52:22 2020-06-23 09:25:29 2020-06-23 09:51:28 0:25:59 0:19:02 0:06:57 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
pass 5172082 2020-06-23 07:52:23 2020-06-23 09:25:29 2020-06-23 09:43:28 0:17:59 0:12:46 0:05:13 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 5172083 2020-06-23 07:52:24 2020-06-23 09:25:56 2020-06-23 10:33:56 1:08:00 1:01:27 0:06:33 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172084 2020-06-23 07:52:25 2020-06-23 09:26:08 2020-06-23 09:42:08 0:16:00 0:07:29 0:08:31 smithi master centos 8.1 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 5172085 2020-06-23 07:52:26 2020-06-23 09:26:23 2020-06-23 09:46:22 0:19:59 0:08:16 0:11:43 smithi master ubuntu 18.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 5172086 2020-06-23 07:52:26 2020-06-23 09:26:27 2020-06-23 09:46:26 0:19:59 0:13:44 0:06:15 smithi master centos 8.1 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} 1
pass 5172087 2020-06-23 07:52:27 2020-06-23 09:26:52 2020-06-23 09:50:52 0:24:00 0:14:29 0:09:31 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
fail 5172088 2020-06-23 07:52:28 2020-06-23 09:27:25 2020-06-23 13:15:30 3:48:05 3:37:22 0:10:43 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
Failure Reason:

"2020-06-23T09:47:30.510298+0000 mon.b (mon.0) 305 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5172089 2020-06-23 07:52:29 2020-06-23 09:27:50 2020-06-23 09:55:50 0:28:00 0:20:05 0:07:55 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 5172090 2020-06-23 07:52:30 2020-06-23 09:28:14 2020-06-23 10:20:14 0:52:00 0:35:59 0:16:01 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172091 2020-06-23 07:52:31 2020-06-23 09:28:14 2020-06-23 12:06:17 2:38:03 0:19:13 2:18:50 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172092 2020-06-23 07:52:32 2020-06-23 09:28:14 2020-06-23 09:56:13 0:27:59 0:18:09 0:09:50 smithi master ubuntu 18.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 5172093 2020-06-23 07:52:33 2020-06-23 09:31:23 2020-06-23 09:51:22 0:19:59 0:11:14 0:08:45 smithi master ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
pass 5172094 2020-06-23 07:52:33 2020-06-23 09:31:53 2020-06-23 10:01:53 0:30:00 0:21:21 0:08:39 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 5172095 2020-06-23 07:52:34 2020-06-23 09:31:53 2020-06-23 10:07:53 0:36:00 0:28:08 0:07:52 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172096 2020-06-23 07:52:35 2020-06-23 09:32:08 2020-06-23 09:50:07 0:17:59 0:11:40 0:06:19 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
pass 5172097 2020-06-23 07:52:36 2020-06-23 09:32:09 2020-06-23 09:50:08 0:17:59 0:10:26 0:07:33 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5172098 2020-06-23 07:52:37 2020-06-23 09:32:17 2020-06-23 10:10:17 0:38:00 0:25:36 0:12:24 smithi master rhel 8.1 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
pass 5172099 2020-06-23 07:52:38 2020-06-23 09:34:11 2020-06-23 10:06:11 0:32:00 0:24:55 0:07:05 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
fail 5172100 2020-06-23 07:52:39 2020-06-23 09:34:11 2020-06-23 09:36:10 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172101 2020-06-23 07:52:40 2020-06-23 09:34:11 2020-06-23 09:56:11 0:22:00 0:10:44 0:11:16 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5172102 2020-06-23 07:52:40 2020-06-23 09:36:13 2020-06-23 10:30:14 0:54:01 0:47:06 0:06:55 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5172103 2020-06-23 07:52:41 2020-06-23 09:36:23 2020-06-23 10:20:23 0:44:00 0:26:23 0:17:37 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5172104 2020-06-23 07:52:42 2020-06-23 09:37:45 2020-06-23 09:51:45 0:14:00 0:08:10 0:05:50 smithi master centos 8.1 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{centos_8}} 1
dead 5172105 2020-06-23 07:52:43 2020-06-23 09:37:49 2020-06-23 14:33:57 4:56:08 smithi master centos 8.1 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} 2
pass 5172106 2020-06-23 07:52:44 2020-06-23 09:38:18 2020-06-23 09:56:18 0:18:00 0:09:58 0:08:02 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5172107 2020-06-23 07:52:45 2020-06-23 09:39:13 2020-06-23 10:01:12 0:21:59 0:14:25 0:07:34 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
pass 5172108 2020-06-23 07:52:46 2020-06-23 09:39:51 2020-06-23 09:53:50 0:13:59 0:07:15 0:06:44 smithi master ubuntu 18.04 rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172109 2020-06-23 07:52:46 2020-06-23 09:39:58 2020-06-23 09:55:58 0:16:00 0:07:18 0:08:42 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5172110 2020-06-23 07:52:47 2020-06-23 09:40:09 2020-06-23 10:18:09 0:38:00 0:29:23 0:08:37 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 5172111 2020-06-23 07:52:48 2020-06-23 09:40:09 2020-06-23 10:08:09 0:28:00 0:13:41 0:14:19 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} 2
pass 5172112 2020-06-23 07:52:49 2020-06-23 09:40:12 2020-06-23 10:04:12 0:24:00 0:09:08 0:14:52 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 5172113 2020-06-23 07:52:50 2020-06-23 09:40:29 2020-06-23 11:18:30 1:38:01 1:28:56 0:09:05 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 5172114 2020-06-23 07:52:51 2020-06-23 09:40:29 2020-06-23 10:00:28 0:19:59 0:12:29 0:07:30 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5172115 2020-06-23 07:52:52 2020-06-23 09:42:20 2020-06-23 10:08:20 0:26:00 0:13:29 0:12:31 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5172116 2020-06-23 07:52:52 2020-06-23 09:42:20 2020-06-23 10:22:21 0:40:01 0:34:28 0:05:33 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5172117 2020-06-23 07:52:53 2020-06-23 09:42:21 2020-06-23 09:54:20 0:11:59 0:06:16 0:05:43 smithi master ubuntu 18.04 rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172118 2020-06-23 07:52:54 2020-06-23 09:42:27 2020-06-23 10:20:27 0:38:00 0:29:39 0:08:21 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172119 2020-06-23 07:52:55 2020-06-23 09:43:47 2020-06-23 10:43:47 1:00:00 0:16:04 0:43:56 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172120 2020-06-23 07:52:56 2020-06-23 09:44:23 2020-06-23 10:08:22 0:23:59 0:18:06 0:05:53 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5172121 2020-06-23 07:52:57 2020-06-23 09:44:23 2020-06-23 10:58:24 1:14:01 1:01:20 0:12:41 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172122 2020-06-23 07:52:57 2020-06-23 09:46:42 2020-06-23 10:08:42 0:22:00 0:15:58 0:06:02 smithi master rhel 8.1 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 5172123 2020-06-23 07:52:58 2020-06-23 09:47:22 2020-06-23 10:05:21 0:17:59 0:12:33 0:05:26 smithi master rhel 8.1 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_8}} 1
pass 5172124 2020-06-23 07:52:59 2020-06-23 09:48:15 2020-06-23 10:00:14 0:11:59 0:07:14 0:04:45 smithi master centos 8.1 rados/singleton/{all/deduptool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5172125 2020-06-23 07:53:00 2020-06-23 09:48:15 2020-06-23 10:12:15 0:24:00 0:12:18 0:11:42 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 5172126 2020-06-23 07:53:01 2020-06-23 09:48:15 2020-06-23 10:10:15 0:22:00 0:10:04 0:11:56 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5172127 2020-06-23 07:53:02 2020-06-23 09:48:16 2020-06-23 10:24:16 0:36:00 0:22:25 0:13:35 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5172128 2020-06-23 07:53:03 2020-06-23 09:48:18 2020-06-23 10:06:17 0:17:59 0:09:13 0:08:46 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
fail 5172129 2020-06-23 07:53:03 2020-06-23 09:50:25 2020-06-23 10:08:24 0:17:59 0:11:38 0:06:21 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} 1
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-code.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a37441cafc930163e20698d71e5d6bd8e5ba01b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh'

pass 5172130 2020-06-23 07:53:04 2020-06-23 09:50:25 2020-06-23 10:06:24 0:15:59 0:10:06 0:05:53 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
fail 5172131 2020-06-23 07:53:05 2020-06-23 09:50:55 2020-06-23 09:52:54 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172132 2020-06-23 07:53:06 2020-06-23 09:51:24 2020-06-23 10:09:23 0:17:59 0:12:53 0:05:06 smithi master rhel 8.1 rados/singleton/{all/divergent_priors msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5172133 2020-06-23 07:53:07 2020-06-23 09:51:45 2020-06-23 10:01:44 0:09:59 0:03:26 0:06:33 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5172134 2020-06-23 07:53:08 2020-06-23 09:51:46 2020-06-23 10:27:46 0:36:00 0:26:28 0:09:32 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 5172135 2020-06-23 07:53:08 2020-06-23 09:51:59 2020-06-23 10:19:59 0:28:00 0:19:09 0:08:51 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
pass 5172136 2020-06-23 07:53:09 2020-06-23 09:53:11 2020-06-23 10:25:11 0:32:00 0:24:01 0:07:59 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5172137 2020-06-23 07:53:10 2020-06-23 09:53:52 2020-06-23 10:31:52 0:38:00 0:31:07 0:06:53 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} 2
pass 5172138 2020-06-23 07:53:11 2020-06-23 09:54:10 2020-06-23 10:26:10 0:32:00 0:24:17 0:07:43 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5172139 2020-06-23 07:53:12 2020-06-23 09:54:37 2020-06-23 10:12:36 0:17:59 0:11:56 0:06:03 smithi master rhel 8.1 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_8}} 1
pass 5172140 2020-06-23 07:53:13 2020-06-23 09:56:08 2020-06-23 10:10:07 0:13:59 0:08:09 0:05:50 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172141 2020-06-23 07:53:14 2020-06-23 09:56:08 2020-06-23 10:22:07 0:25:59 0:15:53 0:10:06 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/failover} 2
pass 5172142 2020-06-23 07:53:15 2020-06-23 09:56:08 2020-06-23 10:32:08 0:36:00 0:26:50 0:09:10 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} 2
pass 5172143 2020-06-23 07:53:16 2020-06-23 09:56:12 2020-06-23 10:18:12 0:22:00 0:14:57 0:07:03 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5172144 2020-06-23 07:53:16 2020-06-23 09:56:17 2020-06-23 10:16:16 0:19:59 0:06:43 0:13:16 smithi master centos 8.1 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 5172145 2020-06-23 07:53:17 2020-06-23 09:56:18 2020-06-23 10:18:17 0:21:59 0:13:13 0:08:46 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 5172146 2020-06-23 07:53:18 2020-06-23 09:56:19 2020-06-23 10:32:19 0:36:00 0:25:52 0:10:08 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5172147 2020-06-23 07:53:19 2020-06-23 09:58:28 2020-06-23 11:46:30 1:48:02 0:15:38 1:32:24 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172148 2020-06-23 07:53:20 2020-06-23 09:58:28 2020-06-23 10:16:27 0:17:59 0:10:46 0:07:13 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 5172149 2020-06-23 07:53:21 2020-06-23 10:00:11 2020-06-23 10:30:11 0:30:00 0:22:16 0:07:44 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172150 2020-06-23 07:53:22 2020-06-23 10:00:16 2020-06-23 10:20:15 0:19:59 0:13:30 0:06:29 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5172151 2020-06-23 07:53:23 2020-06-23 10:00:30 2020-06-23 10:14:29 0:13:59 0:08:24 0:05:35 smithi master ubuntu 18.04 rados/singleton/{all/dump-stuck msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172152 2020-06-23 07:53:24 2020-06-23 10:01:29 2020-06-23 10:19:29 0:18:00 0:11:56 0:06:04 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
pass 5172153 2020-06-23 07:53:24 2020-06-23 10:01:45 2020-06-23 11:09:46 1:08:01 1:01:48 0:06:13 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172154 2020-06-23 07:53:25 2020-06-23 10:01:54 2020-06-23 10:19:53 0:17:59 0:11:30 0:06:29 smithi master rhel 8.1 rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} 1
pass 5172155 2020-06-23 07:53:26 2020-06-23 10:01:55 2020-06-23 10:17:54 0:15:59 0:09:55 0:06:04 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5172156 2020-06-23 07:53:27 2020-06-23 10:02:46 2020-06-23 10:16:46 0:14:00 0:05:56 0:08:04 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} 1
pass 5172157 2020-06-23 07:53:28 2020-06-23 10:03:13 2020-06-23 10:49:13 0:46:00 0:38:12 0:07:48 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5172158 2020-06-23 07:53:29 2020-06-23 10:04:29 2020-06-23 10:42:29 0:38:00 0:30:30 0:07:30 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
pass 5172159 2020-06-23 07:53:30 2020-06-23 10:05:23 2020-06-23 10:31:22 0:25:59 0:20:07 0:05:52 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5172160 2020-06-23 07:53:31 2020-06-23 10:06:28 2020-06-23 10:44:28 0:38:00 0:30:43 0:07:17 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5172161 2020-06-23 07:53:31 2020-06-23 10:06:28 2020-06-23 10:24:27 0:17:59 0:10:19 0:07:40 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 5172162 2020-06-23 07:53:32 2020-06-23 10:06:28 2020-06-23 10:42:28 0:36:00 0:28:04 0:07:56 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172163 2020-06-23 07:53:33 2020-06-23 10:06:30 2020-06-23 10:28:30 0:22:00 0:13:27 0:08:33 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
fail 5172164 2020-06-23 07:53:34 2020-06-23 10:06:42 2020-06-23 10:08:41 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172165 2020-06-23 07:53:35 2020-06-23 10:08:11 2020-06-23 10:36:11 0:28:00 0:18:34 0:09:26 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 5172166 2020-06-23 07:53:36 2020-06-23 10:08:11 2020-06-23 10:32:11 0:24:00 0:09:42 0:14:18 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 5172167 2020-06-23 07:53:37 2020-06-23 10:08:21 2020-06-23 11:06:22 0:58:01 0:40:37 0:17:24 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

"2020-06-23T10:30:56.061824+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 5172168 2020-06-23 07:53:38 2020-06-23 10:08:23 2020-06-23 10:20:23 0:12:00 0:05:56 0:06:04 smithi master centos 8.1 rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5172169 2020-06-23 07:53:38 2020-06-23 10:08:26 2020-06-23 10:28:25 0:19:59 0:12:12 0:07:47 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5172170 2020-06-23 07:53:39 2020-06-23 10:08:42 2020-06-23 10:36:42 0:28:00 0:11:11 0:16:49 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/insights} 2
pass 5172171 2020-06-23 07:53:40 2020-06-23 10:08:43 2020-06-23 10:24:42 0:15:59 0:08:28 0:07:31 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5172172 2020-06-23 07:53:41 2020-06-23 10:09:40 2020-06-23 10:25:39 0:15:59 0:09:46 0:06:13 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5172173 2020-06-23 07:53:42 2020-06-23 10:09:40 2020-06-23 10:57:40 0:48:00 0:41:22 0:06:38 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 5172174 2020-06-23 07:53:43 2020-06-23 10:10:08 2020-06-23 11:04:09 0:54:01 0:14:54 0:39:07 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172175 2020-06-23 07:53:44 2020-06-23 10:10:16 2020-06-23 10:26:15 0:15:59 0:06:36 0:09:23 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5172176 2020-06-23 07:53:44 2020-06-23 10:10:19 2020-06-23 10:44:18 0:33:59 0:28:30 0:05:29 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 5172177 2020-06-23 07:53:45 2020-06-23 10:11:51 2020-06-23 10:23:50 0:11:59 0:06:49 0:05:10 smithi master centos 8.1 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} 1
pass 5172178 2020-06-23 07:53:46 2020-06-23 10:12:16 2020-06-23 10:44:16 0:32:00 0:24:51 0:07:09 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 5172179 2020-06-23 07:53:47 2020-06-23 10:12:37 2020-06-23 10:52:37 0:40:00 0:30:09 0:09:51 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172180 2020-06-23 07:53:48 2020-06-23 10:14:29 2020-06-23 10:46:29 0:32:00 0:22:19 0:09:41 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_python} 2
pass 5172181 2020-06-23 07:53:49 2020-06-23 10:14:30 2020-06-23 10:30:30 0:16:00 0:09:21 0:06:39 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5172182 2020-06-23 07:53:50 2020-06-23 10:16:32 2020-06-23 10:36:32 0:20:00 0:12:14 0:07:46 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5172183 2020-06-23 07:53:51 2020-06-23 10:16:32 2020-06-23 10:48:32 0:32:00 0:25:03 0:06:57 smithi master centos 8.1 rados/singleton/{all/lost-unfound msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5172184 2020-06-23 07:53:52 2020-06-23 10:16:47 2020-06-23 10:38:47 0:22:00 0:15:49 0:06:11 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 5172185 2020-06-23 07:53:53 2020-06-23 10:18:10 2020-06-23 10:48:10 0:30:00 0:23:50 0:06:10 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 5172186 2020-06-23 07:53:53 2020-06-23 10:18:10 2020-06-23 11:26:11 1:08:01 1:01:06 0:06:55 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172187 2020-06-23 07:53:54 2020-06-23 10:18:14 2020-06-23 12:42:17 2:24:03 2:16:03 0:08:00 smithi master rhel 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 5172188 2020-06-23 07:53:55 2020-06-23 10:18:18 2020-06-23 10:44:18 0:26:00 0:18:33 0:07:27 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5172189 2020-06-23 07:53:56 2020-06-23 10:19:45 2020-06-23 10:41:44 0:21:59 0:11:09 0:10:50 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5172190 2020-06-23 07:53:57 2020-06-23 10:19:55 2020-06-23 10:49:54 0:29:59 0:23:37 0:06:22 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5172191 2020-06-23 07:53:58 2020-06-23 10:20:00 2020-06-23 10:52:00 0:32:00 0:23:26 0:08:34 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
fail 5172192 2020-06-23 07:53:59 2020-06-23 10:20:16 2020-06-23 10:38:15 0:17:59 0:11:29 0:06:30 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-06-23T10:34:34.602005+0000 mon.a (mon.0) 45 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5172193 2020-06-23 07:53:59 2020-06-23 10:20:17 2020-06-23 10:40:16 0:19:59 0:12:04 0:07:55 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
pass 5172194 2020-06-23 07:54:00 2020-06-23 10:20:24 2020-06-23 10:38:23 0:17:59 0:11:34 0:06:25 smithi master rhel 8.1 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} 1
pass 5172195 2020-06-23 07:54:01 2020-06-23 10:20:24 2020-06-23 10:50:25 0:30:01 0:22:54 0:07:07 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
fail 5172196 2020-06-23 07:54:02 2020-06-23 10:20:29 2020-06-23 10:22:28 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172197 2020-06-23 07:54:03 2020-06-23 10:21:53 2020-06-23 11:07:53 0:46:00 0:29:02 0:16:58 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5172198 2020-06-23 07:54:04 2020-06-23 10:22:09 2020-06-23 11:20:09 0:58:00 0:50:09 0:07:51 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} 2
pass 5172199 2020-06-23 07:54:04 2020-06-23 10:22:22 2020-06-23 10:56:22 0:34:00 0:24:15 0:09:45 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 5172200 2020-06-23 07:54:05 2020-06-23 10:22:30 2020-06-23 11:00:29 0:37:59 0:29:45 0:08:14 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5172201 2020-06-23 07:54:06 2020-06-23 10:24:08 2020-06-23 11:02:08 0:38:00 0:31:27 0:06:33 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/module_selftest} 2
pass 5172202 2020-06-23 07:54:07 2020-06-23 10:24:11 2020-06-23 10:40:10 0:15:59 0:10:35 0:05:24 smithi master centos 8.1 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5172203 2020-06-23 07:54:08 2020-06-23 10:24:18 2020-06-23 11:24:18 1:00:00 0:14:27 0:45:33 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5172204 2020-06-23 07:54:09 2020-06-23 10:24:29 2020-06-23 10:44:28 0:19:59 0:13:17 0:06:42 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5172205 2020-06-23 07:54:10 2020-06-23 10:24:44 2020-06-23 10:56:44 0:32:00 0:26:14 0:05:46 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
pass 5172206 2020-06-23 07:54:10 2020-06-23 10:25:29 2020-06-23 10:43:29 0:18:00 0:11:30 0:06:30 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 5172207 2020-06-23 07:54:11 2020-06-23 10:25:32 2020-06-23 11:03:32 0:38:00 0:30:25 0:07:35 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5172208 2020-06-23 07:54:12 2020-06-23 10:25:40 2020-06-23 10:45:40 0:20:00 0:11:39 0:08:21 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5172209 2020-06-23 07:54:13 2020-06-23 10:25:54 2020-06-23 11:01:54 0:36:00 0:26:52 0:09:08 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5172210 2020-06-23 07:54:14 2020-06-23 10:26:11 2020-06-23 10:44:10 0:17:59 0:10:59 0:07:00 smithi master centos 8.1 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5172211 2020-06-23 07:54:15 2020-06-23 10:26:14 2020-06-23 10:46:13 0:19:59 0:14:25 0:05:34 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 5172212 2020-06-23 07:54:16 2020-06-23 10:26:17 2020-06-23 10:48:16 0:21:59 0:12:47 0:09:12 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
fail 5172213 2020-06-23 07:54:16 2020-06-23 10:28:02 2020-06-23 11:16:03 0:48:01 0:40:23 0:07:38 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 5172214 2020-06-23 07:54:17 2020-06-23 10:28:26 2020-06-23 10:38:26 0:10:00 0:03:25 0:06:35 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5172215 2020-06-23 07:54:18 2020-06-23 10:28:31 2020-06-23 10:58:31 0:30:00 0:23:22 0:06:38 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 5172216 2020-06-23 07:54:19 2020-06-23 10:30:28 2020-06-23 10:56:28 0:26:00 0:19:43 0:06:17 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5172217 2020-06-23 07:54:20 2020-06-23 10:30:28 2020-06-23 11:00:28 0:30:00 0:22:19 0:07:41 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5172218 2020-06-23 07:54:21 2020-06-23 10:30:31 2020-06-23 10:48:30 0:17:59 0:12:27 0:05:32 smithi master rhel 8.1 rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5172219 2020-06-23 07:54:22 2020-06-23 10:31:24 2020-06-23 11:05:24 0:34:00 0:28:00 0:06:00 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5172220 2020-06-23 07:54:22 2020-06-23 10:32:09 2020-06-23 11:40:10 1:08:01 1:01:35 0:06:26 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5172221 2020-06-23 07:54:23 2020-06-23 10:32:09 2020-06-23 12:50:12 2:18:03 2:10:52 0:07:11 smithi master centos 8.1 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 5172222 2020-06-23 07:54:24 2020-06-23 10:32:12 2020-06-23 10:54:12 0:22:00 0:12:15 0:09:45 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5172223 2020-06-23 07:54:25 2020-06-23 10:32:20 2020-06-23 10:52:20 0:20:00 0:10:48 0:09:12 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5172224 2020-06-23 07:54:26 2020-06-23 10:34:13 2020-06-23 10:58:12 0:23:59 0:14:30 0:09:29 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} 2
pass 5172225 2020-06-23 07:54:27 2020-06-23 10:36:26 2020-06-23 10:56:26 0:20:00 0:11:10 0:08:50 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5172226 2020-06-23 07:54:27 2020-06-23 10:36:33 2020-06-23 10:56:33 0:20:00 0:13:38 0:06:22 smithi master rhel 8.1 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5172227 2020-06-23 07:54:28 2020-06-23 10:36:43 2020-06-23 10:52:42 0:15:59 0:09:36 0:06:23 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 5172228 2020-06-23 07:54:29 2020-06-23 10:38:37 2020-06-23 10:40:36 0:01:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench}
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-kefu-testing-2020-06-23-1007

pass 5172229 2020-06-23 07:54:30 2020-06-23 10:38:37 2020-06-23 11:12:37 0:34:00 0:25:39 0:08:21 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
pass 5172230 2020-06-23 07:54:31 2020-06-23 10:38:48 2020-06-23 11:00:48 0:22:00 0:12:58 0:09:02 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} 2