Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5186624 2020-06-28 18:43:30 2020-06-28 18:43:48 2020-06-28 19:17:46 0:33:58 0:14:36 0:19:22 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
pass 5186625 2020-06-28 18:43:31 2020-06-28 18:43:47 2020-06-28 19:07:46 0:23:59 0:12:31 0:11:28 smithi master rhel 8.1 rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5186626 2020-06-28 18:43:32 2020-06-28 18:43:46 2020-06-28 19:27:47 0:44:01 0:25:33 0:18:28 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186627 2020-06-28 18:43:33 2020-06-28 18:43:48 2020-06-28 19:13:47 0:29:59 0:10:45 0:19:14 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} 2
pass 5186628 2020-06-28 18:43:34 2020-06-28 18:43:48 2020-06-28 19:41:48 0:58:00 0:40:29 0:17:31 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5186629 2020-06-28 18:43:35 2020-06-28 18:43:49 2020-06-28 19:11:48 0:27:59 0:21:36 0:06:23 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186630 2020-06-28 18:43:36 2020-06-28 18:43:49 2020-06-28 19:37:49 0:54:00 0:31:30 0:22:30 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5186631 2020-06-28 18:43:37 2020-06-28 18:43:48 2020-06-28 20:39:49 1:56:01 1:37:05 0:18:56 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 5186632 2020-06-28 18:43:38 2020-06-28 18:43:49 2020-06-28 20:11:50 1:28:01 1:05:21 0:22:40 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5186633 2020-06-28 18:43:38 2020-06-28 18:43:48 2020-06-28 19:05:47 0:21:59 0:06:49 0:15:10 smithi master centos 8.1 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 5186634 2020-06-28 18:43:39 2020-06-28 18:43:50 2020-06-28 19:01:49 0:17:59 0:08:26 0:09:33 smithi master centos 8.1 rados/rest/{mgr-restful supported-random-distro$/{centos_8}} 1
pass 5186635 2020-06-28 18:43:40 2020-06-28 18:43:48 2020-06-28 19:17:47 0:33:59 0:18:43 0:15:16 smithi master rhel 8.1 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}} 1
pass 5186636 2020-06-28 18:43:41 2020-06-28 18:43:47 2020-06-28 19:09:46 0:25:59 0:14:40 0:11:19 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
fail 5186637 2020-06-28 18:43:42 2020-06-28 18:43:49 2020-06-28 22:45:55 4:02:06 3:53:29 0:08:37 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
Failure Reason:

"2020-06-28T19:01:19.344612+0000 mon.b (mon.0) 307 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5186638 2020-06-28 18:43:43 2020-06-28 18:43:49 2020-06-28 19:21:47 0:37:58 0:17:01 0:20:57 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 5186639 2020-06-28 18:43:44 2020-06-28 18:43:48 2020-06-28 19:13:47 0:29:59 0:07:55 0:22:04 smithi master centos 8.1 rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5186640 2020-06-28 18:43:45 2020-06-28 18:43:48 2020-06-28 19:15:47 0:31:59 0:09:34 0:22:25 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect} 2
pass 5186641 2020-06-28 18:43:46 2020-06-28 18:43:48 2020-06-28 19:11:47 0:27:59 0:09:47 0:18:12 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5186642 2020-06-28 18:43:47 2020-06-28 18:43:48 2020-06-28 19:21:48 0:38:00 0:18:39 0:19:21 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 5186643 2020-06-28 18:43:48 2020-06-28 18:43:50 2020-06-28 19:19:49 0:35:59 0:10:23 0:25:36 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186644 2020-06-28 18:43:49 2020-06-28 18:43:50 2020-06-28 19:49:50 1:06:00 0:40:33 0:25:27 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} 2
pass 5186645 2020-06-28 18:43:50 2020-06-28 18:43:51 2020-06-28 19:05:51 0:22:00 0:10:57 0:11:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 5186646 2020-06-28 18:43:50 2020-06-28 18:43:52 2020-06-28 19:07:52 0:24:00 0:13:17 0:10:43 smithi master rhel 8.1 rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5186647 2020-06-28 18:43:52 2020-06-28 18:43:53 2020-06-28 19:13:53 0:30:00 0:10:41 0:19:19 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5186648 2020-06-28 18:43:53 2020-06-28 18:43:54 2020-06-28 19:29:54 0:46:00 0:19:23 0:26:37 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/progress} 2
pass 5186649 2020-06-28 18:43:53 2020-06-28 18:43:55 2020-06-28 19:09:54 0:25:59 0:14:49 0:11:10 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 5186650 2020-06-28 18:43:54 2020-06-28 18:43:56 2020-06-28 19:09:55 0:25:59 0:13:05 0:12:54 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
pass 5186651 2020-06-28 18:43:55 2020-06-28 18:45:26 2020-06-28 19:03:26 0:18:00 0:08:03 0:09:57 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186652 2020-06-28 18:43:56 2020-06-28 18:45:26 2020-06-28 20:33:29 1:48:03 1:34:03 0:14:00 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 5186653 2020-06-28 18:43:57 2020-06-28 18:49:13 2020-06-28 19:07:13 0:18:00 0:07:58 0:10:02 smithi master ubuntu 18.04 rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186654 2020-06-28 18:43:58 2020-06-28 18:49:13 2020-06-28 19:21:13 0:32:00 0:23:07 0:08:53 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 5186655 2020-06-28 18:43:59 2020-06-28 18:49:13 2020-06-28 19:09:13 0:20:00 0:10:02 0:09:58 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5186656 2020-06-28 18:44:00 2020-06-28 18:51:28 2020-06-28 19:15:28 0:24:00 0:13:49 0:10:11 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5186657 2020-06-28 18:44:01 2020-06-28 18:53:10 2020-06-28 19:25:10 0:32:00 0:18:03 0:13:57 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 5186658 2020-06-28 18:44:02 2020-06-28 18:54:06 2020-06-28 19:16:05 0:21:59 0:09:53 0:12:06 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5186659 2020-06-28 18:44:03 2020-06-28 18:54:07 2020-06-28 19:56:07 1:02:00 0:43:43 0:18:17 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
pass 5186660 2020-06-28 18:44:04 2020-06-28 18:54:07 2020-06-28 19:44:07 0:50:00 0:31:26 0:18:34 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186661 2020-06-28 18:44:04 2020-06-28 18:54:07 2020-06-28 19:34:07 0:40:00 0:20:18 0:19:42 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 5186662 2020-06-28 18:44:05 2020-06-28 18:55:21 2020-06-28 21:21:24 2:26:03 2:13:00 0:13:03 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5186663 2020-06-28 18:44:06 2020-06-28 18:56:07 2020-06-28 19:42:07 0:46:00 0:39:12 0:06:48 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5186664 2020-06-28 18:44:07 2020-06-28 18:56:07 2020-06-28 19:46:07 0:50:00 0:33:28 0:16:32 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5186665 2020-06-28 18:44:08 2020-06-28 18:56:07 2020-06-28 19:54:08 0:58:01 0:25:52 0:32:09 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5186666 2020-06-28 18:44:09 2020-06-28 18:56:07 2020-06-28 19:56:08 1:00:01 0:28:58 0:31:03 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5186667 2020-06-28 18:44:10 2020-06-28 18:56:08 2020-06-28 19:38:08 0:42:00 0:33:32 0:08:28 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5186668 2020-06-28 18:44:11 2020-06-28 18:57:15 2020-06-28 19:17:14 0:19:59 0:10:12 0:09:47 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186669 2020-06-28 18:44:12 2020-06-28 18:57:15 2020-06-28 20:09:16 1:12:01 1:01:26 0:10:35 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5186670 2020-06-28 18:44:13 2020-06-28 18:59:24 2020-06-28 19:21:24 0:22:00 0:15:38 0:06:22 smithi master rhel 8.1 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 5186671 2020-06-28 18:44:14 2020-06-28 18:59:24 2020-06-28 19:17:24 0:18:00 0:10:35 0:07:25 smithi master rhel 8.1 rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5186672 2020-06-28 18:44:14 2020-06-28 19:00:07 2020-06-28 19:14:06 0:13:59 0:07:38 0:06:21 smithi master centos 8.1 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} 1
pass 5186673 2020-06-28 18:44:15 2020-06-28 19:00:07 2020-06-28 19:18:07 0:18:00 0:10:08 0:07:52 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5186674 2020-06-28 18:44:16 2020-06-28 19:00:07 2020-06-28 19:48:08 0:48:01 0:24:05 0:23:56 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 5186675 2020-06-28 18:44:17 2020-06-28 19:00:51 2020-06-28 19:28:50 0:27:59 0:21:06 0:06:53 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} 2
pass 5186676 2020-06-28 18:44:18 2020-06-28 19:00:54 2020-06-28 19:26:54 0:26:00 0:18:18 0:07:42 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5186677 2020-06-28 18:44:19 2020-06-28 19:01:07 2020-06-28 19:31:07 0:30:00 0:19:37 0:10:23 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 5186678 2020-06-28 18:44:20 2020-06-28 19:01:09 2020-06-28 19:33:08 0:31:59 0:09:53 0:22:06 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 5186679 2020-06-28 18:44:21 2020-06-28 19:01:14 2020-06-28 19:49:14 0:48:00 0:39:55 0:08:05 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} 1
pass 5186680 2020-06-28 18:44:22 2020-06-28 19:02:06 2020-06-28 19:28:06 0:26:00 0:18:51 0:07:09 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5186681 2020-06-28 18:44:23 2020-06-28 19:02:36 2020-06-28 19:36:36 0:34:00 0:27:28 0:06:32 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186682 2020-06-28 18:44:23 2020-06-28 19:03:05 2020-06-28 19:41:05 0:38:00 0:29:21 0:08:39 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
fail 5186683 2020-06-28 18:44:24 2020-06-28 19:03:42 2020-06-28 19:47:43 0:44:01 0:29:56 0:14:05 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5186684 2020-06-28 18:44:25 2020-06-28 19:04:09 2020-06-28 19:26:08 0:21:59 0:06:50 0:15:09 smithi master centos 8.1 rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 5186685 2020-06-28 18:44:26 2020-06-28 19:04:09 2020-06-28 19:32:09 0:28:00 0:13:20 0:14:40 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 5186686 2020-06-28 18:44:27 2020-06-28 19:05:19 2020-06-28 19:23:18 0:17:59 0:11:10 0:06:49 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5186687 2020-06-28 18:44:28 2020-06-28 19:05:48 2020-06-28 19:43:48 0:38:00 0:32:20 0:05:40 smithi master centos 8.1 rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5186688 2020-06-28 18:44:29 2020-06-28 19:05:52 2020-06-28 19:45:53 0:40:01 0:30:53 0:09:08 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186689 2020-06-28 18:44:30 2020-06-28 19:07:24 2020-06-28 19:31:23 0:23:59 0:15:15 0:08:44 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
pass 5186690 2020-06-28 18:44:31 2020-06-28 19:07:24 2020-06-28 19:19:23 0:11:59 0:07:08 0:04:51 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} 1
pass 5186691 2020-06-28 18:44:32 2020-06-28 19:07:24 2020-06-28 19:43:24 0:36:00 0:24:14 0:11:46 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5186692 2020-06-28 18:44:33 2020-06-28 19:07:48 2020-06-28 19:43:47 0:35:59 0:28:08 0:07:51 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186693 2020-06-28 18:44:34 2020-06-28 19:07:53 2020-06-28 19:33:53 0:26:00 0:20:03 0:05:57 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5186694 2020-06-28 18:44:34 2020-06-28 19:08:08 2020-06-28 19:54:09 0:46:01 0:31:42 0:14:19 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 5186695 2020-06-28 18:44:35 2020-06-28 19:09:22 2020-06-28 19:45:22 0:36:00 0:26:53 0:09:07 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5186696 2020-06-28 18:44:36 2020-06-28 19:09:22 2020-06-28 19:27:22 0:18:00 0:11:22 0:06:38 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5186697 2020-06-28 18:44:37 2020-06-28 19:09:48 2020-06-28 19:37:47 0:27:59 0:15:31 0:12:28 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186698 2020-06-28 18:44:38 2020-06-28 19:09:56 2020-06-28 19:35:55 0:25:59 0:17:46 0:08:13 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 5186699 2020-06-28 18:44:39 2020-06-28 19:09:57 2020-06-28 19:27:56 0:17:59 0:09:35 0:08:24 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 5186700 2020-06-28 18:44:40 2020-06-28 19:10:08 2020-06-28 19:26:08 0:16:00 0:07:54 0:08:06 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
pass 5186701 2020-06-28 18:44:41 2020-06-28 19:10:09 2020-06-28 20:34:10 1:24:01 1:06:19 0:17:42 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5186702 2020-06-28 18:44:42 2020-06-28 19:10:09 2020-06-28 19:24:08 0:13:59 0:06:30 0:07:29 smithi master centos 8.1 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 5186703 2020-06-28 18:44:43 2020-06-28 19:11:31 2020-06-28 19:29:31 0:18:00 0:10:38 0:07:22 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 5186704 2020-06-28 18:44:44 2020-06-28 19:11:48 2020-06-28 19:29:48 0:18:00 0:10:00 0:08:00 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 5186705 2020-06-28 18:44:45 2020-06-28 19:11:49 2020-06-28 19:29:49 0:18:00 0:10:48 0:07:12 smithi master centos 8.1 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 5186706 2020-06-28 18:44:45 2020-06-28 19:12:14 2020-06-28 19:30:13 0:17:59 0:10:06 0:07:53 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup_tier} 2
pass 5186707 2020-06-28 18:44:46 2020-06-28 19:13:14 2020-06-28 19:31:14 0:18:00 0:10:41 0:07:19 smithi master rhel 8.1 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} 1
pass 5186708 2020-06-28 18:44:47 2020-06-28 19:13:48 2020-06-28 19:27:47 0:13:59 0:07:12 0:06:47 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/workunits} 2
pass 5186709 2020-06-28 18:44:48 2020-06-28 19:13:49 2020-06-28 19:53:49 0:40:00 0:33:04 0:06:56 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5186710 2020-06-28 18:44:49 2020-06-28 19:13:54 2020-06-28 19:45:54 0:32:00 0:24:21 0:07:39 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5186711 2020-06-28 18:44:50 2020-06-28 19:14:08 2020-06-28 20:04:08 0:50:00 0:37:27 0:12:33 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
pass 5186712 2020-06-28 18:44:51 2020-06-28 19:14:09 2020-06-28 19:36:08 0:21:59 0:16:31 0:05:28 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5186713 2020-06-28 18:44:52 2020-06-28 19:14:09 2020-06-28 19:50:09 0:36:00 0:28:56 0:07:04 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 5186714 2020-06-28 18:44:53 2020-06-28 19:15:46 2020-06-28 19:29:45 0:13:59 0:06:30 0:07:29 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5186715 2020-06-28 18:44:54 2020-06-28 19:15:48 2020-06-28 20:11:49 0:56:01 0:46:02 0:09:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5186716 2020-06-28 18:44:55 2020-06-28 19:16:07 2020-06-28 19:38:06 0:21:59 0:09:26 0:12:33 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5186717 2020-06-28 18:44:56 2020-06-28 19:17:33 2020-06-28 19:57:33 0:40:00 0:26:23 0:13:37 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 5186718 2020-06-28 18:44:57 2020-06-28 19:17:33 2020-06-28 19:35:32 0:17:59 0:11:14 0:06:45 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 5186719 2020-06-28 18:44:58 2020-06-28 19:17:33 2020-06-28 20:01:33 0:44:00 0:31:07 0:12:53 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186720 2020-06-28 18:44:59 2020-06-28 19:17:49 2020-06-28 20:47:49 1:30:00 1:19:18 0:10:42 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench} 2
pass 5186721 2020-06-28 18:44:59 2020-06-28 19:17:49 2020-06-28 19:33:48 0:15:59 0:08:24 0:07:35 smithi master centos 8.1 rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5186722 2020-06-28 18:45:00 2020-06-28 19:18:08 2020-06-28 19:36:08 0:18:00 0:09:47 0:08:13 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
pass 5186723 2020-06-28 18:45:01 2020-06-28 19:19:47 2020-06-28 19:47:46 0:27:59 0:20:06 0:07:53 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5186724 2020-06-28 18:45:02 2020-06-28 19:19:51 2020-06-28 19:39:50 0:19:59 0:11:38 0:08:21 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 5186725 2020-06-28 18:45:03 2020-06-28 19:21:24 2020-06-28 19:39:23 0:17:59 0:11:11 0:06:48 smithi master rhel 8.1 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{rhel_8}} 1
pass 5186726 2020-06-28 18:45:04 2020-06-28 19:21:24 2020-06-28 19:45:24 0:24:00 0:10:25 0:13:35 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186727 2020-06-28 18:45:05 2020-06-28 19:21:25 2020-06-28 20:01:25 0:40:00 0:29:00 0:11:00 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 5186728 2020-06-28 18:45:06 2020-06-28 19:21:49 2020-06-28 19:39:48 0:17:59 0:11:23 0:06:36 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 5186729 2020-06-28 18:45:07 2020-06-28 19:21:49 2020-06-28 19:49:49 0:28:00 0:22:12 0:05:48 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} 2
pass 5186730 2020-06-28 18:45:08 2020-06-28 19:23:25 2020-06-28 19:43:24 0:19:59 0:12:59 0:07:00 smithi master rhel 8.1 rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5186731 2020-06-28 18:45:09 2020-06-28 19:23:25 2020-06-28 19:49:25 0:26:00 0:16:47 0:09:13 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 5186732 2020-06-28 18:45:10 2020-06-28 19:23:25 2020-06-28 19:43:25 0:20:00 0:10:09 0:09:51 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5186733 2020-06-28 18:45:11 2020-06-28 19:24:10 2020-06-28 19:46:09 0:21:59 0:14:11 0:07:48 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/crash} 2
pass 5186734 2020-06-28 18:45:12 2020-06-28 19:25:28 2020-06-28 19:41:27 0:15:59 0:10:29 0:05:30 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 5186735 2020-06-28 18:45:12 2020-06-28 19:26:09 2020-06-28 20:02:09 0:36:00 0:28:25 0:07:35 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186736 2020-06-28 18:45:13 2020-06-28 19:26:10 2020-06-28 20:40:11 1:14:01 1:06:46 0:07:15 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5186737 2020-06-28 18:45:14 2020-06-28 19:27:11 2020-06-28 21:37:14 2:10:03 2:03:24 0:06:39 smithi master centos 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} 1
pass 5186738 2020-06-28 18:45:15 2020-06-28 19:27:23 2020-06-28 19:51:23 0:24:00 0:18:00 0:06:00 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5186739 2020-06-28 18:45:16 2020-06-28 19:27:48 2020-06-28 19:49:47 0:21:59 0:14:16 0:07:43 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 5186740 2020-06-28 18:45:17 2020-06-28 19:27:49 2020-06-28 19:45:48 0:17:59 0:12:31 0:05:28 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186741 2020-06-28 18:45:18 2020-06-28 19:27:57 2020-06-28 19:51:57 0:24:00 0:18:19 0:05:41 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 5186742 2020-06-28 18:45:19 2020-06-28 19:28:07 2020-06-28 20:02:07 0:34:00 0:21:35 0:12:25 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} 3
pass 5186743 2020-06-28 18:45:20 2020-06-28 19:29:07 2020-06-28 19:43:06 0:13:59 0:07:02 0:06:57 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186744 2020-06-28 18:45:21 2020-06-28 19:29:32 2020-06-28 19:49:32 0:20:00 0:10:53 0:09:07 smithi master centos 8.1 rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 5186745 2020-06-28 18:45:22 2020-06-28 19:29:46 2020-06-28 20:07:46 0:38:00 0:26:57 0:11:03 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 5186746 2020-06-28 18:45:23 2020-06-28 19:29:49 2020-06-28 19:43:48 0:13:59 0:07:37 0:06:22 smithi master ubuntu 18.04 rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186747 2020-06-28 18:45:24 2020-06-28 19:29:50 2020-06-28 19:59:50 0:30:00 0:22:18 0:07:42 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 5186748 2020-06-28 18:45:25 2020-06-28 19:29:55 2020-06-28 20:09:55 0:40:00 0:25:55 0:14:05 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186749 2020-06-28 18:45:26 2020-06-28 19:30:29 2020-06-28 19:58:29 0:28:00 0:20:55 0:07:05 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
pass 5186750 2020-06-28 18:45:26 2020-06-28 19:31:08 2020-06-28 20:13:09 0:42:01 0:31:04 0:10:57 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186751 2020-06-28 18:45:27 2020-06-28 19:31:15 2020-06-28 20:01:15 0:30:00 0:23:33 0:06:27 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 2
pass 5186752 2020-06-28 18:45:28 2020-06-28 19:31:25 2020-06-28 20:13:25 0:42:00 0:33:58 0:08:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5186753 2020-06-28 18:45:29 2020-06-28 19:32:27 2020-06-28 20:00:27 0:28:00 0:19:36 0:08:24 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5186754 2020-06-28 18:45:30 2020-06-28 19:33:10 2020-06-28 19:49:09 0:15:59 0:09:10 0:06:49 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5186755 2020-06-28 18:45:31 2020-06-28 19:34:05 2020-06-28 20:02:05 0:28:00 0:21:35 0:06:25 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5186756 2020-06-28 18:45:32 2020-06-28 19:34:05 2020-06-28 20:04:05 0:30:00 0:15:38 0:14:22 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186757 2020-06-28 18:45:33 2020-06-28 19:34:08 2020-06-28 20:06:08 0:32:00 0:23:39 0:08:21 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5186758 2020-06-28 18:45:34 2020-06-28 19:35:49 2020-06-28 19:57:49 0:22:00 0:16:08 0:05:52 smithi master centos 8.1 rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
fail 5186759 2020-06-28 18:45:35 2020-06-28 19:35:57 2020-06-28 20:35:57 1:00:00 0:51:03 0:08:57 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
Failure Reason:

failed to reach quorum size 9 before timeout expired

pass 5186760 2020-06-28 18:45:36 2020-06-28 19:36:09 2020-06-28 20:10:09 0:34:00 0:27:21 0:06:39 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 5186761 2020-06-28 18:45:36 2020-06-28 19:36:09 2020-06-28 19:56:09 0:20:00 0:13:07 0:06:53 smithi master rhel 8.1 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} 1
pass 5186762 2020-06-28 18:45:37 2020-06-28 19:36:37 2020-06-28 20:00:37 0:24:00 0:11:36 0:12:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5186763 2020-06-28 18:45:38 2020-06-28 19:38:05 2020-06-28 20:02:04 0:23:59 0:17:02 0:06:57 smithi master centos 8.1 rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5186764 2020-06-28 18:45:39 2020-06-28 19:38:05 2020-06-28 20:02:04 0:23:59 0:15:54 0:08:05 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/failover} 2
pass 5186765 2020-06-28 18:45:40 2020-06-28 19:38:07 2020-06-28 20:12:07 0:34:00 0:27:50 0:06:10 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} 1
pass 5186766 2020-06-28 18:45:41 2020-06-28 19:38:09 2020-06-28 20:14:09 0:36:00 0:25:02 0:10:58 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5186767 2020-06-28 18:45:42 2020-06-28 19:39:40 2020-06-28 20:09:40 0:30:00 0:23:41 0:06:19 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5186768 2020-06-28 18:45:43 2020-06-28 19:39:49 2020-06-28 20:07:49 0:28:00 0:16:30 0:11:30 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 5186769 2020-06-28 18:45:44 2020-06-28 19:39:51 2020-06-28 20:49:52 1:10:01 1:02:36 0:07:25 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5186770 2020-06-28 18:45:45 2020-06-28 19:41:23 2020-06-28 21:53:26 2:12:03 2:05:16 0:06:47 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} 1
pass 5186771 2020-06-28 18:45:46 2020-06-28 19:41:28 2020-06-28 20:25:28 0:44:00 0:32:23 0:11:37 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} 3
pass 5186772 2020-06-28 18:45:47 2020-06-28 19:41:49 2020-06-28 20:01:49 0:20:00 0:13:09 0:06:51 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 5186773 2020-06-28 18:45:47 2020-06-28 19:42:09 2020-06-28 20:06:08 0:23:59 0:16:48 0:07:11 smithi master rhel 8.1 rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5186774 2020-06-28 18:45:48 2020-06-28 19:42:57 2020-06-28 19:56:56 0:13:59 0:06:51 0:07:08 smithi master ubuntu 18.04 rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 5186775 2020-06-28 18:45:49 2020-06-28 19:43:07 2020-06-28 20:19:07 0:36:00 0:24:33 0:11:27 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5186776 2020-06-28 18:45:50 2020-06-28 19:43:25 2020-06-28 20:17:25 0:34:00 0:26:30 0:07:30 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5186777 2020-06-28 18:45:51 2020-06-28 19:43:26 2020-06-28 20:01:25 0:17:59 0:10:00 0:07:59 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5186778 2020-06-28 18:45:52 2020-06-28 19:43:26 2020-06-28 21:57:29 2:14:03 2:05:34 0:08:29 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
pass 5186779 2020-06-28 18:45:53 2020-06-28 19:43:49 2020-06-28 19:55:48 0:11:59 0:07:14 0:04:45 smithi master centos 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} 1
pass 5186780 2020-06-28 18:45:54 2020-06-28 19:43:50 2020-06-28 20:17:49 0:33:59 0:26:26 0:07:33 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 5186781 2020-06-28 18:45:55 2020-06-28 19:43:50 2020-06-28 20:23:50 0:40:00 0:32:55 0:07:05 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186782 2020-06-28 18:45:56 2020-06-28 19:44:24 2020-06-28 20:02:23 0:17:59 0:12:07 0:05:52 smithi master rhel 8.1 rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5186783 2020-06-28 18:45:57 2020-06-28 19:45:39 2020-06-28 20:13:39 0:28:00 0:10:36 0:17:24 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186784 2020-06-28 18:45:58 2020-06-28 19:45:39 2020-06-28 20:17:39 0:32:00 0:24:11 0:07:49 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5186785 2020-06-28 18:45:59 2020-06-28 19:45:49 2020-06-28 20:11:49 0:26:00 0:18:48 0:07:12 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 5186786 2020-06-28 18:46:00 2020-06-28 19:45:54 2020-06-28 20:05:53 0:19:59 0:12:53 0:07:06 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5186787 2020-06-28 18:46:01 2020-06-28 19:45:55 2020-06-28 20:23:55 0:38:00 0:30:53 0:07:07 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} 2
pass 5186788 2020-06-28 18:46:02 2020-06-28 19:46:09 2020-06-28 20:22:09 0:36:00 0:28:35 0:07:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 5186789 2020-06-28 18:46:02 2020-06-28 19:46:10 2020-06-28 20:04:10 0:18:00 0:09:20 0:08:40 smithi master ubuntu 18.04 rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 5186790 2020-06-28 18:46:03 2020-06-28 19:47:59 2020-06-28 20:05:58 0:17:59 0:10:14 0:07:45 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} 2
pass 5186791 2020-06-28 18:46:04 2020-06-28 19:47:59 2020-06-28 20:05:58 0:17:59 0:10:29 0:07:30 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup_tier} 2
pass 5186792 2020-06-28 18:46:05 2020-06-28 19:48:09 2020-06-28 20:06:08 0:17:59 0:11:00 0:06:59 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/insights} 2
pass 5186793 2020-06-28 18:46:06 2020-06-28 19:49:26 2020-06-28 20:21:26 0:32:00 0:25:53 0:06:07 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5186794 2020-06-28 18:46:07 2020-06-28 19:49:26 2020-06-28 20:07:26 0:18:00 0:12:47 0:05:13 smithi master rhel 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}} 1
pass 5186795 2020-06-28 18:46:08 2020-06-28 19:49:26 2020-06-28 20:25:27 0:36:01 0:26:21 0:09:40 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5186796 2020-06-28 18:46:09 2020-06-28 19:49:33 2020-06-28 20:03:32 0:13:59 0:06:59 0:07:00 smithi master centos 8.1 rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5186797 2020-06-28 18:46:10 2020-06-28 19:49:49 2020-06-28 20:29:49 0:40:00 0:27:33 0:12:27 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
pass 5186798 2020-06-28 18:46:11 2020-06-28 19:49:50 2020-06-28 21:25:52 1:36:02 1:12:48 0:23:14 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} 3
pass 5186799 2020-06-28 18:46:12 2020-06-28 19:49:52 2020-06-28 20:09:51 0:19:59 0:11:16 0:08:43 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 5186800 2020-06-28 18:46:13 2020-06-28 19:50:10 2020-06-28 20:06:09 0:15:59 0:09:25 0:06:34 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5186801 2020-06-28 18:46:14 2020-06-28 19:51:39 2020-06-28 20:09:39 0:18:00 0:06:54 0:11:06 smithi master ubuntu 18.04 rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5186802 2020-06-28 18:46:14 2020-06-28 19:51:58 2020-06-28 20:27:58 0:36:00 0:27:52 0:08:08 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5186803 2020-06-28 18:46:15 2020-06-28 19:54:07 2020-06-28 20:42:07 0:48:00 0:39:27 0:08:33 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5186804 2020-06-28 18:46:16 2020-06-28 19:54:09 2020-06-28 21:04:10 1:10:01 1:01:24 0:08:37 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5186805 2020-06-28 18:46:17 2020-06-28 19:54:10 2020-06-28 20:06:09 0:11:59 0:06:04 0:05:55 smithi master centos 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} 1
pass 5186806 2020-06-28 18:46:18 2020-06-28 19:56:06 2020-06-28 20:16:06 0:20:00 0:13:11 0:06:49 smithi master centos 8.1 rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 5186807 2020-06-28 18:46:19 2020-06-28 19:56:08 2020-06-28 21:20:10 1:24:02 1:16:51 0:07:11 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 5186808 2020-06-28 18:46:20 2020-06-28 19:56:09 2020-06-28 20:34:09 0:38:00 0:26:46 0:11:14 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186809 2020-06-28 18:46:21 2020-06-28 19:56:10 2020-06-28 20:16:10 0:20:00 0:11:29 0:08:31 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 5186810 2020-06-28 18:46:22 2020-06-28 19:56:58 2020-06-28 20:50:58 0:54:00 0:48:06 0:05:54 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} 1
pass 5186811 2020-06-28 18:46:23 2020-06-28 19:57:01 2020-06-28 20:19:00 0:21:59 0:10:09 0:11:50 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186812 2020-06-28 18:46:23 2020-06-28 19:57:49 2020-06-28 20:29:49 0:32:00 0:26:09 0:05:51 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186813 2020-06-28 18:46:24 2020-06-28 19:57:50 2020-06-28 20:15:50 0:18:00 0:11:15 0:06:45 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} 2
pass 5186814 2020-06-28 18:46:25 2020-06-28 19:58:30 2020-06-28 20:36:30 0:38:00 0:30:54 0:07:06 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5186815 2020-06-28 18:46:26 2020-06-28 20:00:06 2020-06-28 20:14:05 0:13:59 0:07:56 0:06:03 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} 1
pass 5186816 2020-06-28 18:46:27 2020-06-28 20:00:28 2020-06-28 20:20:27 0:19:59 0:13:14 0:06:45 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
pass 5186817 2020-06-28 18:46:28 2020-06-28 20:00:38 2020-06-28 20:46:38 0:46:00 0:38:55 0:07:05 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 5186818 2020-06-28 18:46:29 2020-06-28 20:01:31 2020-06-28 20:33:31 0:32:00 0:25:44 0:06:16 smithi master centos 8.1 rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
fail 5186819 2020-06-28 18:46:30 2020-06-28 20:01:31 2020-06-28 20:15:30 0:13:59 0:06:55 0:07:04 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
Failure Reason:

Command failed on smithi136 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh'

pass 5186820 2020-06-28 18:46:31 2020-06-28 20:01:31 2020-06-28 20:23:30 0:21:59 0:15:11 0:06:48 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 5186821 2020-06-28 18:46:31 2020-06-28 20:01:34 2020-06-28 20:19:34 0:18:00 0:10:56 0:07:04 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5186822 2020-06-28 18:46:32 2020-06-28 20:01:50 2020-06-28 20:37:50 0:36:00 0:26:41 0:09:19 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
fail 5186823 2020-06-28 18:46:33 2020-06-28 20:02:05 2020-06-28 20:26:05 0:24:00 0:18:00 0:06:00 smithi master rhel 8.1 rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-06-28T20:18:10.263157+0000 mon.a (mon.0) 53 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5186824 2020-06-28 18:46:34 2020-06-28 20:02:06 2020-06-28 20:22:05 0:19:59 0:12:12 0:07:47 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 5186825 2020-06-28 18:46:35 2020-06-28 20:02:06 2020-06-28 20:26:06 0:24:00 0:15:24 0:08:36 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} 2
pass 5186826 2020-06-28 18:46:36 2020-06-28 20:02:08 2020-06-28 20:28:08 0:26:00 0:19:31 0:06:29 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
fail 5186827 2020-06-28 18:46:37 2020-06-28 20:02:10 2020-06-28 20:46:11 0:44:01 0:28:01 0:16:00 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5186828 2020-06-28 18:46:38 2020-06-28 20:02:24 2020-06-28 20:36:24 0:34:00 0:25:59 0:08:01 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 5186829 2020-06-28 18:46:39 2020-06-28 20:03:48 2020-06-28 20:27:48 0:24:00 0:17:44 0:06:16 smithi master rhel 8.1 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} 1
pass 5186830 2020-06-28 18:46:40 2020-06-28 20:04:06 2020-06-28 20:28:06 0:24:00 0:18:02 0:05:58 smithi master ubuntu 18.04 rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5186831 2020-06-28 18:46:41 2020-06-28 20:04:09 2020-06-28 20:20:09 0:16:00 0:09:17 0:06:43 smithi master centos 8.1 rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
fail 5186832 2020-06-28 18:46:42 2020-06-28 20:04:11 2020-06-28 20:18:11 0:14:00 0:06:44 0:07:16 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
Failure Reason:

Command failed on smithi138 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh'

pass 5186833 2020-06-28 18:46:43 2020-06-28 20:06:11 2020-06-28 20:38:10 0:31:59 0:24:21 0:07:38 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} 2
pass 5186834 2020-06-28 18:46:44 2020-06-28 20:06:11 2020-06-28 20:38:10 0:31:59 0:25:51 0:06:08 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5186835 2020-06-28 18:46:45 2020-06-28 20:06:12 2020-06-28 20:26:10 0:19:58 0:09:49 0:10:09 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5186836 2020-06-28 18:46:46 2020-06-28 20:06:12 2020-06-28 21:00:11 0:53:59 0:45:07 0:08:52 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 5186837 2020-06-28 18:46:47 2020-06-28 20:06:12 2020-06-28 20:34:11 0:27:59 0:10:15 0:17:44 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186838 2020-06-28 18:46:48 2020-06-28 20:06:11 2020-06-28 21:16:12 1:10:01 1:02:22 0:07:39 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5186839 2020-06-28 18:46:48 2020-06-28 20:06:12 2020-06-28 20:24:10 0:17:58 0:11:21 0:06:37 smithi master centos 8.1 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 5186840 2020-06-28 18:46:49 2020-06-28 20:06:12 2020-06-28 20:32:11 0:25:59 0:18:19 0:07:40 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5186841 2020-06-28 18:46:50 2020-06-28 20:07:43 2020-06-28 20:45:43 0:38:00 0:26:57 0:11:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5186842 2020-06-28 18:46:51 2020-06-28 20:07:48 2020-06-28 20:39:48 0:32:00 0:25:35 0:06:25 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186843 2020-06-28 18:46:52 2020-06-28 20:07:50 2020-06-28 20:21:50 0:14:00 0:07:31 0:06:29 smithi master centos 8.1 rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 2
pass 5186844 2020-06-28 18:46:53 2020-06-28 20:09:00 2020-06-28 20:47:00 0:38:00 0:32:03 0:05:57 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5186845 2020-06-28 18:46:54 2020-06-28 20:09:17 2020-06-28 20:49:17 0:40:00 0:31:30 0:08:30 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5186846 2020-06-28 18:46:55 2020-06-28 20:09:40 2020-06-28 20:47:40 0:38:00 0:30:52 0:07:08 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} 2
pass 5186847 2020-06-28 18:46:56 2020-06-28 20:09:41 2020-06-28 20:43:41 0:34:00 0:27:24 0:06:36 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 5186848 2020-06-28 18:46:57 2020-06-28 20:09:53 2020-06-28 20:35:52 0:25:59 0:17:53 0:08:06 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5186849 2020-06-28 18:46:58 2020-06-28 20:09:57 2020-06-28 20:27:56 0:17:59 0:13:14 0:04:45 smithi master rhel 8.1 rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5186850 2020-06-28 18:46:58 2020-06-28 20:10:26 2020-06-28 20:30:25 0:19:59 0:11:44 0:08:15 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5186851 2020-06-28 18:46:59 2020-06-28 20:12:05 2020-06-28 20:44:05 0:32:00 0:25:43 0:06:17 smithi master rhel 8.1 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} 2
pass 5186852 2020-06-28 18:47:00 2020-06-28 20:12:05 2020-06-28 20:30:05 0:18:00 0:10:03 0:07:57 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 5186853 2020-06-28 18:47:01 2020-06-28 20:12:05 2020-06-28 20:32:05 0:20:00 0:13:03 0:06:57 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 5186854 2020-06-28 18:47:02 2020-06-28 20:12:08 2020-06-28 23:24:13 3:12:05 3:04:51 0:07:14 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 5186855 2020-06-28 18:47:03 2020-06-28 20:13:25 2020-06-28 20:41:25 0:28:00 0:20:47 0:07:13 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5186856 2020-06-28 18:47:04 2020-06-28 20:13:26 2020-06-28 20:37:26 0:24:00 0:16:01 0:07:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 5186857 2020-06-28 18:47:05 2020-06-28 20:13:40 2020-06-28 20:35:40 0:22:00 0:13:47 0:08:13 smithi master ubuntu 18.04 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
fail 5186858 2020-06-28 18:47:06 2020-06-28 20:14:07 2020-06-28 20:52:07 0:38:00 0:23:47 0:14:13 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5186859 2020-06-28 18:47:07 2020-06-28 20:14:11 2020-06-28 20:32:10 0:17:59 0:11:54 0:06:05 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 5186860 2020-06-28 18:47:08 2020-06-28 20:15:47 2020-06-28 20:29:47 0:14:00 0:06:29 0:07:31 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
pass 5186861 2020-06-28 18:47:09 2020-06-28 20:15:51 2020-06-28 20:43:51 0:28:00 0:22:05 0:05:55 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5186862 2020-06-28 18:47:10 2020-06-28 20:16:07 2020-06-28 20:38:07 0:22:00 0:10:47 0:11:13 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186863 2020-06-28 18:47:11 2020-06-28 20:16:11 2020-06-28 20:34:10 0:17:59 0:12:08 0:05:51 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5186864 2020-06-28 18:47:11 2020-06-28 20:17:43 2020-06-28 21:51:45 1:34:02 1:26:02 0:08:00 smithi master centos 8.1 rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 5186865 2020-06-28 18:47:12 2020-06-28 20:17:43 2020-06-28 20:43:43 0:26:00 0:18:42 0:07:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 5186866 2020-06-28 18:47:13 2020-06-28 20:17:51 2020-06-28 21:01:51 0:44:00 0:30:15 0:13:45 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186867 2020-06-28 18:47:14 2020-06-28 20:18:12 2020-06-28 20:46:12 0:28:00 0:20:17 0:07:43 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 5186868 2020-06-28 18:47:15 2020-06-28 20:19:18 2020-06-28 20:43:18 0:24:00 0:17:01 0:06:59 smithi master centos 8.1 rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} 1
pass 5186869 2020-06-28 18:47:16 2020-06-28 20:19:18 2020-06-28 20:51:18 0:32:00 0:23:01 0:08:59 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5186870 2020-06-28 18:47:17 2020-06-28 20:19:35 2020-06-28 20:53:35 0:34:00 0:26:56 0:07:04 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186871 2020-06-28 18:47:18 2020-06-28 20:20:10 2020-06-28 20:54:10 0:34:00 0:27:48 0:06:12 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 5186872 2020-06-28 18:47:19 2020-06-28 20:20:46 2020-06-28 20:48:46 0:28:00 0:21:24 0:06:36 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} 2
pass 5186873 2020-06-28 18:47:20 2020-06-28 20:21:29 2020-06-28 21:33:31 1:12:02 1:02:34 0:09:28 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5186874 2020-06-28 18:47:20 2020-06-28 20:22:07 2020-06-28 20:56:07 0:34:00 0:28:31 0:05:29 smithi master ubuntu 18.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 5186875 2020-06-28 18:47:21 2020-06-28 20:22:07 2020-06-28 20:56:07 0:34:00 0:24:05 0:09:55 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5186876 2020-06-28 18:47:22 2020-06-28 20:22:10 2020-06-28 20:56:10 0:34:00 0:21:38 0:12:22 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 5186877 2020-06-28 18:47:23 2020-06-28 20:23:48 2020-06-28 21:05:48 0:42:00 0:34:49 0:07:11 smithi master ubuntu 18.04 rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 5186878 2020-06-28 18:47:24 2020-06-28 20:23:54 2020-06-28 20:53:54 0:30:00 0:22:08 0:07:52 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 5186879 2020-06-28 18:47:25 2020-06-28 20:23:56 2020-06-28 20:41:56 0:18:00 0:10:58 0:07:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} 2
pass 5186880 2020-06-28 18:47:26 2020-06-28 20:24:14 2020-06-28 21:00:12 0:35:58 0:25:25 0:10:33 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5186881 2020-06-28 18:47:27 2020-06-28 20:25:44 2020-06-28 20:47:43 0:21:59 0:14:57 0:07:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup_tier} 2
pass 5186882 2020-06-28 18:47:28 2020-06-28 20:25:44 2020-06-28 20:45:43 0:19:59 0:10:08 0:09:51 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
pass 5186883 2020-06-28 18:47:29 2020-06-28 20:26:06 2020-06-28 20:46:06 0:20:00 0:11:41 0:08:19 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5186884 2020-06-28 18:47:30 2020-06-28 20:26:07 2020-06-28 20:58:07 0:32:00 0:23:26 0:08:34 smithi master rhel 8.1 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 2
pass 5186885 2020-06-28 18:47:31 2020-06-28 20:26:12 2020-06-28 21:06:12 0:40:00 0:32:15 0:07:45 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5186886 2020-06-28 18:47:32 2020-06-28 20:28:06 2020-06-28 20:46:06 0:18:00 0:12:03 0:05:57 smithi master rhel 8.1 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{rhel_8}} 1
pass 5186887 2020-06-28 18:47:32 2020-06-28 20:28:06 2020-06-28 21:02:06 0:34:00 0:26:06 0:07:54 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
fail 5186888 2020-06-28 18:47:33 2020-06-28 20:28:06 2020-06-28 21:12:07 0:44:01 0:24:49 0:19:12 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5186889 2020-06-28 18:47:34 2020-06-28 20:28:07 2020-06-28 21:20:08 0:52:01 0:44:48 0:07:13 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
fail 5186890 2020-06-28 18:47:35 2020-06-28 20:28:10 2020-06-28 20:52:09 0:23:59 0:15:40 0:08:19 smithi master ubuntu 18.04 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'

pass 5186891 2020-06-28 18:47:36 2020-06-28 20:28:54 2020-06-28 20:46:53 0:17:59 0:06:51 0:11:08 smithi master ubuntu 18.04 rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5186892 2020-06-28 18:47:37 2020-06-28 20:30:04 2020-06-28 20:50:03 0:19:59 0:10:53 0:09:06 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186893 2020-06-28 18:47:38 2020-06-28 20:30:04 2020-06-28 22:22:06 1:52:02 1:44:25 0:07:37 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 5186894 2020-06-28 18:47:39 2020-06-28 20:30:04 2020-06-28 21:54:05 1:24:01 1:17:39 0:06:22 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 5186895 2020-06-28 18:47:40 2020-06-28 20:30:06 2020-06-28 20:50:05 0:19:59 0:09:47 0:10:12 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5186896 2020-06-28 18:47:41 2020-06-28 20:30:27 2020-06-28 22:40:29 2:10:02 2:01:55 0:08:07 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
pass 5186897 2020-06-28 18:47:42 2020-06-28 20:32:21 2020-06-28 20:56:21 0:24:00 0:17:41 0:06:19 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 5186898 2020-06-28 18:47:43 2020-06-28 20:32:22 2020-06-28 20:48:21 0:15:59 0:10:08 0:05:51 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5186899 2020-06-28 18:47:44 2020-06-28 20:32:22 2020-06-28 20:56:21 0:23:59 0:17:13 0:06:46 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 5186900 2020-06-28 18:47:45 2020-06-28 20:33:10 2020-06-28 20:49:09 0:15:59 0:08:45 0:07:14 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_5925} 2
pass 5186901 2020-06-28 18:47:46 2020-06-28 20:33:46 2020-06-28 21:05:46 0:32:00 0:25:20 0:06:40 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5186902 2020-06-28 18:47:47 2020-06-28 20:33:46 2020-06-28 20:47:45 0:13:59 0:07:02 0:06:57 smithi master centos 8.1 rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5186903 2020-06-28 18:47:48 2020-06-28 20:34:11 2020-06-28 20:58:10 0:23:59 0:17:51 0:06:08 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 5186904 2020-06-28 18:47:49 2020-06-28 20:34:11 2020-06-28 22:52:14 2:18:03 2:11:17 0:06:46 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5186905 2020-06-28 18:47:49 2020-06-28 20:34:12 2020-06-28 21:08:11 0:33:59 0:27:23 0:06:36 smithi master centos 8.1 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_8}} 1
pass 5186906 2020-06-28 18:47:50 2020-06-28 20:34:13 2020-06-28 20:56:12 0:21:59 0:13:30 0:08:29 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 5186907 2020-06-28 18:47:51 2020-06-28 20:35:58 2020-06-28 21:47:59 1:12:01 1:05:10 0:06:51 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5186908 2020-06-28 18:47:52 2020-06-28 20:35:58 2020-06-29 01:20:04 4:44:06 4:28:57 0:15:09 smithi master centos 8.1 rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} 1
pass 5186909 2020-06-28 18:47:53 2020-06-28 20:35:59 2020-06-28 20:53:58 0:17:59 0:09:41 0:08:18 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5186910 2020-06-28 18:47:54 2020-06-28 20:36:26 2020-06-28 20:54:25 0:17:59 0:11:15 0:06:44 smithi master rhel 8.1 rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 5186911 2020-06-28 18:47:55 2020-06-28 20:36:31 2020-06-28 20:50:31 0:14:00 0:07:31 0:06:29 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
pass 5186912 2020-06-28 18:47:56 2020-06-28 20:37:44 2020-06-28 20:57:43 0:19:59 0:13:53 0:06:06 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 5186913 2020-06-28 18:47:57 2020-06-28 20:37:51 2020-06-28 20:53:51 0:16:00 0:10:20 0:05:40 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5186914 2020-06-28 18:47:58 2020-06-28 20:38:08 2020-06-28 21:04:07 0:25:59 0:19:05 0:06:54 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 5186915 2020-06-28 18:47:59 2020-06-28 20:38:12 2020-06-28 20:56:11 0:17:59 0:11:46 0:06:13 smithi master rhel 8.1 rados/singleton/{all/deduptool msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 5186916 2020-06-28 18:48:00 2020-06-28 20:38:12 2020-06-28 21:24:12 0:46:00 0:33:50 0:12:10 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} 3
pass 5186917 2020-06-28 18:48:01 2020-06-28 20:39:28 2020-06-28 21:07:27 0:27:59 0:19:56 0:08:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 5186918 2020-06-28 18:48:02 2020-06-28 20:39:49 2020-06-28 21:05:48 0:25:59 0:20:06 0:05:53 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5186919 2020-06-28 18:48:03 2020-06-28 20:39:51 2020-06-28 21:11:50 0:31:59 0:21:27 0:10:32 smithi master ubuntu 18.04 rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 5186920 2020-06-28 18:48:04 2020-06-28 20:40:12 2020-06-28 20:54:12 0:14:00 0:07:53 0:06:07 smithi master centos 8.1 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} 1
pass 5186921 2020-06-28 18:48:05 2020-06-28 20:41:41 2020-06-28 21:13:41 0:32:00 0:25:26 0:06:34 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 5186922 2020-06-28 18:48:06 2020-06-28 20:41:58 2020-06-28 21:01:57 0:19:59 0:10:14 0:09:45 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5186923 2020-06-28 18:48:07 2020-06-28 20:42:08 2020-06-28 21:02:08 0:20:00 0:13:00 0:07:00 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_python} 2
pass 5186924 2020-06-28 18:48:07 2020-06-28 20:43:35 2020-06-28 21:23:35 0:40:00 0:33:50 0:06:10 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5186925 2020-06-28 18:48:08 2020-06-28 20:43:42 2020-06-28 20:59:42 0:16:00 0:08:11 0:07:49 smithi master centos 8.1 rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5186926 2020-06-28 18:48:09 2020-06-28 20:43:44 2020-06-28 21:23:44 0:40:00 0:31:13 0:08:47 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5186927 2020-06-28 18:48:10 2020-06-28 20:43:52 2020-06-28 21:01:51 0:17:59 0:11:04 0:06:55 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 5186928 2020-06-28 18:48:11 2020-06-28 20:44:06 2020-06-28 21:18:06 0:34:00 0:27:08 0:06:52 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} 2
pass 5186929 2020-06-28 18:48:12 2020-06-28 20:46:00 2020-06-28 21:20:00 0:34:00 0:26:51 0:07:09 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2