Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5175103 2020-06-24 11:08:53 2020-06-24 11:09:31 2020-06-24 11:25:30 0:15:59 0:07:53 0:08:06 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} 2
pass 5175104 2020-06-24 11:08:54 2020-06-24 11:09:32 2020-06-24 11:37:31 0:27:59 0:15:39 0:12:20 smithi master rhel 8.1 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} 2
pass 5175105 2020-06-24 11:08:55 2020-06-24 11:09:31 2020-06-24 11:37:31 0:28:00 0:19:14 0:08:46 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5175106 2020-06-24 11:08:56 2020-06-24 11:11:31 2020-06-24 11:27:30 0:15:59 0:09:09 0:06:50 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175107 2020-06-24 11:08:57 2020-06-24 11:11:31 2020-06-24 11:29:30 0:17:59 0:09:07 0:08:52 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 5175108 2020-06-24 11:08:58 2020-06-24 11:11:31 2020-06-24 11:27:30 0:15:59 0:09:11 0:06:48 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5175109 2020-06-24 11:08:59 2020-06-24 11:12:55 2020-06-24 11:40:55 0:28:00 0:20:33 0:07:27 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 5175110 2020-06-24 11:09:00 2020-06-24 11:12:55 2020-06-24 11:40:55 0:28:00 0:21:26 0:06:34 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} 2
pass 5175111 2020-06-24 11:09:00 2020-06-24 11:12:57 2020-06-24 11:52:58 0:40:01 0:25:08 0:14:53 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175112 2020-06-24 11:09:01 2020-06-24 11:12:59 2020-06-24 11:34:59 0:22:00 0:11:16 0:10:44 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/failover} 2
pass 5175113 2020-06-24 11:09:02 2020-06-24 11:13:05 2020-06-24 11:27:05 0:14:00 0:08:04 0:05:56 smithi master centos 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{centos_8}} 1
pass 5175114 2020-06-24 11:09:03 2020-06-24 11:13:15 2020-06-24 11:31:15 0:18:00 0:12:16 0:05:44 smithi master ubuntu 18.04 rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175115 2020-06-24 11:09:04 2020-06-24 11:13:18 2020-06-24 11:59:18 0:46:00 0:29:49 0:16:11 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5175116 2020-06-24 11:09:04 2020-06-24 11:13:22 2020-06-24 11:57:22 0:44:00 0:34:02 0:09:58 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5175117 2020-06-24 11:09:05 2020-06-24 11:14:56 2020-06-24 11:42:56 0:28:00 0:12:32 0:15:28 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175118 2020-06-24 11:09:06 2020-06-24 11:14:56 2020-06-24 12:22:57 1:08:01 1:00:25 0:07:36 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5175119 2020-06-24 11:09:07 2020-06-24 11:15:10 2020-06-24 11:27:10 0:12:00 0:06:03 0:05:57 smithi master centos 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} 1
pass 5175120 2020-06-24 11:09:08 2020-06-24 11:15:18 2020-06-24 11:29:18 0:14:00 0:07:20 0:06:40 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5175121 2020-06-24 11:09:09 2020-06-24 11:17:08 2020-06-24 11:47:07 0:29:59 0:22:53 0:07:06 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5175122 2020-06-24 11:09:09 2020-06-24 11:17:08 2020-06-24 11:31:07 0:13:59 0:08:11 0:05:48 smithi master ubuntu 18.04 rados/singleton/{all/mon-config msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175123 2020-06-24 11:09:10 2020-06-24 11:17:09 2020-06-24 11:45:09 0:28:00 0:20:39 0:07:21 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
pass 5175124 2020-06-24 11:09:11 2020-06-24 11:17:10 2020-06-24 12:11:11 0:54:01 0:48:16 0:05:45 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
pass 5175125 2020-06-24 11:09:12 2020-06-24 11:17:11 2020-06-24 12:01:12 0:44:01 0:30:56 0:13:05 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5175126 2020-06-24 11:09:13 2020-06-24 11:19:06 2020-06-24 11:53:06 0:34:00 0:26:33 0:07:27 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 5175127 2020-06-24 11:09:14 2020-06-24 11:19:10 2020-06-24 11:59:10 0:40:00 0:30:53 0:09:07 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5175128 2020-06-24 11:09:15 2020-06-24 11:19:10 2020-06-24 11:59:10 0:40:00 0:33:43 0:06:17 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5175129 2020-06-24 11:09:16 2020-06-24 11:19:11 2020-06-24 11:39:11 0:20:00 0:11:59 0:08:01 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
pass 5175130 2020-06-24 11:09:17 2020-06-24 11:19:15 2020-06-24 11:35:15 0:16:00 0:10:21 0:05:39 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 5175131 2020-06-24 11:09:18 2020-06-24 11:21:03 2020-06-24 11:41:03 0:20:00 0:14:25 0:05:35 smithi master centos 8.1 rados/singleton/{all/osd-backfill msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 5175132 2020-06-24 11:09:19 2020-06-24 11:21:03 2020-06-24 11:35:02 0:13:59 0:08:17 0:05:42 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} 1
pass 5175133 2020-06-24 11:09:19 2020-06-24 11:21:04 2020-06-24 11:49:04 0:28:00 0:20:28 0:07:32 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} 2
pass 5175134 2020-06-24 11:09:20 2020-06-24 11:21:13 2020-06-24 11:39:13 0:18:00 0:11:04 0:06:56 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5175135 2020-06-24 11:09:21 2020-06-24 11:21:27 2020-06-24 11:35:26 0:13:59 0:06:51 0:07:08 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
fail 5175136 2020-06-24 11:09:22 2020-06-24 11:23:24 2020-06-24 12:11:25 0:48:01 0:40:31 0:07:30 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 5175137 2020-06-24 11:09:23 2020-06-24 11:23:24 2020-06-24 12:01:24 0:38:00 0:29:46 0:08:14 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175138 2020-06-24 11:09:24 2020-06-24 11:23:24 2020-06-24 11:43:24 0:20:00 0:11:17 0:08:43 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 5175139 2020-06-24 11:09:25 2020-06-24 11:23:28 2020-06-24 11:41:27 0:17:59 0:11:48 0:06:11 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5175140 2020-06-24 11:09:26 2020-06-24 11:23:30 2020-06-24 11:49:29 0:25:59 0:18:07 0:07:52 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5175141 2020-06-24 11:09:27 2020-06-24 11:25:14 2020-06-24 11:53:14 0:28:00 0:20:52 0:07:08 smithi master ubuntu 18.04 rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175142 2020-06-24 11:09:28 2020-06-24 11:25:14 2020-06-24 12:01:14 0:36:00 0:29:05 0:06:55 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5175143 2020-06-24 11:09:29 2020-06-24 11:25:14 2020-06-24 11:53:14 0:28:00 0:21:27 0:06:33 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5175144 2020-06-24 11:09:29 2020-06-24 11:25:14 2020-06-24 11:55:14 0:30:00 0:15:27 0:14:33 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175145 2020-06-24 11:09:30 2020-06-24 11:25:14 2020-06-24 11:43:14 0:18:00 0:10:12 0:07:48 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5175146 2020-06-24 11:09:31 2020-06-24 11:25:28 2020-06-24 11:47:27 0:21:59 0:13:48 0:08:11 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5175147 2020-06-24 11:09:32 2020-06-24 11:25:31 2020-06-24 11:47:31 0:22:00 0:16:45 0:05:15 smithi master rhel 8.1 rados/singleton/{all/osd-recovery msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5175148 2020-06-24 11:09:33 2020-06-24 11:27:10 2020-06-24 12:09:10 0:42:00 0:33:37 0:08:23 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5175149 2020-06-24 11:09:34 2020-06-24 11:27:10 2020-06-24 11:51:09 0:23:59 0:17:37 0:06:22 smithi master rhel 8.1 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} 1
pass 5175150 2020-06-24 11:09:35 2020-06-24 11:27:11 2020-06-24 11:45:10 0:17:59 0:09:07 0:08:52 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5175151 2020-06-24 11:09:36 2020-06-24 11:27:15 2020-06-24 11:43:15 0:16:00 0:09:25 0:06:35 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5175152 2020-06-24 11:09:36 2020-06-24 11:27:16 2020-06-24 12:35:17 1:08:01 1:00:21 0:07:40 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5175153 2020-06-24 11:09:37 2020-06-24 11:27:16 2020-06-24 11:47:16 0:20:00 0:11:42 0:08:18 smithi master centos 8.1 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 5175154 2020-06-24 11:09:38 2020-06-24 11:27:31 2020-06-24 11:51:31 0:24:00 0:17:27 0:06:33 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5175155 2020-06-24 11:09:39 2020-06-24 11:27:31 2020-06-24 11:59:31 0:32:00 0:21:43 0:10:17 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 5175156 2020-06-24 11:09:40 2020-06-24 11:29:36 2020-06-24 11:39:35 0:09:59 0:03:32 0:06:27 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5175157 2020-06-24 11:09:41 2020-06-24 12:35:34 2020-06-24 12:53:34 0:18:00 0:12:54 0:05:06 smithi master rhel 8.1 rados/singleton/{all/peer msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5175158 2020-06-24 11:09:42 2020-06-24 12:35:34 2020-06-24 12:57:34 0:22:00 0:14:37 0:07:23 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5175159 2020-06-24 11:09:43 2020-06-24 12:36:43 2020-06-24 13:06:42 0:29:59 0:19:00 0:10:59 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 5175160 2020-06-24 11:09:44 2020-06-24 12:36:58 2020-06-24 13:08:58 0:32:00 0:24:48 0:07:12 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5175161 2020-06-24 11:09:45 2020-06-24 12:37:01 2020-06-24 13:09:00 0:31:59 0:25:26 0:06:33 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5175162 2020-06-24 11:09:46 2020-06-24 12:37:16 2020-06-24 13:27:17 0:50:01 0:41:02 0:08:59 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 5175163 2020-06-24 11:09:47 2020-06-24 12:37:28 2020-06-24 12:51:28 0:14:00 0:06:30 0:07:30 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 5175164 2020-06-24 11:09:47 2020-06-24 12:37:29 2020-06-24 12:59:28 0:21:59 0:14:39 0:07:20 smithi master rhel 8.1 rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 2
pass 5175165 2020-06-24 11:09:48 2020-06-24 12:37:31 2020-06-24 13:11:31 0:34:00 0:27:10 0:06:50 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 5175166 2020-06-24 11:09:49 2020-06-24 12:37:32 2020-06-24 13:11:32 0:34:00 0:26:33 0:07:27 smithi master rhel 8.1 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} 2
pass 5175167 2020-06-24 11:09:50 2020-06-24 12:37:36 2020-06-24 13:05:36 0:28:00 0:22:13 0:05:47 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
dead 5175168 2020-06-24 11:09:51 2020-06-24 12:39:13 2020-06-25 00:41:41 12:02:28 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 5175169 2020-06-24 11:09:52 2020-06-24 12:39:13 2020-06-24 15:51:17 3:12:04 3:04:50 0:07:14 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
fail 5175170 2020-06-24 11:09:53 2020-06-24 12:39:18 2020-06-24 12:53:18 0:14:00 0:06:48 0:07:12 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
Failure Reason:

Command failed on smithi012 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh'

pass 5175171 2020-06-24 11:09:54 2020-06-24 12:39:23 2020-06-24 12:57:22 0:17:59 0:11:47 0:06:12 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
pass 5175172 2020-06-24 11:09:54 2020-06-24 12:39:28 2020-06-24 12:57:28 0:18:00 0:11:15 0:06:45 smithi master rhel 8.1 rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5175173 2020-06-24 11:09:55 2020-06-24 12:39:29 2020-06-24 13:17:29 0:38:00 0:24:11 0:13:49 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175174 2020-06-24 11:09:56 2020-06-24 12:41:39 2020-06-24 13:21:39 0:40:00 0:33:20 0:06:40 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
pass 5175175 2020-06-24 11:09:57 2020-06-24 12:41:39 2020-06-24 13:13:39 0:32:00 0:23:48 0:08:12 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5175176 2020-06-24 11:09:58 2020-06-24 12:41:39 2020-06-24 13:01:38 0:19:59 0:13:26 0:06:33 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 5175177 2020-06-24 11:09:59 2020-06-24 12:41:39 2020-06-24 13:07:38 0:25:59 0:19:31 0:06:28 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
pass 5175178 2020-06-24 11:09:59 2020-06-24 12:41:39 2020-06-24 13:05:39 0:24:00 0:18:04 0:05:56 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5175179 2020-06-24 11:10:00 2020-06-24 12:41:39 2020-06-24 13:01:38 0:19:59 0:13:58 0:06:01 smithi master ubuntu 18.04 rados/singleton/{all/radostool msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175180 2020-06-24 11:10:01 2020-06-24 12:43:34 2020-06-24 13:11:33 0:27:59 0:21:41 0:06:18 smithi master rhel 8.1 rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} 1
pass 5175181 2020-06-24 11:10:02 2020-06-24 12:43:34 2020-06-24 13:03:33 0:19:59 0:13:49 0:06:10 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5175182 2020-06-24 11:10:03 2020-06-24 12:43:34 2020-06-24 13:17:34 0:34:00 0:26:55 0:07:05 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5175183 2020-06-24 11:10:04 2020-06-24 12:43:34 2020-06-24 16:01:39 3:18:05 3:10:16 0:07:49 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
fail 5175184 2020-06-24 11:10:04 2020-06-24 12:43:36 2020-06-24 12:57:36 0:14:00 0:06:42 0:07:18 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
Failure Reason:

Command failed on smithi083 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh'

pass 5175185 2020-06-24 11:10:05 2020-06-24 12:45:30 2020-06-24 13:57:31 1:12:01 1:05:12 0:06:49 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5175186 2020-06-24 11:10:06 2020-06-24 12:45:30 2020-06-24 13:19:30 0:34:00 0:26:26 0:07:34 smithi master rhel 8.1 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 5175187 2020-06-24 11:10:07 2020-06-24 12:45:33 2020-06-24 13:21:33 0:36:00 0:26:36 0:09:24 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5175188 2020-06-24 11:10:08 2020-06-24 12:45:33 2020-06-24 13:15:33 0:30:00 0:21:56 0:08:04 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5175189 2020-06-24 11:10:09 2020-06-24 12:45:38 2020-06-24 13:01:38 0:16:00 0:08:43 0:07:17 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5175190 2020-06-24 11:10:10 2020-06-24 12:46:58 2020-06-24 13:22:58 0:36:00 0:29:50 0:06:10 smithi master rhel 8.1 rados/singleton/{all/random-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
pass 5175191 2020-06-24 11:10:11 2020-06-24 12:47:33 2020-06-24 13:21:33 0:34:00 0:26:51 0:07:09 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 5175192 2020-06-24 11:10:11 2020-06-24 12:47:34 2020-06-24 13:17:34 0:30:00 0:24:29 0:05:31 smithi master centos 8.1 rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5175193 2020-06-24 11:10:12 2020-06-24 12:47:34 2020-06-24 13:07:34 0:20:00 0:13:08 0:06:52 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
pass 5175194 2020-06-24 11:10:13 2020-06-24 12:47:38 2020-06-24 13:09:37 0:21:59 0:14:31 0:07:28 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} 2
pass 5175195 2020-06-24 11:10:14 2020-06-24 12:47:38 2020-06-24 13:21:37 0:33:59 0:28:46 0:05:13 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5175196 2020-06-24 11:10:15 2020-06-24 12:48:42 2020-06-24 13:16:41 0:27:59 0:21:12 0:06:47 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175197 2020-06-24 11:10:16 2020-06-24 12:49:14 2020-06-24 13:07:14 0:18:00 0:12:10 0:05:50 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
fail 5175198 2020-06-24 11:10:17 2020-06-24 12:49:29 2020-06-24 13:13:28 0:23:59 0:17:30 0:06:29 smithi master rhel 8.1 rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-06-24T13:05:03.453889+0000 mon.a (mon.0) 53 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5175199 2020-06-24 11:10:18 2020-06-24 12:49:30 2020-06-24 13:17:30 0:28:00 0:22:10 0:05:50 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 5175200 2020-06-24 11:10:19 2020-06-24 12:49:33 2020-06-24 13:03:32 0:13:59 0:07:01 0:06:58 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175201 2020-06-24 11:10:20 2020-06-24 12:49:37 2020-06-24 13:07:37 0:18:00 0:11:38 0:06:22 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5175202 2020-06-24 11:10:20 2020-06-24 12:51:27 2020-06-24 13:09:26 0:17:59 0:10:29 0:07:30 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175203 2020-06-24 11:10:21 2020-06-24 12:51:27 2020-06-24 13:19:26 0:27:59 0:22:07 0:05:52 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_python} 2
fail 5175204 2020-06-24 11:10:22 2020-06-24 12:51:28 2020-06-24 13:15:28 0:24:00 0:15:23 0:08:37 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
Failure Reason:

"2020-06-24T13:04:14.722440+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4148.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e19) initiated 2020-06-24T13:03:43.718567+0000 currently delayed" in cluster log

pass 5175205 2020-06-24 11:10:23 2020-06-24 12:51:29 2020-06-24 13:19:29 0:28:00 0:20:53 0:07:07 smithi master rhel 8.1 rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5175206 2020-06-24 11:10:24 2020-06-24 12:53:34 2020-06-24 13:11:33 0:17:59 0:12:07 0:05:52 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
pass 5175207 2020-06-24 11:10:25 2020-06-24 12:53:34 2020-06-24 14:01:35 1:08:01 1:00:50 0:07:11 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 5175208 2020-06-24 11:10:26 2020-06-24 12:53:35 2020-06-24 13:29:34 0:35:59 0:26:00 0:09:59 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5175209 2020-06-24 11:10:26 2020-06-24 12:53:34 2020-06-24 13:11:34 0:18:00 0:12:02 0:05:58 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5175210 2020-06-24 11:10:27 2020-06-24 12:53:35 2020-06-24 14:17:36 1:24:01 1:17:44 0:06:17 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
pass 5175211 2020-06-24 11:10:28 2020-06-24 12:53:35 2020-06-24 13:17:35 0:24:00 0:14:20 0:09:40 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5175212 2020-06-24 11:10:29 2020-06-24 12:55:44 2020-06-24 13:11:43 0:15:59 0:10:32 0:05:27 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 5175213 2020-06-24 11:10:30 2020-06-24 12:57:14 2020-06-24 13:11:13 0:13:59 0:07:41 0:06:18 smithi master ubuntu 18.04 rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 5175214 2020-06-24 11:10:31 2020-06-24 12:57:23 2020-06-24 13:15:23 0:18:00 0:10:52 0:07:08 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5175215 2020-06-24 11:10:32 2020-06-24 12:57:24 2020-06-24 13:17:23 0:19:59 0:12:58 0:07:01 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5175216 2020-06-24 11:10:32 2020-06-24 12:57:29 2020-06-24 13:35:29 0:38:00 0:32:23 0:05:37 smithi master rhel 8.1 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} 1
pass 5175217 2020-06-24 11:10:33 2020-06-24 12:57:30 2020-06-24 13:25:30 0:28:00 0:21:44 0:06:16 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 5175218 2020-06-24 11:10:34 2020-06-24 12:57:31 2020-06-24 13:37:31 0:40:00 0:31:58 0:08:02 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 5175219 2020-06-24 11:10:35 2020-06-24 12:57:32 2020-06-24 13:39:32 0:42:00 0:34:35 0:07:25 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} 2
pass 5175220 2020-06-24 11:10:36 2020-06-24 12:57:33 2020-06-24 14:05:33 1:08:00 1:01:37 0:06:23 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
fail 5175221 2020-06-24 11:10:37 2020-06-24 12:57:35 2020-06-24 18:03:43 5:06:08 4:50:53 0:15:15 smithi master ubuntu 18.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed on smithi072 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\''

pass 5175222 2020-06-24 11:10:38 2020-06-24 12:57:37 2020-06-24 13:15:36 0:17:59 0:10:31 0:07:28 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
pass 5175223 2020-06-24 11:10:39 2020-06-24 12:57:47 2020-06-24 13:09:46 0:11:59 0:06:34 0:05:25 smithi master centos 8.1 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 5175224 2020-06-24 11:10:39 2020-06-24 12:59:28 2020-06-24 13:19:28 0:20:00 0:13:24 0:06:36 smithi master rhel 8.1 rados/singleton/{all/test-crash msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5175225 2020-06-24 11:10:40 2020-06-24 12:59:28 2020-06-24 13:09:27 0:09:59 0:03:43 0:06:16 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5175226 2020-06-24 11:10:41 2020-06-24 12:59:28 2020-06-24 13:37:28 0:38:00 0:31:55 0:06:05 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175227 2020-06-24 11:10:42 2020-06-24 12:59:29 2020-06-24 13:19:29 0:20:00 0:12:48 0:07:12 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5175228 2020-06-24 11:10:43 2020-06-24 12:59:31 2020-06-24 13:23:30 0:23:59 0:15:35 0:08:24 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 5175229 2020-06-24 11:10:44 2020-06-24 12:59:35 2020-06-24 13:23:35 0:24:00 0:16:40 0:07:20 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} 2
pass 5175230 2020-06-24 11:10:45 2020-06-24 13:01:47 2020-06-24 13:33:47 0:32:00 0:25:18 0:06:42 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5175231 2020-06-24 11:10:46 2020-06-24 13:01:48 2020-06-24 13:23:47 0:21:59 0:12:22 0:09:37 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175232 2020-06-24 11:10:46 2020-06-24 13:01:47 2020-06-24 13:27:47 0:26:00 0:18:50 0:07:10 smithi master rhel 8.1 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5175233 2020-06-24 11:10:47 2020-06-24 13:01:48 2020-06-24 13:21:47 0:19:59 0:11:27 0:08:32 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5175234 2020-06-24 11:10:48 2020-06-24 13:03:49 2020-06-24 13:21:49 0:18:00 0:09:50 0:08:10 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5175235 2020-06-24 11:10:49 2020-06-24 13:03:49 2020-06-24 13:41:49 0:38:00 0:29:28 0:08:32 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 5175236 2020-06-24 11:10:50 2020-06-24 13:05:44 2020-06-24 13:19:44 0:14:00 0:07:45 0:06:15 smithi master centos 8.1 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} 1
pass 5175237 2020-06-24 11:10:51 2020-06-24 13:05:44 2020-06-24 13:33:44 0:28:00 0:21:05 0:06:55 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5175238 2020-06-24 11:10:52 2020-06-24 13:05:44 2020-06-24 13:21:44 0:16:00 0:10:18 0:05:42 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup_tier} 2
pass 5175239 2020-06-24 11:10:53 2020-06-24 13:05:44 2020-06-24 14:43:46 1:38:02 1:30:34 0:07:28 smithi master rhel 8.1 rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 2
pass 5175240 2020-06-24 11:10:54 2020-06-24 13:06:59 2020-06-24 13:22:58 0:15:59 0:10:26 0:05:33 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5175241 2020-06-24 11:10:54 2020-06-24 13:07:15 2020-06-24 13:43:15 0:36:00 0:29:46 0:06:14 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5175242 2020-06-24 11:10:55 2020-06-24 13:07:31 2020-06-24 14:09:32 1:02:01 0:56:02 0:05:59 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
pass 5175243 2020-06-24 11:10:56 2020-06-24 13:07:32 2020-06-24 13:25:32 0:18:00 0:12:13 0:05:47 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5175244 2020-06-24 11:10:57 2020-06-24 13:07:35 2020-06-24 13:43:35 0:36:00 0:30:03 0:05:57 smithi master ubuntu 18.04 rados/singleton/{all/thrash-eio msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 2
pass 5175245 2020-06-24 11:10:58 2020-06-24 13:07:38 2020-06-24 13:25:37 0:17:59 0:11:25 0:06:34 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5175246 2020-06-24 11:10:59 2020-06-24 13:07:38 2020-06-24 13:23:38 0:16:00 0:09:55 0:06:05 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5175247 2020-06-24 11:11:00 2020-06-24 13:07:40 2020-06-24 13:39:40 0:32:00 0:25:52 0:06:08 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5175248 2020-06-24 11:11:01 2020-06-24 13:09:13 2020-06-24 13:37:13 0:28:00 0:21:13 0:06:47 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} 2
pass 5175249 2020-06-24 11:11:02 2020-06-24 13:09:13 2020-06-24 13:27:13 0:18:00 0:12:38 0:05:22 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 5175250 2020-06-24 11:11:02 2020-06-24 13:09:19 2020-06-24 13:23:19 0:14:00 0:06:43 0:07:17 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5175251 2020-06-24 11:11:03 2020-06-24 13:09:27 2020-06-24 13:35:27 0:26:00 0:19:26 0:06:34 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
fail 5175252 2020-06-24 11:11:04 2020-06-24 13:09:29 2020-06-24 14:43:31 1:34:02 1:28:08 0:05:54 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
Failure Reason:

"2020-06-24T13:24:43.895573+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4438.0:73 3.1e 3.9c77cd5e (undecoded) ondisk+read+known_if_redirected e20) initiated 2020-06-24T13:24:13.553265+0000 currently delayed" in cluster log

pass 5175253 2020-06-24 11:11:05 2020-06-24 13:09:30 2020-06-24 14:17:31 1:08:01 1:01:38 0:06:23 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5175254 2020-06-24 11:11:06 2020-06-24 13:09:33 2020-06-24 13:23:33 0:14:00 0:07:59 0:06:01 smithi master centos 8.1 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 5175255 2020-06-24 11:11:07 2020-06-24 13:09:35 2020-06-24 13:25:34 0:15:59 0:08:24 0:07:35 smithi master ubuntu 18.04 rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} 1
pass 5175256 2020-06-24 11:11:08 2020-06-24 13:09:38 2020-06-24 13:29:38 0:20:00 0:14:07 0:05:53 smithi master centos 8.1 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} 1
pass 5175257 2020-06-24 11:11:09 2020-06-24 13:09:47 2020-06-24 13:29:47 0:20:00 0:15:16 0:04:44 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
fail 5175258 2020-06-24 11:11:10 2020-06-24 13:10:00 2020-06-24 16:54:06 3:44:06 3:36:06 0:08:00 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
Failure Reason:

"2020-06-24T13:26:44.092689+0000 mon.b (mon.0) 310 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5175259 2020-06-24 11:11:11 2020-06-24 13:11:29 2020-06-24 13:35:29 0:24:00 0:18:50 0:05:10 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 5175260 2020-06-24 11:11:11 2020-06-24 13:11:29 2020-06-24 13:47:29 0:36:00 0:30:16 0:05:44 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175261 2020-06-24 11:11:12 2020-06-24 13:11:32 2020-06-24 13:39:32 0:28:00 0:20:39 0:07:21 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175262 2020-06-24 11:11:13 2020-06-24 13:11:32 2020-06-24 13:37:32 0:26:00 0:18:56 0:07:04 smithi master ubuntu 18.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 5175263 2020-06-24 11:11:14 2020-06-24 13:11:33 2020-06-24 13:29:32 0:17:59 0:11:16 0:06:43 smithi master ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} 2
pass 5175264 2020-06-24 11:11:15 2020-06-24 13:11:35 2020-06-24 13:37:34 0:25:59 0:19:09 0:06:50 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 5175265 2020-06-24 11:11:16 2020-06-24 13:11:35 2020-06-24 13:47:35 0:36:00 0:28:59 0:07:01 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175266 2020-06-24 11:11:17 2020-06-24 13:11:35 2020-06-24 13:29:34 0:17:59 0:10:47 0:07:12 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
fail 5175267 2020-06-24 11:11:18 2020-06-24 13:11:45 2020-06-24 13:37:44 0:25:59 0:17:25 0:08:34 smithi master rhel 8.1 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'

pass 5175268 2020-06-24 11:11:19 2020-06-24 13:13:45 2020-06-24 13:43:45 0:30:00 0:24:22 0:05:38 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5175269 2020-06-24 11:11:20 2020-06-24 13:13:45 2020-06-24 14:05:46 0:52:01 0:46:04 0:05:57 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5175270 2020-06-24 11:11:21 2020-06-24 13:13:45 2020-06-24 13:51:45 0:38:00 0:31:50 0:06:10 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5175271 2020-06-24 11:11:22 2020-06-24 13:15:40 2020-06-24 13:29:40 0:14:00 0:08:17 0:05:43 smithi master centos 8.1 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{centos_8}} 1
pass 5175272 2020-06-24 11:11:22 2020-06-24 13:15:40 2020-06-24 13:33:40 0:18:00 0:11:23 0:06:37 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5175273 2020-06-24 11:11:23 2020-06-24 13:15:40 2020-06-24 13:37:40 0:22:00 0:14:48 0:07:12 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
pass 5175274 2020-06-24 11:11:24 2020-06-24 13:15:40 2020-06-24 13:29:40 0:14:00 0:07:02 0:06:58 smithi master ubuntu 18.04 rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175275 2020-06-24 11:11:25 2020-06-24 13:15:40 2020-06-24 13:29:40 0:14:00 0:07:13 0:06:47 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5175276 2020-06-24 11:11:26 2020-06-24 13:17:24 2020-06-24 13:53:25 0:36:01 0:29:49 0:06:12 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 5175277 2020-06-24 11:11:27 2020-06-24 13:17:31 2020-06-24 13:35:30 0:17:59 0:11:47 0:06:12 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
pass 5175278 2020-06-24 11:11:28 2020-06-24 13:17:31 2020-06-24 13:37:30 0:19:59 0:13:35 0:06:24 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} 2
pass 5175279 2020-06-24 11:11:29 2020-06-24 13:17:34 2020-06-24 13:33:33 0:15:59 0:09:19 0:06:40 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 5175280 2020-06-24 11:11:30 2020-06-24 13:17:35 2020-06-24 14:39:37 1:22:02 1:14:56 0:07:06 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 5175281 2020-06-24 11:11:31 2020-06-24 13:17:35 2020-06-24 13:35:34 0:17:59 0:11:20 0:06:39 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5175282 2020-06-24 11:11:32 2020-06-24 13:17:36 2020-06-24 13:37:35 0:19:59 0:13:14 0:06:45 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5175283 2020-06-24 11:11:33 2020-06-24 13:19:44 2020-06-24 13:35:43 0:15:59 0:09:21 0:06:38 smithi master ubuntu 18.04 rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175284 2020-06-24 11:11:34 2020-06-24 13:19:44 2020-06-24 13:35:43 0:15:59 0:10:32 0:05:27 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5175285 2020-06-24 11:11:35 2020-06-24 13:19:44 2020-06-24 13:53:44 0:34:00 0:26:19 0:07:41 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175286 2020-06-24 11:11:36 2020-06-24 13:19:44 2020-06-24 13:41:43 0:21:59 0:15:06 0:06:53 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175287 2020-06-24 11:11:37 2020-06-24 13:19:44 2020-06-24 13:59:44 0:40:00 0:34:16 0:05:44 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5175288 2020-06-24 11:11:37 2020-06-24 13:19:45 2020-06-24 14:27:46 1:08:01 1:01:03 0:06:58 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5175289 2020-06-24 11:11:38 2020-06-24 13:21:49 2020-06-24 13:43:49 0:22:00 0:15:33 0:06:27 smithi master rhel 8.1 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} 1
pass 5175290 2020-06-24 11:11:39 2020-06-24 13:21:50 2020-06-24 13:41:49 0:19:59 0:13:20 0:06:39 smithi master rhel 8.1 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_8}} 1
pass 5175291 2020-06-24 11:11:40 2020-06-24 13:21:49 2020-06-24 13:35:49 0:14:00 0:07:25 0:06:35 smithi master centos 8.1 rados/singleton/{all/deduptool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5175292 2020-06-24 11:11:41 2020-06-24 13:21:50 2020-06-24 13:37:49 0:15:59 0:10:59 0:05:00 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 5175293 2020-06-24 11:11:42 2020-06-24 13:21:50 2020-06-24 13:45:49 0:23:59 0:17:56 0:06:03 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5175294 2020-06-24 11:11:43 2020-06-24 13:21:50 2020-06-24 13:57:50 0:36:00 0:30:03 0:05:57 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5175295 2020-06-24 11:11:44 2020-06-24 13:21:50 2020-06-24 13:37:49 0:15:59 0:10:33 0:05:26 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5175296 2020-06-24 11:11:45 2020-06-24 13:23:15 2020-06-24 14:05:15 0:42:00 0:35:45 0:06:15 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 5175297 2020-06-24 11:11:46 2020-06-24 13:23:15 2020-06-24 13:39:14 0:15:59 0:10:22 0:05:37 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 5175298 2020-06-24 11:11:47 2020-06-24 13:23:20 2020-06-24 13:41:19 0:17:59 0:13:18 0:04:41 smithi master rhel 8.1 rados/singleton/{all/divergent_priors msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5175299 2020-06-24 11:11:48 2020-06-24 13:23:32 2020-06-24 13:39:31 0:15:59 0:09:42 0:06:17 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5175300 2020-06-24 11:11:48 2020-06-24 13:23:34 2020-06-24 13:41:34 0:18:00 0:12:18 0:05:42 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
pass 5175301 2020-06-24 11:11:49 2020-06-24 13:23:36 2020-06-24 13:49:36 0:26:00 0:19:22 0:06:38 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
pass 5175302 2020-06-24 11:11:50 2020-06-24 13:23:39 2020-06-24 13:55:39 0:32:00 0:24:16 0:07:44 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 5175303 2020-06-24 11:11:51 2020-06-24 13:23:49 2020-06-24 14:23:49 1:00:00 0:54:03 0:05:57 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

pass 5175304 2020-06-24 11:11:52 2020-06-24 13:25:46 2020-06-24 13:35:45 0:09:59 0:03:29 0:06:30 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5175305 2020-06-24 11:11:53 2020-06-24 13:25:46 2020-06-24 13:43:46 0:18:00 0:12:19 0:05:41 smithi master rhel 8.1 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_8}} 1
pass 5175306 2020-06-24 11:11:54 2020-06-24 13:25:46 2020-06-24 13:39:45 0:13:59 0:08:32 0:05:27 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175307 2020-06-24 11:11:54 2020-06-24 13:25:46 2020-06-24 13:47:46 0:22:00 0:16:38 0:05:22 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/failover} 2
pass 5175308 2020-06-24 11:11:55 2020-06-24 13:27:30 2020-06-24 13:57:30 0:30:00 0:24:25 0:05:35 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5175309 2020-06-24 11:11:56 2020-06-24 13:27:30 2020-06-24 13:59:30 0:32:00 0:25:30 0:06:30 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} 2
pass 5175310 2020-06-24 11:11:57 2020-06-24 13:27:49 2020-06-24 13:41:48 0:13:59 0:06:51 0:07:08 smithi master centos 8.1 rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 5175311 2020-06-24 11:11:58 2020-06-24 13:29:49 2020-06-24 13:47:48 0:17:59 0:12:18 0:05:41 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 5175312 2020-06-24 11:11:59 2020-06-24 13:29:50 2020-06-24 14:05:50 0:36:00 0:25:58 0:10:02 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5175313 2020-06-24 11:12:00 2020-06-24 13:29:49 2020-06-24 13:57:49 0:28:00 0:20:18 0:07:42 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175314 2020-06-24 11:12:01 2020-06-24 13:29:49 2020-06-24 13:47:48 0:17:59 0:10:52 0:07:07 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 5175315 2020-06-24 11:12:02 2020-06-24 13:29:49 2020-06-24 14:03:49 0:34:00 0:25:39 0:08:21 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175316 2020-06-24 11:12:02 2020-06-24 13:29:49 2020-06-24 13:43:48 0:13:59 0:08:12 0:05:47 smithi master ubuntu 18.04 rados/singleton/{all/dump-stuck msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175317 2020-06-24 11:12:03 2020-06-24 13:29:50 2020-06-24 14:41:50 1:12:00 1:02:27 0:09:33 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5175318 2020-06-24 11:12:04 2020-06-24 13:29:50 2020-06-24 13:47:49 0:17:59 0:11:07 0:06:52 smithi master rhel 8.1 rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} 1
pass 5175319 2020-06-24 11:12:05 2020-06-24 13:33:49 2020-06-24 13:51:49 0:18:00 0:11:44 0:06:16 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
pass 5175320 2020-06-24 11:12:06 2020-06-24 13:33:50 2020-06-24 13:49:49 0:15:59 0:09:09 0:06:50 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5175321 2020-06-24 11:12:07 2020-06-24 13:33:50 2020-06-24 13:45:49 0:11:59 0:06:08 0:05:51 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} 1
pass 5175322 2020-06-24 11:12:07 2020-06-24 13:33:50 2020-06-24 14:17:50 0:44:00 0:38:12 0:05:48 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5175323 2020-06-24 11:12:08 2020-06-24 13:35:44 2020-06-24 14:03:43 0:27:59 0:21:35 0:06:24 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
pass 5175324 2020-06-24 11:12:09 2020-06-24 13:35:44 2020-06-24 14:13:44 0:38:00 0:31:09 0:06:51 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
pass 5175325 2020-06-24 11:12:10 2020-06-24 13:35:44 2020-06-24 14:13:44 0:38:00 0:32:11 0:05:49 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5175326 2020-06-24 11:12:11 2020-06-24 13:35:44 2020-06-24 13:51:43 0:15:59 0:09:51 0:06:08 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 5175327 2020-06-24 11:12:12 2020-06-24 13:35:43 2020-06-24 14:11:43 0:36:00 0:28:49 0:07:11 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175328 2020-06-24 11:12:12 2020-06-24 13:35:44 2020-06-24 13:57:44 0:22:00 0:14:44 0:07:16 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5175329 2020-06-24 11:12:13 2020-06-24 13:35:44 2020-06-24 13:57:44 0:22:00 0:15:23 0:06:37 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 5175330 2020-06-24 11:12:14 2020-06-24 13:35:46 2020-06-24 13:57:46 0:22:00 0:15:41 0:06:19 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5175331 2020-06-24 11:12:15 2020-06-24 13:35:50 2020-06-24 13:53:50 0:18:00 0:11:27 0:06:33 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
pass 5175332 2020-06-24 11:12:16 2020-06-24 13:37:29 2020-06-24 13:49:29 0:12:00 0:06:12 0:05:48 smithi master centos 8.1 rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5175333 2020-06-24 11:12:17 2020-06-24 13:37:29 2020-06-24 13:57:29 0:20:00 0:13:37 0:06:23 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5175334 2020-06-24 11:12:18 2020-06-24 13:37:32 2020-06-24 13:55:31 0:17:59 0:11:05 0:06:54 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/insights} 2
pass 5175335 2020-06-24 11:12:18 2020-06-24 13:37:32 2020-06-24 13:53:32 0:16:00 0:09:13 0:06:47 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5175336 2020-06-24 11:12:19 2020-06-24 13:37:33 2020-06-24 13:53:33 0:16:00 0:10:03 0:05:57 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5175337 2020-06-24 11:12:20 2020-06-24 13:37:36 2020-06-24 14:23:36 0:46:00 0:40:29 0:05:31 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 5175338 2020-06-24 11:12:21 2020-06-24 13:37:37 2020-06-24 14:03:36 0:25:59 0:19:36 0:06:23 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175339 2020-06-24 11:12:22 2020-06-24 13:37:41 2020-06-24 13:51:40 0:13:59 0:06:43 0:07:16 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5175340 2020-06-24 11:12:23 2020-06-24 13:37:46 2020-06-24 14:13:46 0:36:00 0:29:38 0:06:22 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 5175341 2020-06-24 11:12:23 2020-06-24 13:37:50 2020-06-24 13:51:50 0:14:00 0:06:54 0:07:06 smithi master centos 8.1 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} 1
pass 5175342 2020-06-24 11:12:24 2020-06-24 13:37:51 2020-06-24 14:09:51 0:32:00 0:26:22 0:05:38 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 5175343 2020-06-24 11:12:25 2020-06-24 13:39:20 2020-06-24 14:09:20 0:30:00 0:22:29 0:07:31 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_python} 2
pass 5175344 2020-06-24 11:12:26 2020-06-24 13:39:20 2020-06-24 14:15:20 0:36:00 0:29:17 0:06:43 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175345 2020-06-24 11:12:27 2020-06-24 13:39:32 2020-06-24 13:55:32 0:16:00 0:09:12 0:06:48 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5175346 2020-06-24 11:12:28 2020-06-24 13:39:33 2020-06-24 13:59:33 0:20:00 0:14:20 0:05:40 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
pass 5175347 2020-06-24 11:12:29 2020-06-24 13:39:33 2020-06-24 14:13:33 0:34:00 0:27:50 0:06:10 smithi master centos 8.1 rados/singleton/{all/lost-unfound msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5175348 2020-06-24 11:12:30 2020-06-24 13:39:41 2020-06-24 13:57:41 0:18:00 0:12:49 0:05:11 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5175349 2020-06-24 11:12:30 2020-06-24 13:39:46 2020-06-24 14:01:46 0:22:00 0:15:12 0:06:48 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 5175350 2020-06-24 11:12:31 2020-06-24 13:41:36 2020-06-24 14:09:36 0:28:00 0:21:55 0:06:05 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 5175351 2020-06-24 11:12:32 2020-06-24 13:41:36 2020-06-24 14:51:37 1:10:01 1:02:29 0:07:32 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5175352 2020-06-24 11:12:33 2020-06-24 13:41:44 2020-06-24 16:29:48 2:48:04 2:41:31 0:06:33 smithi master rhel 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 5175353 2020-06-24 11:12:34 2020-06-24 13:41:49 2020-06-24 14:07:49 0:26:00 0:19:32 0:06:28 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5175354 2020-06-24 11:12:35 2020-06-24 13:41:51 2020-06-24 14:11:50 0:29:59 0:23:27 0:06:32 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5175355 2020-06-24 11:12:36 2020-06-24 13:41:51 2020-06-24 14:11:50 0:29:59 0:23:37 0:06:22 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5175356 2020-06-24 11:12:36 2020-06-24 13:43:32 2020-06-24 14:01:32 0:18:00 0:12:50 0:05:10 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
fail 5175357 2020-06-24 11:12:37 2020-06-24 13:43:36 2020-06-24 14:01:36 0:18:00 0:11:18 0:06:42 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-06-24T13:57:19.366847+0000 mon.a (mon.0) 48 : cluster [ERR] Health check failed: 4 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

pass 5175358 2020-06-24 11:12:38 2020-06-24 13:43:46 2020-06-24 14:01:46 0:18:00 0:12:00 0:06:00 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5175359 2020-06-24 11:12:39 2020-06-24 13:43:47 2020-06-24 14:01:46 0:17:59 0:12:16 0:05:43 smithi master rhel 8.1 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} 1
pass 5175360 2020-06-24 11:12:40 2020-06-24 13:43:49 2020-06-24 14:13:49 0:30:00 0:22:34 0:07:26 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5175361 2020-06-24 11:12:41 2020-06-24 13:43:50 2020-06-24 14:21:50 0:38:00 0:31:00 0:07:00 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 5175362 2020-06-24 11:12:42 2020-06-24 13:46:06 2020-06-24 15:16:08 1:30:02 1:22:35 0:07:27 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi173 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=266dcf5a85ae7f9cdc6d0ebd0d198fa1c4d255cd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5175363 2020-06-24 11:12:43 2020-06-24 13:46:06 2020-06-24 14:18:06 0:32:00 0:25:32 0:06:28 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 5175364 2020-06-24 11:12:44 2020-06-24 13:47:47 2020-06-24 14:05:46 0:17:59 0:11:07 0:06:52 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
fail 5175365 2020-06-24 11:12:44 2020-06-24 13:47:47 2020-06-24 14:25:47 0:38:00 0:31:18 0:06:42 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/module_selftest} 2
Failure Reason:

"2020-06-24T14:15:35.476982+0000 mds.b (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi032:z (6678), after 304.552 seconds" in cluster log

pass 5175366 2020-06-24 11:12:45 2020-06-24 13:47:47 2020-06-24 14:05:46 0:17:59 0:10:49 0:07:10 smithi master centos 8.1 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5175367 2020-06-24 11:12:46 2020-06-24 13:47:49 2020-06-24 14:05:49 0:18:00 0:11:11 0:06:49 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5175368 2020-06-24 11:12:47 2020-06-24 13:47:50 2020-06-24 14:25:50 0:38:00 0:30:01 0:07:59 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5175369 2020-06-24 11:12:48 2020-06-24 13:47:51 2020-06-24 14:23:50 0:35:59 0:28:24 0:07:35 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
pass 5175370 2020-06-24 11:12:49 2020-06-24 13:49:46 2020-06-24 14:07:46 0:18:00 0:11:46 0:06:14 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 5175371 2020-06-24 11:12:50 2020-06-24 13:49:46 2020-06-24 13:59:46 0:10:00 0:03:35 0:06:25 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5175372 2020-06-24 11:12:51 2020-06-24 13:49:50 2020-06-24 14:27:50 0:38:00 0:29:31 0:08:29 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5175373 2020-06-24 11:12:52 2020-06-24 13:51:57 2020-06-24 14:23:57 0:32:00 0:25:51 0:06:09 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5175374 2020-06-24 11:12:53 2020-06-24 13:51:57 2020-06-24 14:09:57 0:18:00 0:10:58 0:07:02 smithi master centos 8.1 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5175375 2020-06-24 11:12:54 2020-06-24 13:51:57 2020-06-24 14:11:57 0:20:00 0:14:12 0:05:48 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 5175376 2020-06-24 11:12:54 2020-06-24 13:51:57 2020-06-24 14:11:57 0:20:00 0:13:07 0:06:53 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5175377 2020-06-24 11:12:55 2020-06-24 13:51:57 2020-06-24 14:11:57 0:20:00 0:13:02 0:06:58 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
fail 5175378 2020-06-24 11:12:56 2020-06-24 13:53:41 2020-06-24 14:41:42 0:48:01 0:40:40 0:07:21 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2020-06-24T14:05:39.252472+0000 osd.0 (osd.0) 3 : cluster [WRN] slow request osd_op(client.4136.0:1 1.2 1.7c339972 (undecoded) ondisk+read+known_if_redirected e20) initiated 2020-06-24T14:05:08.497955+0000 currently delayed" in cluster log

pass 5175379 2020-06-24 11:12:57 2020-06-24 13:53:41 2020-06-24 14:11:41 0:18:00 0:11:25 0:06:35 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5175380 2020-06-24 11:12:58 2020-06-24 13:53:42 2020-06-24 14:23:41 0:29:59 0:22:54 0:07:05 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 5175381 2020-06-24 11:12:59 2020-06-24 13:53:45 2020-06-24 14:21:45 0:28:00 0:22:18 0:05:42 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5175382 2020-06-24 11:13:00 2020-06-24 13:53:51 2020-06-24 14:13:50 0:19:59 0:13:29 0:06:30 smithi master rhel 8.1 rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5175383 2020-06-24 11:13:01 2020-06-24 13:55:48 2020-06-24 14:29:47 0:33:59 0:26:51 0:07:08 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5175384 2020-06-24 11:13:01 2020-06-24 13:55:48 2020-06-24 14:21:47 0:25:59 0:19:52 0:06:07 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5175385 2020-06-24 11:13:02 2020-06-24 13:55:48 2020-06-24 15:05:49 1:10:01 1:03:22 0:06:39 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5175386 2020-06-24 11:13:03 2020-06-24 13:57:46 2020-06-24 16:33:49 2:36:03 2:30:28 0:05:35 smithi master centos 8.1 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 5175387 2020-06-24 11:13:04 2020-06-24 13:57:47 2020-06-24 14:13:46 0:15:59 0:10:40 0:05:19 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5175388 2020-06-24 11:13:05 2020-06-24 13:57:46 2020-06-24 14:13:46 0:16:00 0:09:55 0:06:05 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5175389 2020-06-24 11:13:06 2020-06-24 13:57:46 2020-06-24 14:19:46 0:22:00 0:15:01 0:06:59 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} 2
pass 5175390 2020-06-24 11:13:07 2020-06-24 13:57:46 2020-06-24 14:17:46 0:20:00 0:13:44 0:06:16 smithi master rhel 8.1 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5175391 2020-06-24 11:13:08 2020-06-24 13:57:46 2020-06-24 14:13:46 0:16:00 0:09:37 0:06:23 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5175392 2020-06-24 11:13:08 2020-06-24 13:57:47 2020-06-24 14:15:47 0:18:00 0:11:56 0:06:04 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5175393 2020-06-24 11:13:09 2020-06-24 13:57:50 2020-06-24 14:27:50 0:30:00 0:24:38 0:05:22 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
pass 5175394 2020-06-24 11:13:10 2020-06-24 13:57:51 2020-06-24 14:17:51 0:20:00 0:13:11 0:06:49 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 5175395 2020-06-24 11:13:11 2020-06-24 13:59:46 2020-06-24 14:17:46 0:18:00 0:11:53 0:06:07 smithi master rhel 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} 1
pass 5175396 2020-06-24 11:13:12 2020-06-24 13:59:46 2020-06-24 14:39:46 0:40:00 0:33:57 0:06:03 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5175397 2020-06-24 11:13:13 2020-06-24 13:59:46 2020-06-24 14:33:46 0:34:00 0:27:19 0:06:41 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5175398 2020-06-24 11:13:14 2020-06-24 13:59:46 2020-06-24 14:31:46 0:32:00 0:25:36 0:06:24 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4