Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5267361 2020-07-29 19:11:07 2020-07-29 19:12:25 2020-07-29 19:30:25 0:18:00 0:11:00 0:07:00 smithi master rhel 8.1 rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 5267362 2020-07-29 19:11:08 2020-07-29 19:12:39 2020-07-29 19:56:39 0:44:00 0:27:32 0:16:28 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5267363 2020-07-29 19:11:09 2020-07-29 19:12:51 2020-07-29 19:36:50 0:23:59 0:16:38 0:07:21 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5267364 2020-07-29 19:11:10 2020-07-29 19:13:13 2020-07-29 19:55:13 0:42:00 0:30:39 0:11:21 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5267365 2020-07-29 19:11:11 2020-07-29 19:13:37 2020-07-29 19:41:36 0:27:59 0:12:01 0:15:58 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} 2
pass 5267366 2020-07-29 19:11:12 2020-07-29 19:14:08 2020-07-29 19:40:07 0:25:59 0:15:58 0:10:01 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 5267367 2020-07-29 19:11:13 2020-07-29 19:15:17 2020-07-29 19:47:17 0:32:00 0:23:22 0:08:38 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267368 2020-07-29 19:11:14 2020-07-29 19:16:56 2020-07-29 19:30:56 0:14:00 0:08:17 0:05:43 smithi master centos 8.1 rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 5267369 2020-07-29 19:11:15 2020-07-29 19:18:47 2020-07-29 19:42:46 0:23:59 0:15:48 0:08:11 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
pass 5267370 2020-07-29 19:11:16 2020-07-29 19:19:03 2020-07-29 20:01:03 0:42:00 0:35:10 0:06:50 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 5267371 2020-07-29 19:11:17 2020-07-29 19:19:03 2020-07-29 19:45:03 0:26:00 0:16:23 0:09:37 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
pass 5267372 2020-07-29 19:11:18 2020-07-29 19:19:03 2020-07-29 20:39:04 1:20:01 1:10:01 0:10:00 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5267373 2020-07-29 19:11:18 2020-07-29 19:19:15 2020-07-29 19:33:15 0:14:00 0:08:23 0:05:37 smithi master centos 8.1 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
fail 5267374 2020-07-29 19:11:19 2020-07-29 19:21:18 2020-07-29 19:37:17 0:15:59 0:08:56 0:07:03 smithi master centos 8.1 rados/rest/{mgr-restful supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-07-29T19:33:09.628335+0000 mon.a (mon.0) 93 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

fail 5267375 2020-07-29 19:11:20 2020-07-29 19:21:18 2020-07-29 19:41:17 0:19:59 0:13:33 0:06:26 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2020-07-29T19:31:16.955227+0000 mon.a (mon.0) 73 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267376 2020-07-29 19:11:21 2020-07-29 19:23:16 2020-07-29 19:43:16 0:20:00 0:14:35 0:05:25 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
pass 5267377 2020-07-29 19:11:22 2020-07-29 19:23:16 2020-07-29 23:51:24 4:28:08 4:02:31 0:25:37 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
pass 5267378 2020-07-29 19:11:23 2020-07-29 19:23:16 2020-07-29 19:53:16 0:30:00 0:23:30 0:06:30 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
fail 5267379 2020-07-29 19:11:24 2020-07-29 19:23:16 2020-07-29 19:47:16 0:24:00 0:15:52 0:08:08 smithi master rhel 8.1 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} 2
Failure Reason:

"2020-07-29T19:38:32.969633+0000 mon.a (mon.0) 89 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267380 2020-07-29 19:11:25 2020-07-29 19:23:32 2020-07-29 19:41:31 0:17:59 0:10:58 0:07:01 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5267381 2020-07-29 19:11:26 2020-07-29 19:24:33 2020-07-29 19:44:33 0:20:00 0:13:17 0:06:43 smithi master rhel 8.1 rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5267382 2020-07-29 19:11:27 2020-07-29 19:24:33 2020-07-29 19:50:33 0:26:00 0:15:09 0:10:51 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 5267383 2020-07-29 19:11:27 2020-07-29 19:24:35 2020-07-29 19:58:34 0:33:59 0:11:56 0:22:03 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267384 2020-07-29 19:11:28 2020-07-29 19:24:37 2020-07-29 19:42:37 0:18:00 0:11:57 0:06:03 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
pass 5267385 2020-07-29 19:11:29 2020-07-29 19:24:43 2020-07-29 20:14:44 0:50:01 0:41:13 0:08:48 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} 2
pass 5267386 2020-07-29 19:11:30 2020-07-29 19:25:02 2020-07-29 19:47:02 0:22:00 0:11:00 0:11:00 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5267387 2020-07-29 19:11:31 2020-07-29 19:25:15 2020-07-29 19:43:14 0:17:59 0:11:03 0:06:56 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5267388 2020-07-29 19:11:32 2020-07-29 19:26:30 2020-07-29 19:42:29 0:15:59 0:09:17 0:06:42 smithi master centos 8.1 rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5267389 2020-07-29 19:11:33 2020-07-29 19:26:30 2020-07-29 19:48:29 0:21:59 0:16:06 0:05:53 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/progress} 2
pass 5267390 2020-07-29 19:11:34 2020-07-29 19:27:00 2020-07-29 19:49:00 0:22:00 0:16:31 0:05:29 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 5267391 2020-07-29 19:11:35 2020-07-29 19:27:02 2020-07-29 20:07:02 0:40:00 0:28:20 0:11:40 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 5267392 2020-07-29 19:11:36 2020-07-29 19:27:08 2020-07-29 19:49:07 0:21:59 0:16:23 0:05:36 smithi master centos 8.0 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_8.0} fixed-2} 2
pass 5267393 2020-07-29 19:11:37 2020-07-29 19:27:09 2020-07-29 19:43:08 0:15:59 0:09:19 0:06:40 smithi master centos 8.1 rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{centos_8}} 1
pass 5267394 2020-07-29 19:11:38 2020-07-29 19:29:18 2020-07-29 19:55:18 0:26:00 0:20:38 0:05:22 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 5267395 2020-07-29 19:11:39 2020-07-29 19:29:19 2020-07-29 19:47:18 0:17:59 0:11:01 0:06:58 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5267396 2020-07-29 19:11:40 2020-07-29 19:29:19 2020-07-29 19:49:19 0:20:00 0:12:59 0:07:01 smithi master rhel 8.1 rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
fail 5267397 2020-07-29 19:11:41 2020-07-29 19:30:43 2020-07-29 19:54:43 0:24:00 0:18:03 0:05:57 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
Failure Reason:

Command failed (workunit test rados/test_python.sh) on smithi149 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=804404f8309168c2db908fa5863e53833a27dd11 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh'

pass 5267398 2020-07-29 19:11:41 2020-07-29 19:30:57 2020-07-29 19:46:56 0:15:59 0:08:35 0:07:24 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5267399 2020-07-29 19:11:42 2020-07-29 19:31:01 2020-07-29 19:55:00 0:23:59 0:15:34 0:08:25 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 5267400 2020-07-29 19:11:43 2020-07-29 19:31:01 2020-07-29 20:59:02 1:28:01 1:20:56 0:07:05 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 5267401 2020-07-29 19:11:44 2020-07-29 19:31:04 2020-07-29 19:59:03 0:27:59 0:21:33 0:06:26 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 5267402 2020-07-29 19:11:45 2020-07-29 19:31:14 2020-07-29 19:51:14 0:20:00 0:11:02 0:08:58 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5267403 2020-07-29 19:11:46 2020-07-29 19:33:16 2020-07-29 20:29:16 0:56:00 0:48:18 0:07:42 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
pass 5267404 2020-07-29 19:11:47 2020-07-29 19:33:16 2020-07-29 20:09:16 0:36:00 0:27:39 0:08:21 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267405 2020-07-29 19:11:48 2020-07-29 19:33:16 2020-07-29 20:05:16 0:32:00 0:25:26 0:06:34 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
pass 5267406 2020-07-29 19:11:49 2020-07-29 19:33:16 2020-07-29 20:05:16 0:32:00 0:23:02 0:08:58 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} 2
pass 5267407 2020-07-29 19:11:50 2020-07-29 19:33:23 2020-07-29 20:17:23 0:44:00 0:38:24 0:05:36 smithi master rhel 8.1 rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5267408 2020-07-29 19:11:51 2020-07-29 19:33:24 2020-07-29 19:59:23 0:25:59 0:18:54 0:07:05 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5267409 2020-07-29 19:11:52 2020-07-29 19:33:26 2020-07-29 20:07:26 0:34:00 0:26:59 0:07:01 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5267410 2020-07-29 19:11:52 2020-07-29 19:35:04 2020-07-29 20:11:04 0:36:00 0:29:04 0:06:56 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
fail 5267411 2020-07-29 19:11:53 2020-07-29 19:35:04 2020-07-29 20:13:04 0:38:00 0:31:02 0:06:58 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2020-07-29T20:05:04.513464+0000 mon.a (mon.0) 3396 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267412 2020-07-29 19:11:54 2020-07-29 19:35:04 2020-07-29 20:49:05 1:14:01 1:05:07 0:08:54 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5267413 2020-07-29 19:11:55 2020-07-29 19:35:07 2020-07-29 19:55:07 0:20:00 0:12:04 0:07:56 smithi master centos 8.1 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} 1
pass 5267414 2020-07-29 19:11:56 2020-07-29 19:35:09 2020-07-29 22:09:12 2:34:03 0:11:21 2:22:42 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 5267415 2020-07-29 19:11:57 2020-07-29 19:35:24 2020-07-29 19:51:23 0:15:59 0:09:22 0:06:37 smithi master centos 8.1 rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-07-29T19:47:37.000592+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267416 2020-07-29 19:11:58 2020-07-29 19:36:22 2020-07-29 19:54:22 0:18:00 0:11:10 0:06:50 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5267417 2020-07-29 19:11:59 2020-07-29 19:36:52 2020-07-29 19:54:51 0:17:59 0:11:54 0:06:05 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5267418 2020-07-29 19:12:00 2020-07-29 19:37:05 2020-07-29 20:01:04 0:23:59 0:17:16 0:06:43 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} 2
pass 5267419 2020-07-29 19:12:01 2020-07-29 19:37:10 2020-07-29 20:11:10 0:34:00 0:27:52 0:06:08 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5267420 2020-07-29 19:12:02 2020-07-29 19:37:18 2020-07-29 19:51:18 0:14:00 0:07:06 0:06:54 smithi master ubuntu 18.04 rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267421 2020-07-29 19:12:02 2020-07-29 19:39:10 2020-07-29 19:57:10 0:18:00 0:11:04 0:06:56 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5267422 2020-07-29 19:12:03 2020-07-29 19:39:16 2020-07-29 20:17:16 0:38:00 0:30:22 0:07:38 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
fail 5267423 2020-07-29 19:12:04 2020-07-29 19:39:16 2020-07-29 20:01:15 0:21:59 0:15:17 0:06:42 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/prometheus} 2
Failure Reason:

"2020-07-29T19:54:16.471374+0000 mon.b (mon.0) 83 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267424 2020-07-29 19:12:05 2020-07-29 19:40:09 2020-07-29 20:22:09 0:42:00 0:36:06 0:05:54 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 5267425 2020-07-29 19:12:06 2020-07-29 19:41:10 2020-07-29 20:21:09 0:39:59 0:32:47 0:07:12 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
pass 5267426 2020-07-29 19:12:07 2020-07-29 19:41:10 2020-07-29 20:09:09 0:27:59 0:20:19 0:07:40 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
pass 5267427 2020-07-29 19:12:08 2020-07-29 19:41:10 2020-07-29 20:21:10 0:40:00 0:34:20 0:05:40 smithi master rhel 8.1 rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 5267428 2020-07-29 19:12:09 2020-07-29 19:41:19 2020-07-29 20:07:18 0:25:59 0:18:19 0:07:40 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5267429 2020-07-29 19:12:10 2020-07-29 19:41:33 2020-07-29 21:27:35 1:46:02 1:35:36 0:10:26 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 5267430 2020-07-29 19:12:10 2020-07-29 19:41:38 2020-07-29 19:53:37 0:11:59 0:04:48 0:07:11 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5267431 2020-07-29 19:12:11 2020-07-29 19:42:53 2020-07-29 20:04:52 0:21:59 0:07:59 0:14:00 smithi master ubuntu 18.04 rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 5267432 2020-07-29 19:12:12 2020-07-29 19:42:53 2020-07-29 20:20:52 0:37:59 0:31:21 0:06:38 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5267433 2020-07-29 19:12:13 2020-07-29 19:42:53 2020-07-29 20:10:52 0:27:59 0:21:26 0:06:33 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5267434 2020-07-29 19:12:14 2020-07-29 19:42:53 2020-07-29 20:02:52 0:19:59 0:12:26 0:07:33 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5267435 2020-07-29 19:12:15 2020-07-29 19:42:53 2020-07-29 19:58:52 0:15:59 0:08:18 0:07:41 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267436 2020-07-29 19:12:16 2020-07-29 19:43:00 2020-07-29 20:25:01 0:42:01 0:31:54 0:10:07 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5267437 2020-07-29 19:12:17 2020-07-29 19:43:09 2020-07-29 20:27:09 0:44:00 0:17:33 0:26:27 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
pass 5267438 2020-07-29 19:12:18 2020-07-29 19:43:10 2020-07-29 20:25:10 0:42:00 0:34:57 0:07:03 smithi master rhel 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267439 2020-07-29 19:12:18 2020-07-29 19:43:16 2020-07-29 20:21:16 0:38:00 0:29:58 0:08:02 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267440 2020-07-29 19:12:19 2020-07-29 19:43:18 2020-07-29 20:07:17 0:23:59 0:14:55 0:09:04 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5267441 2020-07-29 19:12:20 2020-07-29 19:44:51 2020-07-29 20:12:51 0:28:00 0:17:51 0:10:09 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 5267442 2020-07-29 19:12:21 2020-07-29 19:44:56 2020-07-29 20:06:55 0:21:59 0:13:38 0:08:21 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5267443 2020-07-29 19:12:22 2020-07-29 19:45:04 2020-07-29 20:09:04 0:24:00 0:14:32 0:09:28 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 5267444 2020-07-29 19:12:23 2020-07-29 19:47:16 2020-07-29 20:19:15 0:31:59 0:15:30 0:16:29 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267445 2020-07-29 19:12:24 2020-07-29 19:47:16 2020-07-29 20:05:15 0:17:59 0:11:25 0:06:34 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5267446 2020-07-29 19:12:25 2020-07-29 19:47:17 2020-07-29 20:19:17 0:32:00 0:24:10 0:07:50 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
pass 5267447 2020-07-29 19:12:26 2020-07-29 19:47:18 2020-07-29 20:05:18 0:18:00 0:10:50 0:07:10 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 5267448 2020-07-29 19:12:27 2020-07-29 19:47:20 2020-07-29 20:25:19 0:37:59 0:25:58 0:12:01 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5267449 2020-07-29 19:12:27 2020-07-29 19:48:49 2020-07-29 21:04:50 1:16:01 1:06:26 0:09:35 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5267450 2020-07-29 19:12:28 2020-07-29 19:49:02 2020-07-29 20:05:01 0:15:59 0:07:24 0:08:35 smithi master ubuntu 18.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 5267451 2020-07-29 19:12:29 2020-07-29 19:49:09 2020-07-29 20:07:08 0:17:59 0:11:07 0:06:52 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 5267452 2020-07-29 19:12:30 2020-07-29 19:49:20 2020-07-29 20:15:20 0:26:00 0:17:56 0:08:04 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
pass 5267453 2020-07-29 19:12:31 2020-07-29 19:50:17 2020-07-29 20:22:17 0:32:00 0:26:07 0:05:53 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 5267454 2020-07-29 19:12:32 2020-07-29 19:50:34 2020-07-29 20:06:34 0:16:00 0:07:58 0:08:02 smithi master centos 8.1 rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} 1
fail 5267455 2020-07-29 19:12:33 2020-07-29 19:51:07 2020-07-29 20:07:07 0:16:00 0:08:43 0:07:17 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/workunits} 2
Failure Reason:

"2020-07-29T20:03:14.528656+0000 mon.a (mon.0) 91 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267456 2020-07-29 19:12:34 2020-07-29 19:51:15 2020-07-29 20:13:15 0:22:00 0:12:33 0:09:27 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 5267457 2020-07-29 19:12:35 2020-07-29 19:51:35 2020-07-29 20:13:35 0:22:00 0:15:28 0:06:32 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5267458 2020-07-29 19:12:36 2020-07-29 19:51:35 2020-08-04 03:56:40 5 days, 8:05:05 0:24:18 5 days, 7:40:47 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5267459 2020-07-29 19:12:37 2020-07-29 19:53:05 2020-07-29 20:25:05 0:32:00 0:24:01 0:07:59 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 5267460 2020-07-29 19:12:38 2020-07-29 19:53:17 2020-07-29 20:15:17 0:22:00 0:13:40 0:08:20 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
pass 5267461 2020-07-29 19:12:38 2020-07-29 19:53:39 2020-07-29 20:23:38 0:29:59 0:22:31 0:07:28 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
fail 5267462 2020-07-29 19:12:39 2020-07-29 19:54:40 2020-07-29 20:40:40 0:46:00 0:25:59 0:20:01 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5267463 2020-07-29 19:12:40 2020-07-29 19:54:44 2020-07-29 20:20:44 0:26:00 0:20:01 0:05:59 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5267464 2020-07-29 19:12:41 2020-07-29 19:54:53 2020-07-29 20:16:52 0:21:59 0:16:13 0:05:46 smithi master rhel 8.1 rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5267465 2020-07-29 19:12:42 2020-07-29 19:55:02 2020-07-29 20:19:01 0:23:59 0:07:38 0:16:21 smithi master ubuntu 18.04 rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5267466 2020-07-29 19:12:43 2020-07-29 19:55:08 2020-07-29 20:25:08 0:30:00 0:23:10 0:06:50 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5267467 2020-07-29 19:12:44 2020-07-29 19:55:14 2020-07-29 20:17:14 0:22:00 0:11:09 0:10:51 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5267468 2020-07-29 19:12:45 2020-07-29 19:55:19 2020-07-29 20:35:19 0:40:00 0:27:15 0:12:45 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 5267469 2020-07-29 19:12:45 2020-07-29 19:56:59 2020-07-29 20:14:59 0:18:00 0:11:39 0:06:21 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 5267470 2020-07-29 19:12:46 2020-07-29 19:57:12 2020-07-29 20:15:11 0:17:59 0:10:43 0:07:16 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache} 2
pass 5267471 2020-07-29 19:12:47 2020-07-29 19:58:53 2020-07-29 20:34:54 0:36:01 0:23:58 0:12:03 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} 2
pass 5267472 2020-07-29 19:12:48 2020-07-29 19:58:54 2020-07-29 20:42:54 0:44:00 0:29:51 0:14:09 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267473 2020-07-29 19:12:49 2020-07-29 19:59:05 2020-07-29 20:17:04 0:17:59 0:11:37 0:06:22 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5267474 2020-07-29 19:12:50 2020-07-29 19:59:25 2020-07-29 20:13:24 0:13:59 0:07:38 0:06:21 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267475 2020-07-29 19:12:51 2020-07-29 20:01:22 2020-07-29 20:37:22 0:36:00 0:11:44 0:24:16 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267476 2020-07-29 19:12:52 2020-07-29 20:01:22 2020-07-29 20:23:21 0:21:59 0:12:16 0:09:43 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/dedup_tier} 2
pass 5267477 2020-07-29 19:12:52 2020-07-29 20:01:22 2020-07-29 20:17:21 0:15:59 0:09:03 0:06:56 smithi master ubuntu 18.04 rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267478 2020-07-29 19:12:53 2020-07-29 20:03:13 2020-07-29 20:21:13 0:18:00 0:09:42 0:08:18 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5267479 2020-07-29 19:12:54 2020-07-29 20:05:12 2020-07-29 20:41:12 0:36:00 0:27:38 0:08:22 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} 2
pass 5267480 2020-07-29 19:12:55 2020-07-29 20:05:12 2020-07-29 20:41:12 0:36:00 0:30:10 0:05:50 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5267481 2020-07-29 19:12:56 2020-07-29 20:05:16 2020-07-29 20:27:16 0:22:00 0:13:54 0:08:06 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5267482 2020-07-29 19:12:57 2020-07-29 20:05:17 2020-07-29 20:47:17 0:42:00 0:34:33 0:07:27 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
pass 5267483 2020-07-29 19:12:58 2020-07-29 20:05:18 2020-07-29 20:25:17 0:19:59 0:13:45 0:06:14 smithi master rhel 8.1 rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5267484 2020-07-29 19:12:58 2020-07-29 20:05:20 2020-07-29 20:37:19 0:31:59 0:23:35 0:08:24 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 5267485 2020-07-29 19:12:59 2020-07-29 20:06:53 2020-07-29 20:26:53 0:20:00 0:12:17 0:07:43 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
fail 5267486 2020-07-29 19:13:00 2020-07-29 20:06:54 2020-07-29 20:32:54 0:26:00 0:14:35 0:11:25 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/crash} 2
Failure Reason:

"2020-07-29T20:26:55.472648+0000 mon.b (mon.0) 89 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267487 2020-07-29 19:13:01 2020-07-29 20:06:57 2020-07-29 20:24:56 0:17:59 0:10:51 0:07:08 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
fail 5267488 2020-07-29 19:13:02 2020-07-29 20:07:04 2020-07-29 20:45:04 0:38:00 0:31:14 0:06:46 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-07-29T20:37:34.100149+0000 mon.a (mon.0) 3325 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267489 2020-07-29 19:13:03 2020-07-29 20:07:08 2020-07-29 21:21:09 1:14:01 1:05:43 0:08:18 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5267490 2020-07-29 19:13:04 2020-07-29 20:07:09 2020-07-29 22:45:14 2:38:05 2:31:02 0:07:03 smithi master rhel 8.1 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 5267491 2020-07-29 19:13:04 2020-07-29 20:07:18 2020-07-29 20:33:18 0:26:00 0:19:04 0:06:56 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5267492 2020-07-29 19:13:05 2020-07-29 20:07:20 2020-07-29 20:51:20 0:44:00 0:34:54 0:09:06 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5267493 2020-07-29 19:13:06 2020-07-29 20:07:29 2020-07-29 20:27:28 0:19:59 0:13:58 0:06:01 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
pass 5267494 2020-07-29 19:13:07 2020-07-29 20:09:22 2020-07-29 20:25:21 0:15:59 0:08:23 0:07:36 smithi master centos 8.1 rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{centos_8}} 1
pass 5267495 2020-07-29 19:13:08 2020-07-29 20:09:22 2020-07-29 20:33:22 0:24:00 0:17:33 0:06:27 smithi master rhel 8.1 rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 5267496 2020-07-29 19:13:09 2020-07-29 20:09:22 2020-07-29 21:55:24 1:46:02 1:35:42 0:10:20 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 5267497 2020-07-29 19:13:10 2020-07-29 20:11:11 2020-07-29 20:49:11 0:38:00 0:30:47 0:07:13 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} 2
pass 5267498 2020-07-29 19:13:11 2020-07-29 20:11:11 2020-07-29 20:31:10 0:19:59 0:12:25 0:07:34 smithi master centos 8.1 rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 5267499 2020-07-29 19:13:12 2020-07-29 20:11:12 2020-07-29 20:39:11 0:27:59 0:20:40 0:07:19 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5267500 2020-07-29 19:13:12 2020-07-29 20:13:26 2020-07-29 21:07:25 0:53:59 0:38:43 0:15:16 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
pass 5267501 2020-07-29 19:13:13 2020-07-29 20:13:25 2020-07-29 20:33:24 0:19:59 0:11:01 0:08:58 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} 2
pass 5267502 2020-07-29 19:13:14 2020-07-29 20:13:26 2020-07-29 20:51:25 0:37:59 0:30:11 0:07:48 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 5267503 2020-07-29 19:13:15 2020-07-29 20:13:26 2020-07-29 20:43:25 0:29:59 0:22:26 0:07:33 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi104 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=804404f8309168c2db908fa5863e53833a27dd11 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5267504 2020-07-29 19:13:16 2020-07-29 20:13:36 2020-07-29 20:39:36 0:26:00 0:13:36 0:12:24 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5267505 2020-07-29 19:13:17 2020-07-29 20:15:08 2020-07-29 20:47:07 0:31:59 0:25:18 0:06:41 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267506 2020-07-29 19:13:18 2020-07-29 20:15:10 2020-07-29 20:31:07 0:15:57 0:08:59 0:06:58 smithi master ubuntu 18.04 rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267507 2020-07-29 19:13:19 2020-07-29 20:15:13 2020-07-29 20:33:12 0:17:59 0:09:59 0:08:00 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5267508 2020-07-29 19:13:20 2020-07-29 20:15:19 2020-07-29 20:45:18 0:29:59 0:22:45 0:07:14 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5267509 2020-07-29 19:13:20 2020-07-29 20:15:21 2020-07-29 20:43:21 0:28:00 0:11:55 0:16:05 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267510 2020-07-29 19:13:21 2020-07-29 20:17:08 2020-07-29 20:43:07 0:25:59 0:14:32 0:11:27 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 5267511 2020-07-29 19:13:22 2020-07-29 20:17:08 2020-07-29 20:45:07 0:27:59 0:12:14 0:15:45 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5267512 2020-07-29 19:13:23 2020-07-29 20:17:08 2020-07-29 20:49:07 0:31:59 0:20:12 0:11:47 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} 2
pass 5267513 2020-07-29 19:13:24 2020-07-29 20:17:16 2020-07-29 21:11:16 0:54:00 0:48:04 0:05:56 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 5267514 2020-07-29 19:13:25 2020-07-29 20:17:18 2020-07-29 20:39:17 0:21:59 0:12:15 0:09:44 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 5267515 2020-07-29 19:13:26 2020-07-29 20:17:24 2020-07-29 20:43:24 0:26:00 0:21:12 0:04:48 smithi master rhel 8.1 rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 5267516 2020-07-29 19:13:27 2020-07-29 20:17:28 2020-07-29 20:31:27 0:13:59 0:04:34 0:09:25 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5267517 2020-07-29 19:13:28 2020-07-29 20:19:22 2020-07-29 20:37:21 0:17:59 0:09:34 0:08:25 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267518 2020-07-29 19:13:28 2020-07-29 20:19:22 2020-07-29 20:43:21 0:23:59 0:13:01 0:10:58 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5267519 2020-07-29 19:13:29 2020-07-29 20:19:22 2020-07-29 20:51:22 0:32:00 0:25:37 0:06:23 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} 2
fail 5267520 2020-07-29 19:13:30 2020-07-29 20:21:03 2020-07-29 20:47:02 0:25:59 0:16:38 0:09:21 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/failover} 2
Failure Reason:

"2020-07-29T20:39:22.420010+0000 mon.a (mon.0) 91 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267521 2020-07-29 19:13:31 2020-07-29 20:21:04 2020-07-29 20:51:02 0:29:58 0:24:29 0:05:29 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} 1
pass 5267522 2020-07-29 19:13:32 2020-07-29 20:21:11 2020-07-29 20:47:11 0:26:00 0:20:18 0:05:42 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} 2
pass 5267523 2020-07-29 19:13:33 2020-07-29 20:21:11 2020-07-29 20:51:11 0:30:00 0:23:11 0:06:49 smithi master rhel 8.1 rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 5267524 2020-07-29 19:13:34 2020-07-29 20:21:14 2020-07-29 20:55:14 0:34:00 0:24:43 0:09:17 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5267525 2020-07-29 19:13:34 2020-07-29 20:21:17 2020-07-29 20:43:17 0:22:00 0:13:07 0:08:53 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5267526 2020-07-29 19:13:35 2020-07-29 20:22:29 2020-07-29 21:40:31 1:18:02 1:09:46 0:08:16 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5267527 2020-07-29 19:13:36 2020-07-29 20:22:29 2020-07-29 22:58:33 2:36:04 2:28:40 0:07:24 smithi master rhel 8.1 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} 1
pass 5267528 2020-07-29 19:13:37 2020-07-29 20:23:23 2020-07-29 20:57:23 0:34:00 0:27:38 0:06:22 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} 2
pass 5267529 2020-07-29 19:13:38 2020-07-29 20:23:56 2020-07-29 20:43:56 0:20:00 0:11:49 0:08:11 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5267530 2020-07-29 19:13:39 2020-07-29 20:25:14 2020-07-29 20:59:14 0:34:00 0:08:05 0:25:55 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 5267531 2020-07-29 19:13:40 2020-07-29 20:25:15 2020-07-29 20:57:14 0:31:59 0:23:12 0:08:47 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 5267532 2020-07-29 19:13:41 2020-07-29 20:25:14 2020-07-29 20:45:14 0:20:00 0:14:00 0:06:00 smithi master centos 8.1 rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5267533 2020-07-29 19:13:42 2020-07-29 20:25:14 2020-07-29 21:09:14 0:44:00 0:19:18 0:24:42 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 5267534 2020-07-29 19:13:43 2020-07-29 20:25:14 2020-07-29 20:45:13 0:19:59 0:12:18 0:07:41 smithi master rhel 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} 1
pass 5267535 2020-07-29 19:13:44 2020-07-29 20:25:19 2020-07-29 20:51:18 0:25:59 0:17:54 0:08:05 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
pass 5267536 2020-07-29 19:13:45 2020-07-29 20:25:21 2020-07-29 20:55:21 0:30:00 0:14:22 0:15:38 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5267537 2020-07-29 19:13:45 2020-07-29 20:25:23 2020-07-29 22:55:26 2:30:03 2:11:51 0:18:12 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
fail 5267538 2020-07-29 19:13:46 2020-07-29 20:25:57 2020-07-29 21:29:58 1:04:01 0:25:27 0:38:34 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5267539 2020-07-29 19:13:47 2020-07-29 20:27:10 2020-07-29 21:01:09 0:33:59 0:25:58 0:08:01 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267540 2020-07-29 19:13:48 2020-07-29 20:27:09 2020-07-29 20:55:09 0:28:00 0:11:31 0:16:29 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267541 2020-07-29 19:13:49 2020-07-29 20:27:11 2020-07-29 21:01:11 0:34:00 0:21:59 0:12:01 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} 2
pass 5267542 2020-07-29 19:13:50 2020-07-29 20:27:18 2020-07-29 21:05:17 0:37:59 0:31:48 0:06:11 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5267543 2020-07-29 19:13:51 2020-07-29 20:27:30 2020-07-29 21:11:30 0:44:00 0:34:54 0:09:06 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} 2
pass 5267544 2020-07-29 19:13:51 2020-07-29 20:29:43 2020-07-29 20:51:41 0:21:58 0:13:59 0:07:59 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5267545 2020-07-29 19:13:52 2020-07-29 20:31:39 2020-07-29 20:49:36 0:17:57 0:11:20 0:06:37 smithi master rhel 8.1 rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5267546 2020-07-29 19:13:53 2020-07-29 20:31:38 2020-07-29 21:07:36 0:35:58 0:28:36 0:07:22 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} 2
pass 5267547 2020-07-29 19:13:54 2020-07-29 20:31:39 2020-07-29 21:07:37 0:35:58 0:26:39 0:09:19 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} 2
fail 5267548 2020-07-29 19:13:55 2020-07-29 20:33:15 2020-07-29 20:59:15 0:26:00 0:12:23 0:13:37 smithi master centos 8.1 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} 2
Failure Reason:

"2020-07-29T20:52:57.935386+0000 mon.a (mon.0) 115 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267549 2020-07-29 19:13:56 2020-07-29 20:33:15 2020-07-29 21:17:15 0:44:00 0:30:31 0:13:29 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5267550 2020-07-29 19:13:57 2020-07-29 20:33:19 2020-07-29 21:05:19 0:32:00 0:23:29 0:08:31 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} 2
fail 5267551 2020-07-29 19:13:58 2020-07-29 20:33:23 2020-07-29 20:57:23 0:24:00 0:12:54 0:11:06 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/insights} 2
Failure Reason:

"2020-07-29T20:50:01.293487+0000 mon.a (mon.0) 116 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267552 2020-07-29 19:13:58 2020-07-29 20:33:26 2020-07-29 21:05:25 0:31:59 0:15:23 0:16:36 smithi master rhel 8.1 rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 5267553 2020-07-29 19:13:59 2020-07-29 20:35:13 2020-07-29 21:11:13 0:36:00 0:26:47 0:09:13 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5267554 2020-07-29 19:14:00 2020-07-29 20:35:20 2020-07-29 20:51:20 0:16:00 0:09:05 0:06:55 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267555 2020-07-29 19:14:01 2020-07-29 20:37:38 2020-07-29 21:09:37 0:31:59 0:24:24 0:07:35 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 2
pass 5267556 2020-07-29 19:14:02 2020-07-29 20:37:38 2020-07-29 20:57:37 0:19:59 0:10:59 0:09:00 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5267557 2020-07-29 19:14:03 2020-07-29 20:37:38 2020-07-29 20:59:37 0:21:59 0:10:27 0:11:32 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 5267558 2020-07-29 19:14:04 2020-07-29 20:39:23 2020-07-29 20:59:23 0:20:00 0:14:31 0:05:29 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5267559 2020-07-29 19:14:05 2020-07-29 20:39:24 2020-07-29 20:53:23 0:13:59 0:08:18 0:05:41 smithi master centos 8.1 rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5267560 2020-07-29 19:14:06 2020-07-29 20:39:24 2020-07-29 21:03:24 0:24:00 0:15:21 0:08:39 smithi master centos 8.1 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} 2
fail 5267561 2020-07-29 19:14:06 2020-07-29 20:39:37 2020-07-29 21:17:38 0:38:01 0:30:33 0:07:28 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-07-29T21:11:12.621639+0000 mon.a (mon.0) 3365 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267562 2020-07-29 19:14:07 2020-07-29 20:40:57 2020-07-29 21:54:58 1:14:01 1:08:07 0:05:54 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5267563 2020-07-29 19:14:08 2020-07-29 20:41:13 2020-07-29 20:55:12 0:13:59 0:07:13 0:06:46 smithi master ubuntu 18.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 5267564 2020-07-29 19:14:09 2020-07-29 20:41:13 2020-07-29 21:01:13 0:20:00 0:12:04 0:07:56 smithi master rhel 8.1 rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 3
pass 5267565 2020-07-29 19:14:10 2020-07-29 20:43:11 2020-07-29 21:15:11 0:32:00 0:24:46 0:07:14 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5267566 2020-07-29 19:14:11 2020-07-29 20:43:11 2020-07-29 21:19:11 0:36:00 0:27:38 0:08:22 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5267567 2020-07-29 19:14:12 2020-07-29 20:43:18 2020-07-29 21:03:17 0:19:59 0:12:15 0:07:44 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 5267568 2020-07-29 19:14:13 2020-07-29 20:43:22 2020-07-29 20:57:21 0:13:59 0:09:00 0:04:59 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_adoption} 1
pass 5267569 2020-07-29 19:14:13 2020-07-29 20:43:22 2020-07-29 21:35:23 0:52:01 0:44:54 0:07:07 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} 1
pass 5267570 2020-07-29 19:14:14 2020-07-29 20:43:25 2020-07-29 21:31:25 0:48:00 0:26:33 0:21:27 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5267571 2020-07-29 19:14:15 2020-07-29 20:43:26 2020-07-29 21:03:26 0:20:00 0:12:39 0:07:21 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 5267572 2020-07-29 19:14:16 2020-07-29 20:43:57 2020-07-29 21:11:57 0:28:00 0:14:32 0:13:28 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267573 2020-07-29 19:14:17 2020-07-29 20:45:22 2020-07-29 21:39:22 0:54:00 0:46:52 0:07:08 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} 2
pass 5267574 2020-07-29 19:14:18 2020-07-29 20:45:23 2020-07-29 21:15:22 0:29:59 0:23:04 0:06:55 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267575 2020-07-29 19:14:19 2020-07-29 20:45:22 2020-07-29 21:11:21 0:25:59 0:19:13 0:06:46 smithi master rhel 8.1 rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 5267576 2020-07-29 19:14:20 2020-07-29 20:45:22 2020-07-29 21:45:23 1:00:01 0:32:05 0:27:56 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} 3
pass 5267577 2020-07-29 19:14:21 2020-07-29 20:45:22 2020-07-29 21:15:21 0:29:59 0:22:33 0:07:26 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} 2
fail 5267578 2020-07-29 19:14:21 2020-07-29 20:45:36 2020-07-29 21:01:36 0:16:00 0:09:29 0:06:31 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-07-29T20:57:12.335545+0000 mon.a (mon.0) 73 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267579 2020-07-29 19:14:22 2020-07-29 20:47:22 2020-07-29 21:33:22 0:46:00 0:39:45 0:06:15 smithi master centos 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} 2
pass 5267580 2020-07-29 19:14:23 2020-07-29 20:47:22 2020-07-29 21:13:21 0:25:59 0:19:06 0:06:53 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-agent-small} 2
pass 5267581 2020-07-29 19:14:24 2020-07-29 20:47:23 2020-07-29 21:11:22 0:23:59 0:17:19 0:06:40 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
pass 5267582 2020-07-29 19:14:25 2020-07-29 20:47:22 2020-07-29 21:13:22 0:26:00 0:19:26 0:06:34 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} 1
pass 5267583 2020-07-29 19:14:26 2020-07-29 20:49:25 2020-07-29 21:25:25 0:36:00 0:29:53 0:06:07 smithi master rhel 8.1 rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 2
pass 5267584 2020-07-29 19:14:27 2020-07-29 20:49:25 2020-07-29 21:27:25 0:38:00 0:31:23 0:06:37 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} 2
fail 5267585 2020-07-29 19:14:27 2020-07-29 20:49:26 2020-07-29 21:29:25 0:39:59 0:32:37 0:07:22 smithi master rhel 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/module_selftest} 2
Failure Reason:

"2020-07-29T21:05:16.555370+0000 mon.b (mon.0) 87 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267586 2020-07-29 19:14:28 2020-07-29 20:49:37 2020-07-29 21:07:37 0:18:00 0:11:34 0:06:26 smithi master centos 8.1 rados/cephadm/smoke/{distro/centos_latest fixed-2 start} 2
pass 5267587 2020-07-29 19:14:29 2020-07-29 20:51:22 2020-07-29 21:29:22 0:38:00 0:26:22 0:11:38 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} 2
pass 5267588 2020-07-29 19:14:30 2020-07-29 20:51:24 2020-07-29 21:21:22 0:29:58 0:10:40 0:19:18 smithi master centos 8.1 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5267589 2020-07-29 19:14:31 2020-07-29 20:51:24 2020-07-29 21:13:22 0:21:58 0:14:06 0:07:52 smithi master centos 8.1 rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5267590 2020-07-29 19:14:32 2020-07-29 20:51:23 2020-07-29 21:21:22 0:29:59 0:22:12 0:07:47 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 5267591 2020-07-29 19:14:33 2020-07-29 20:51:23 2020-07-29 21:13:22 0:21:59 0:14:46 0:07:13 smithi master centos 8.1 rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_8}} 1
pass 5267592 2020-07-29 19:14:33 2020-07-29 20:51:24 2020-07-29 21:23:23 0:31:59 0:19:48 0:12:11 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/repair_test} 2
pass 5267593 2020-07-29 19:14:34 2020-07-29 20:51:27 2020-07-29 21:35:27 0:44:00 0:33:25 0:10:35 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_api_tests} 2
pass 5267594 2020-07-29 19:14:35 2020-07-29 20:51:43 2020-07-29 21:15:42 0:23:59 0:18:40 0:05:19 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
pass 5267595 2020-07-29 19:14:36 2020-07-29 20:52:53 2020-07-29 21:28:53 0:36:00 0:18:19 0:17:41 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps} 2
pass 5267596 2020-07-29 19:14:37 2020-07-29 20:53:25 2020-07-29 21:13:24 0:19:59 0:14:13 0:05:46 smithi master rhel 8.1 rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
pass 5267597 2020-07-29 19:14:38 2020-07-29 20:55:32 2020-07-29 21:31:32 0:36:00 0:28:15 0:07:45 smithi master centos 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5267598 2020-07-29 19:14:38 2020-07-29 20:55:32 2020-07-29 21:25:32 0:30:00 0:22:55 0:07:05 smithi master rhel 8.1 rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 5267599 2020-07-29 19:14:39 2020-07-29 20:55:33 2020-07-29 21:35:32 0:39:59 0:30:43 0:09:16 smithi master rhel 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 5267600 2020-07-29 19:14:40 2020-07-29 20:55:32 2020-07-29 21:07:31 0:11:59 0:04:47 0:07:12 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} 1
pass 5267601 2020-07-29 19:14:41 2020-07-29 20:57:32 2020-07-29 22:15:33 1:18:01 1:10:27 0:07:34 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5267602 2020-07-29 19:14:42 2020-07-29 20:57:32 2020-07-29 21:17:31 0:19:59 0:13:31 0:06:28 smithi master centos 8.1 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 5267603 2020-07-29 19:14:43 2020-07-29 20:57:32 2020-07-29 21:53:32 0:56:00 0:15:13 0:40:47 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267604 2020-07-29 19:14:44 2020-07-29 20:57:32 2020-07-29 21:25:32 0:28:00 0:20:04 0:07:56 smithi master centos 8.1 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5267605 2020-07-29 19:14:44 2020-07-29 20:57:38 2020-07-29 21:33:39 0:36:01 0:10:52 0:25:09 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5267606 2020-07-29 19:14:45 2020-07-29 20:59:06 2020-07-29 21:57:06 0:58:00 0:49:53 0:08:07 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 5267607 2020-07-29 19:14:46 2020-07-29 20:59:06 2020-07-29 21:21:05 0:21:59 0:15:17 0:06:42 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache} 2
pass 5267608 2020-07-29 19:14:47 2020-07-29 20:59:15 2020-07-29 21:33:15 0:34:00 0:27:06 0:06:54 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267609 2020-07-29 19:14:48 2020-07-29 20:59:16 2020-07-29 21:23:15 0:23:59 0:14:58 0:09:01 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} 2
pass 5267610 2020-07-29 19:14:49 2020-07-29 20:59:24 2020-07-29 21:35:24 0:36:00 0:27:17 0:08:43 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} 2
pass 5267611 2020-07-29 19:14:49 2020-07-29 20:59:38 2020-07-29 21:23:38 0:24:00 0:11:44 0:12:16 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup_tier} 2
fail 5267612 2020-07-29 19:14:50 2020-07-29 21:01:26 2020-07-29 21:53:27 0:52:01 0:24:27 0:27:34 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5267613 2020-07-29 19:14:51 2020-07-29 21:01:26 2020-07-29 21:23:26 0:22:00 0:12:47 0:09:13 smithi master rhel 8.1 rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 2
pass 5267614 2020-07-29 19:14:52 2020-07-29 21:01:26 2020-07-29 21:25:26 0:24:00 0:13:53 0:10:07 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5267615 2020-07-29 19:14:53 2020-07-29 21:01:37 2020-07-29 21:41:37 0:40:00 0:31:32 0:08:28 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5267616 2020-07-29 19:14:54 2020-07-29 21:05:11 2020-07-29 21:35:10 0:29:59 0:22:19 0:07:40 smithi master centos 8.1 rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} 2
pass 5267617 2020-07-29 19:14:55 2020-07-29 21:05:19 2020-07-29 21:25:18 0:19:59 0:12:57 0:07:02 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5267618 2020-07-29 19:14:55 2020-07-29 21:05:20 2020-07-29 21:27:20 0:22:00 0:14:51 0:07:09 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/progress} 2
pass 5267619 2020-07-29 19:14:56 2020-07-29 21:05:27 2020-07-30 00:19:31 3:14:04 3:06:27 0:07:37 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 5267620 2020-07-29 19:14:57 2020-07-29 21:07:47 2020-07-29 21:39:46 0:31:59 0:21:07 0:10:52 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} 2
pass 5267621 2020-07-29 19:14:58 2020-07-29 21:07:46 2020-07-29 21:39:46 0:32:00 0:23:57 0:08:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 5267622 2020-07-29 19:14:59 2020-07-29 21:07:46 2020-07-29 21:27:45 0:19:59 0:13:15 0:06:44 smithi master rhel 8.1 rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 5267623 2020-07-29 19:15:00 2020-07-29 21:07:47 2020-07-29 21:31:45 0:23:58 0:17:41 0:06:17 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
pass 5267624 2020-07-29 19:15:01 2020-07-29 21:07:47 2020-07-29 21:31:46 0:23:59 0:11:25 0:12:34 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 5267625 2020-07-29 19:15:01 2020-07-29 21:09:37 2020-07-29 22:07:37 0:58:00 0:50:44 0:07:16 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5267626 2020-07-29 19:15:02 2020-07-29 21:09:39 2020-07-29 21:29:38 0:19:59 0:13:36 0:06:23 smithi master rhel 8.1 rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} 2
pass 5267627 2020-07-29 19:15:03 2020-07-29 21:10:32 2020-07-29 21:32:31 0:21:59 0:14:44 0:07:15 smithi master ubuntu 18.04 rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267628 2020-07-29 19:15:04 2020-07-29 21:11:34 2020-07-29 22:37:35 1:26:01 1:17:32 0:08:29 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench} 2
fail 5267629 2020-07-29 19:15:05 2020-07-29 21:11:35 2020-07-29 21:31:33 0:19:58 0:07:26 0:12:32 smithi master ubuntu 18.04 rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 2
Failure Reason:

"2020-07-29T21:27:59.795675+0000 mon.a (mon.0) 31 : cluster [WRN] Health check failed: 2/6 mons down, quorum a,b,c,e (MON_DOWN)" in cluster log

pass 5267630 2020-07-29 19:15:06 2020-07-29 21:11:35 2020-07-29 21:53:34 0:41:59 0:28:22 0:13:37 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5267631 2020-07-29 19:15:07 2020-07-29 21:11:35 2020-07-29 22:15:34 1:03:59 0:11:58 0:52:01 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267632 2020-07-29 19:15:08 2020-07-29 21:11:34 2020-07-29 21:31:33 0:19:59 0:12:34 0:07:25 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5267633 2020-07-29 19:15:09 2020-07-29 21:11:59 2020-07-29 21:31:58 0:19:59 0:12:42 0:07:17 smithi master rhel 8.1 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5267634 2020-07-29 19:15:09 2020-07-29 21:13:42 2020-07-29 21:43:42 0:30:00 0:21:49 0:08:11 smithi master rhel 8.1 rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} 1
pass 5267635 2020-07-29 19:15:10 2020-07-29 21:13:43 2020-07-29 21:41:42 0:27:59 0:13:08 0:14:51 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect} 2
pass 5267636 2020-07-29 19:15:11 2020-07-29 21:13:44 2020-07-29 21:59:43 0:45:59 0:27:14 0:18:45 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5267637 2020-07-29 19:15:12 2020-07-29 21:13:44 2020-07-29 21:43:43 0:29:59 0:22:54 0:07:05 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 5267638 2020-07-29 19:15:13 2020-07-29 21:13:44 2020-07-29 21:47:43 0:33:59 0:27:06 0:06:53 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267639 2020-07-29 19:15:14 2020-07-29 21:15:32 2020-07-29 22:53:33 1:38:01 1:27:59 0:10:02 smithi master centos 8.1 rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
fail 5267640 2020-07-29 19:15:15 2020-07-29 21:15:32 2020-07-29 21:55:32 0:40:00 0:34:26 0:05:34 smithi master rhel 8.1 rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2020-07-29T21:48:24.822223+0000 mon.a (mon.0) 3298 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267641 2020-07-29 19:15:15 2020-07-29 21:15:32 2020-07-29 22:35:33 1:20:01 1:08:35 0:11:26 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5267642 2020-07-29 19:15:16 2020-07-29 21:15:44 2020-07-29 21:45:44 0:30:00 0:23:14 0:06:46 smithi master centos 8.1 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} 1
pass 5267643 2020-07-29 19:15:17 2020-07-29 21:16:31 2020-07-29 21:54:31 0:38:00 0:31:24 0:06:36 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} 2
pass 5267644 2020-07-29 19:15:18 2020-07-29 21:17:33 2020-07-29 21:47:33 0:30:00 0:18:59 0:11:01 smithi master rhel 8.1 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} 2
pass 5267645 2020-07-29 19:15:19 2020-07-29 21:17:33 2020-07-29 21:39:33 0:22:00 0:12:24 0:09:36 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
pass 5267646 2020-07-29 19:15:20 2020-07-29 21:17:39 2020-07-29 22:03:39 0:46:00 0:23:21 0:22:39 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
pass 5267647 2020-07-29 19:15:20 2020-07-29 21:19:29 2020-07-29 21:37:28 0:17:59 0:09:44 0:08:15 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} 1
pass 5267648 2020-07-29 19:15:21 2020-07-29 21:21:25 2020-07-29 21:41:24 0:19:59 0:12:28 0:07:31 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 5267649 2020-07-29 19:15:22 2020-07-29 21:21:25 2020-07-29 21:59:25 0:38:00 0:28:11 0:09:49 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5267650 2020-07-29 19:15:23 2020-07-29 21:21:25 2020-07-29 22:15:25 0:54:00 0:44:03 0:09:57 smithi master centos 8.1 rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 2
fail 5267651 2020-07-29 19:15:24 2020-07-29 21:21:25 2020-07-29 21:45:24 0:23:59 0:12:07 0:11:52 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/prometheus} 2
Failure Reason:

"2020-07-29T21:38:29.115519+0000 mon.a (mon.0) 89 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267652 2020-07-29 19:15:25 2020-07-29 21:23:36 2020-07-29 21:45:36 0:22:00 0:12:36 0:09:24 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5267653 2020-07-29 19:15:26 2020-07-29 21:23:36 2020-07-29 21:45:36 0:22:00 0:12:08 0:09:52 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/set-chunk-promote-flush} 2
pass 5267654 2020-07-29 19:15:26 2020-07-29 21:23:36 2020-07-29 21:43:36 0:20:00 0:12:21 0:07:39 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5267655 2020-07-29 19:15:27 2020-07-29 21:23:39 2020-07-29 21:57:39 0:34:00 0:24:24 0:09:36 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
pass 5267656 2020-07-29 19:15:28 2020-07-29 21:25:37 2020-07-29 21:41:37 0:16:00 0:08:23 0:07:37 smithi master centos 8.1 rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} 1
pass 5267657 2020-07-29 19:15:29 2020-07-29 21:25:37 2020-07-29 21:47:37 0:22:00 0:11:44 0:10:16 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5267658 2020-07-29 19:15:30 2020-07-29 21:25:38 2020-07-29 21:55:37 0:29:59 0:14:33 0:15:26 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 5267659 2020-07-29 19:15:31 2020-07-29 21:25:38 2020-07-29 22:03:38 0:38:00 0:23:54 0:14:06 smithi master rhel 8.1 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 2
pass 5267660 2020-07-29 19:15:32 2020-07-29 21:25:38 2020-07-29 22:01:37 0:35:59 0:25:56 0:10:03 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} 2
pass 5267661 2020-07-29 19:15:32 2020-07-29 21:27:37 2020-07-29 21:55:37 0:28:00 0:19:33 0:08:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 5267662 2020-07-29 19:15:33 2020-07-29 21:27:37 2020-07-29 22:07:37 0:40:00 0:15:48 0:24:12 smithi master rhel 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 5267663 2020-07-29 19:15:34 2020-07-29 21:27:37 2020-07-29 21:47:37 0:20:00 0:10:00 0:10:00 smithi master centos 8.1 rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
Failure Reason:

Command failed on smithi172 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json'

pass 5267664 2020-07-29 19:15:35 2020-07-29 21:27:47 2020-07-29 23:09:49 1:42:02 1:35:18 0:06:44 smithi master rhel 8.1 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
pass 5267665 2020-07-29 19:15:36 2020-07-29 21:29:40 2020-07-29 23:09:42 1:40:02 1:31:46 0:08:16 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 5267666 2020-07-29 19:15:37 2020-07-29 21:29:59 2020-07-29 21:49:59 0:20:00 0:13:48 0:06:12 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} 1
pass 5267667 2020-07-29 19:15:38 2020-07-29 21:31:44 2020-07-29 22:05:44 0:34:00 0:23:02 0:10:58 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 5267668 2020-07-29 19:15:39 2020-07-29 21:31:45 2020-07-29 22:13:44 0:41:59 0:27:07 0:14:52 smithi master ubuntu 18.04 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
pass 5267669 2020-07-29 19:15:40 2020-07-29 21:31:45 2020-07-29 21:49:44 0:17:59 0:11:12 0:06:47 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 5267670 2020-07-29 19:15:41 2020-07-29 21:31:45 2020-07-29 22:25:45 0:54:00 0:10:45 0:43:15 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5267671 2020-07-29 19:15:42 2020-07-29 21:31:47 2020-07-29 23:43:50 2:12:03 2:03:41 0:08:22 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
pass 5267672 2020-07-29 19:15:43 2020-07-29 21:31:47 2020-07-29 21:49:47 0:18:00 0:10:12 0:07:48 smithi master centos 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_5925} 2
pass 5267673 2020-07-29 19:15:44 2020-07-29 21:31:59 2020-07-29 22:11:59 0:40:00 0:26:47 0:13:13 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 5267674 2020-07-29 19:15:45 2020-07-29 21:32:33 2020-07-29 22:06:33 0:34:00 0:25:38 0:08:22 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5267675 2020-07-29 19:15:46 2020-07-29 21:33:34 2020-07-29 21:55:34 0:22:00 0:14:00 0:08:00 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} 2
pass 5267676 2020-07-29 19:15:47 2020-07-29 21:33:34 2020-07-29 22:07:34 0:34:00 0:27:38 0:06:22 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_latest}} 1
pass 5267677 2020-07-29 19:15:48 2020-07-29 21:33:40 2020-07-29 22:53:41 1:20:01 1:08:03 0:11:58 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5267678 2020-07-29 19:15:48 2020-07-29 21:35:33 2020-07-30 02:31:40 4:56:07 4:41:57 0:14:10 smithi master rhel 8.1 rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} 1
pass 5267679 2020-07-29 19:15:49 2020-07-29 21:35:34 2020-07-29 21:53:32 0:17:58 0:08:23 0:09:35 smithi master centos 8.1 rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5267680 2020-07-29 19:15:50 2020-07-29 21:35:33 2020-07-29 22:11:33 0:36:00 0:27:23 0:08:37 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5267681 2020-07-29 19:15:51 2020-07-29 21:35:34 2020-07-29 21:59:33 0:23:59 0:12:33 0:11:26 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5267682 2020-07-29 19:15:52 2020-07-29 21:35:35 2020-07-29 22:05:34 0:29:59 0:19:50 0:10:09 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} 2
fail 5267683 2020-07-29 19:15:53 2020-07-29 21:37:54 2020-07-29 22:39:53 1:01:59 0:24:36 0:37:23 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

fail 5267684 2020-07-29 19:15:54 2020-07-29 21:37:53 2020-07-29 21:53:52 0:15:59 0:09:09 0:06:50 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/workunits} 2
Failure Reason:

"2020-07-29T21:51:00.684232+0000 mon.b (mon.0) 87 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267685 2020-07-29 19:15:55 2020-07-29 21:39:48 2020-07-29 22:15:46 0:35:58 0:28:56 0:07:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5267686 2020-07-29 19:15:56 2020-07-29 21:39:48 2020-07-29 22:25:46 0:45:58 0:34:48 0:11:10 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async start tasks/rados_api_tests} 2
pass 5267687 2020-07-29 19:15:56 2020-07-29 21:39:49 2020-07-29 21:53:47 0:13:58 0:07:38 0:06:20 smithi master centos 8.1 rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5267688 2020-07-29 19:15:57 2020-07-29 21:39:48 2020-07-29 21:57:46 0:17:58 0:11:23 0:06:35 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5267689 2020-07-29 19:15:58 2020-07-29 21:40:34 2020-07-29 22:16:33 0:35:59 0:27:08 0:08:51 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
pass 5267690 2020-07-29 19:15:59 2020-07-29 21:41:47 2020-07-29 21:53:46 0:11:59 0:04:40 0:07:19 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} 1
pass 5267691 2020-07-29 19:16:00 2020-07-29 21:41:48 2020-07-29 22:01:47 0:19:59 0:12:57 0:07:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5267692 2020-07-29 19:16:01 2020-07-29 21:41:47 2020-07-29 22:03:47 0:22:00 0:12:53 0:09:07 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
fail 5267693 2020-07-29 19:16:02 2020-07-29 21:41:47 2020-07-29 21:55:46 0:13:59 0:08:24 0:05:35 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

"2020-07-29T21:52:01.499425+0000 mon.a (mon.0) 73 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log

pass 5267694 2020-07-29 19:16:03 2020-07-29 21:43:53 2020-07-29 22:13:53 0:30:00 0:22:12 0:07:48 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5267695 2020-07-29 19:16:04 2020-07-29 21:43:53 2020-07-29 22:03:53 0:20:00 0:11:44 0:08:16 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5267696 2020-07-29 19:16:04 2020-07-29 21:43:54 2020-07-29 22:01:53 0:17:59 0:12:48 0:05:11 smithi master rhel 8.1 rados/singleton/{all/deduptool msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 5267697 2020-07-29 19:16:05 2020-07-29 21:43:53 2020-07-29 22:15:53 0:32:00 0:21:44 0:10:16 smithi master ubuntu 18.04 rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 5267698 2020-07-29 19:16:06 2020-07-29 21:45:11 2020-07-29 22:13:11 0:28:00 0:21:33 0:06:27 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5267699 2020-07-29 19:16:07 2020-07-29 21:45:25 2020-07-29 22:15:24 0:29:59 0:21:55 0:08:04 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} 2
pass 5267700 2020-07-29 19:16:08 2020-07-29 21:45:26 2020-07-29 22:05:24 0:19:58 0:11:54 0:08:04 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5267701 2020-07-29 19:16:09 2020-07-29 21:45:27 2020-07-29 22:49:27 1:04:00 0:30:47 0:33:13 smithi master rhel 8.1 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5267702 2020-07-29 19:16:10 2020-07-29 21:45:38 2020-07-29 22:07:38 0:22:00 0:12:50 0:09:10 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 5267703 2020-07-29 19:16:11 2020-07-29 21:45:39 2020-07-29 22:29:39 0:44:00 0:29:44 0:14:16 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} 2