Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 4901586 2020-03-29 14:36:16 2020-03-29 15:01:41 2020-03-30 03:04:08 12:02:27 smithi master centos 8.1 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4901587 2020-03-29 14:36:17 2020-03-29 15:01:41 2020-03-29 15:27:41 0:26:00 0:18:34 0:07:26 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_cephadm.yaml} 1
fail 4901588 2020-03-29 14:36:18 2020-03-29 15:03:37 2020-03-29 15:25:37 0:22:00 0:09:19 0:12:41 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 3
Failure Reason:

Command failed on smithi154 with status 5: 'sudo systemctl stop ceph-599f8fca-71d1-11ea-924b-001a4aab830c@mon.a'

dead 4901589 2020-03-29 14:36:18 2020-03-29 15:03:39 2020-03-30 03:06:05 12:02:26 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 4901590 2020-03-29 14:36:19 2020-03-29 15:03:39 2020-03-29 15:29:38 0:25:59 0:10:51 0:15:08 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8.yaml} workloads/mgr.yaml} 1
fail 4901591 2020-03-29 14:36:20 2020-03-29 15:03:38 2020-03-29 15:59:38 0:56:00 0:41:15 0:14:45 smithi master ubuntu 18.04 rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

reached maximum tries (200) after waiting for 1200 seconds

pass 4901592 2020-03-29 14:36:21 2020-03-29 15:03:38 2020-03-29 15:31:37 0:27:59 0:16:03 0:11:56 smithi master centos 8.1 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/repair_test.yaml} 2
pass 4901593 2020-03-29 14:36:22 2020-03-29 15:03:38 2020-03-29 15:43:37 0:39:59 0:25:52 0:14:07 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/module_selftest.yaml} 2
pass 4901594 2020-03-29 14:36:23 2020-03-29 15:03:38 2020-03-29 15:17:37 0:13:59 0:07:35 0:06:24 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
pass 4901595 2020-03-29 14:36:24 2020-03-29 15:03:38 2020-03-29 15:43:38 0:40:00 0:11:19 0:28:41 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 4901596 2020-03-29 14:36:25 2020-03-29 15:03:37 2020-03-29 15:57:37 0:54:00 0:44:14 0:09:46 smithi master centos 8.1 rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
pass 4901597 2020-03-29 14:36:26 2020-03-29 15:03:37 2020-03-29 15:27:37 0:24:00 0:12:02 0:11:58 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
dead 4901598 2020-03-29 14:36:26 2020-03-29 15:03:38 2020-03-30 03:06:05 12:02:27 11:51:26 0:11:01 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=11771)

fail 4901599 2020-03-29 14:36:27 2020-03-29 15:03:38 2020-03-29 15:23:38 0:20:00 0:03:08 0:16:52 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml} 2
Failure Reason:

empty file

pass 4901600 2020-03-29 14:36:28 2020-03-29 15:03:38 2020-03-29 15:21:37 0:17:59 0:10:49 0:07:10 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_rw.yaml} 1
dead 4901601 2020-03-29 14:36:29 2020-03-29 15:03:38 2020-03-30 03:06:05 12:02:27 11:54:24 0:08:03 smithi master ubuntu 18.04 rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=31522)

dead 4901602 2020-03-29 14:36:30 2020-03-29 15:03:38 2020-03-30 03:06:05 12:02:27 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 4901603 2020-03-29 14:36:31 2020-03-29 15:03:39 2020-03-29 16:15:39 1:12:00 0:55:23 0:16:37 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} 2
pass 4901604 2020-03-29 14:36:32 2020-03-29 15:05:38 2020-03-29 17:25:39 2:20:01 2:14:38 0:05:23 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
pass 4901605 2020-03-29 14:36:32 2020-03-29 15:05:38 2020-03-29 15:33:37 0:27:59 0:20:09 0:07:50 smithi master centos 8.1 rados/valgrind-leaks/{1-start.yaml 2-inject-leak/none.yaml centos_latest.yaml} 1
fail 4901606 2020-03-29 14:36:33 2020-03-29 15:05:38 2020-03-29 15:19:37 0:13:59 0:06:38 0:07:21 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi173 with status 5: 'sudo systemctl stop ceph-5eed0d50-71d0-11ea-924b-001a4aab830c@mon.a'

pass 4901607 2020-03-29 14:36:34 2020-03-29 15:05:38 2020-03-29 15:23:37 0:17:59 0:10:28 0:07:31 smithi master ubuntu 18.04 rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} 2
dead 4901608 2020-03-29 14:36:35 2020-03-29 15:05:38 2020-03-30 03:08:01 12:02:23 11:50:46 0:11:37 smithi master centos 8.1 rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml}}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=7539)

dead 4901609 2020-03-29 14:36:36 2020-03-29 15:05:38 2020-03-30 03:08:05 12:02:27 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} 2
pass 4901610 2020-03-29 14:36:37 2020-03-29 15:05:38 2020-03-29 15:43:38 0:38:00 0:24:16 0:13:44 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 4901611 2020-03-29 14:36:38 2020-03-29 15:05:38 2020-03-29 15:21:37 0:15:59 0:07:49 0:08:10 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4901612 2020-03-29 14:36:38 2020-03-29 15:07:27 2020-03-29 15:19:25 0:11:58 0:05:10 0:06:48 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml} 2
Failure Reason:

empty file

fail 4901613 2020-03-29 14:36:39 2020-03-29 15:07:27 2020-03-29 15:45:26 0:37:59 0:28:37 0:09:22 smithi master centos 8.1 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
Failure Reason:

"2020-03-29T15:27:17.220844+0000 mon.a (mon.0) 95 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 4901614 2020-03-29 14:36:40 2020-03-29 15:07:27 2020-03-29 15:27:26 0:19:59 0:08:28 0:11:31 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/radosbench.yaml} 3
Failure Reason:

Command failed on smithi112 with status 5: 'sudo systemctl stop ceph-7ce424b4-71d1-11ea-924b-001a4aab830c@mon.a'

pass 4901615 2020-03-29 14:36:41 2020-03-29 15:07:27 2020-03-29 15:25:26 0:17:59 0:11:42 0:06:17 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_write.yaml} 1
pass 4901616 2020-03-29 14:36:42 2020-03-29 15:07:27 2020-03-29 15:25:26 0:17:59 0:11:08 0:06:51 smithi master ubuntu 18.04 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/scrub_test.yaml} 2
pass 4901617 2020-03-29 14:36:43 2020-03-29 15:07:27 2020-03-29 15:23:26 0:15:59 0:09:10 0:06:49 smithi master ubuntu 18.04 rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4901618 2020-03-29 14:36:44 2020-03-29 15:07:38 2020-03-29 15:43:37 0:35:59 0:27:06 0:08:53 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

"2020-03-29T15:29:02.712142+0000 mon.a (mon.0) 1759 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

pass 4901619 2020-03-29 14:36:45 2020-03-29 15:07:38 2020-03-29 15:41:37 0:33:59 0:25:23 0:08:36 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 4901620 2020-03-29 14:36:46 2020-03-29 15:07:39 2020-03-29 15:33:38 0:25:59 0:12:01 0:13:58 smithi master centos 8.1 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} tasks/progress.yaml} 2
pass 4901621 2020-03-29 14:36:46 2020-03-29 15:07:45 2020-03-29 15:21:45 0:14:00 0:04:48 0:09:12 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml} 1
fail 4901622 2020-03-29 14:36:47 2020-03-29 15:09:36 2020-03-29 20:25:41 5:16:05 5:07:25 0:08:40 smithi master centos 8.1 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
Failure Reason:

Command failed on smithi136 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json'

pass 4901623 2020-03-29 14:36:48 2020-03-29 15:09:36 2020-03-29 15:31:35 0:21:59 0:11:27 0:10:32 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4901624 2020-03-29 14:36:49 2020-03-29 15:09:36 2020-03-29 15:45:36 0:36:00 0:28:06 0:07:54 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
dead 4901625 2020-03-29 14:36:50 2020-03-29 15:09:36 2020-03-30 03:12:04 12:02:28 smithi master centos 8.1 rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 4901626 2020-03-29 14:36:51 2020-03-29 15:09:38 2020-03-29 15:47:37 0:37:59 0:28:36 0:09:23 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps-balanced.yaml} 2
Failure Reason:

"2020-03-29T15:31:46.624353+0000 mon.b (mon.0) 329 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

fail 4901627 2020-03-29 14:36:52 2020-03-29 15:09:38 2020-03-29 18:53:41 3:44:03 3:32:31 0:11:32 smithi master centos 8.1 rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi195 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33fa4d8815d50123cf49055d852a6d2a9f1c5bdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

pass 4901628 2020-03-29 14:36:53 2020-03-29 15:09:38 2020-03-29 15:25:37 0:15:59 0:09:30 0:06:29 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4901629 2020-03-29 14:36:54 2020-03-29 15:09:38 2020-03-29 15:27:38 0:18:00 0:08:38 0:09:22 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml} 2
Failure Reason:

Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-53d34118-71d1-11ea-924b-001a4aab830c@mon.a'

pass 4901630 2020-03-29 14:36:55 2020-03-29 15:09:39 2020-03-29 15:29:38 0:19:59 0:11:59 0:08:00 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_rand_read.yaml} 1
pass 4901631 2020-03-29 14:36:55 2020-03-29 15:09:39 2020-03-29 15:41:38 0:31:59 0:21:58 0:10:01 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
dead 4901632 2020-03-29 14:36:56 2020-03-29 15:09:39 2020-03-30 03:12:06 12:02:27 smithi master ubuntu 18.04 rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4901633 2020-03-29 14:36:57 2020-03-29 15:10:02 2020-03-29 15:40:02 0:30:00 0:22:59 0:07:01 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} 1
pass 4901634 2020-03-29 14:36:58 2020-03-29 15:11:11 2020-03-29 15:27:10 0:15:59 0:07:43 0:08:16 smithi master centos 8.1 rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_clock_no_skews.yaml} 2
fail 4901635 2020-03-29 14:36:59 2020-03-29 15:11:11 2020-03-29 15:23:10 0:11:59 0:03:10 0:08:49 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml} 2
Failure Reason:

empty file

dead 4901636 2020-03-29 14:37:00 2020-03-29 15:11:27 2020-03-30 03:13:55 12:02:28 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 4901637 2020-03-29 14:37:01 2020-03-29 15:11:28 2020-03-29 16:15:28 1:04:00 0:56:14 0:07:46 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} 2
pass 4901638 2020-03-29 14:37:02 2020-03-29 15:11:38 2020-03-29 17:43:40 2:32:02 2:26:15 0:05:47 smithi master ubuntu 18.04 rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
pass 4901639 2020-03-29 14:37:03 2020-03-29 15:11:39 2020-03-29 15:47:38 0:35:59 0:29:40 0:06:19 smithi master centos 8.1 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
pass 4901640 2020-03-29 14:37:03 2020-03-29 15:11:39 2020-03-29 15:41:38 0:29:59 0:22:15 0:07:44 smithi master centos 8.1 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
fail 4901641 2020-03-29 14:37:04 2020-03-29 15:11:39 2020-03-29 15:43:38 0:31:59 0:08:11 0:23:48 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} 3
Failure Reason:

Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-bfed319a-71d3-11ea-924b-001a4aab830c@mon.a'

fail 4901642 2020-03-29 14:37:05 2020-03-29 15:11:39 2020-03-29 18:47:42 3:36:03 3:23:57 0:12:06 smithi master centos 8.1 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi169 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33fa4d8815d50123cf49055d852a6d2a9f1c5bdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

dead 4901643 2020-03-29 14:37:06 2020-03-29 15:11:39 2020-03-30 03:14:06 12:02:27 smithi master centos 8.1 rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 2
fail 4901644 2020-03-29 14:37:07 2020-03-29 15:11:39 2020-03-29 15:45:39 0:34:00 0:23:50 0:10:10 smithi master ubuntu 18.04 rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} 2
Failure Reason:

"2020-03-29T15:26:27.528801+0000 mon.b (mon.0) 235 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 4901645 2020-03-29 14:37:08 2020-03-29 15:11:39 2020-03-29 15:51:39 0:40:00 0:11:21 0:28:39 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} 2
fail 4901646 2020-03-29 14:37:09 2020-03-29 15:13:27 2020-03-29 15:33:26 0:19:59 0:06:35 0:13:24 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

Command failed on smithi173 with status 5: 'sudo systemctl stop ceph-2d6da3c8-71d2-11ea-924b-001a4aab830c@mon.a'

pass 4901647 2020-03-29 14:37:10 2020-03-29 15:13:28 2020-03-29 15:59:27 0:45:59 0:26:30 0:19:29 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4901648 2020-03-29 14:37:11 2020-03-29 15:13:28 2020-03-29 15:33:27 0:19:59 0:08:17 0:11:42 smithi master centos 8.1 rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
pass 4901649 2020-03-29 14:37:12 2020-03-29 15:13:28 2020-03-29 15:35:27 0:21:59 0:10:53 0:11:06 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_seq_read.yaml} 1
pass 4901650 2020-03-29 14:37:13 2020-03-29 15:13:27 2020-03-29 15:41:27 0:28:00 0:10:27 0:17:33 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-avl.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/prometheus.yaml} 2
pass 4901651 2020-03-29 14:37:14 2020-03-29 15:13:27 2020-03-29 16:35:28 1:22:01 0:11:44 1:10:17 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4901652 2020-03-29 14:37:15 2020-03-29 15:13:28 2020-03-29 15:51:27 0:37:59 0:19:32 0:18:27 smithi master ubuntu 18.04 rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4901653 2020-03-29 14:37:15 2020-03-29 15:13:28 2020-03-29 16:01:27 0:47:59 0:26:39 0:21:20 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 4901654 2020-03-29 14:37:16 2020-03-29 15:13:30 2020-03-29 15:51:29 0:37:59 0:11:23 0:26:36 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
fail 4901655 2020-03-29 14:37:17 2020-03-29 15:13:33 2020-03-29 15:51:32 0:37:59 0:27:25 0:10:34 smithi master centos 8.1 rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
Failure Reason:

saw valgrind issues

pass 4901656 2020-03-29 14:37:18 2020-03-29 15:13:33 2020-03-29 15:31:32 0:17:59 0:08:17 0:09:42 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml} 1
pass 4901657 2020-03-29 14:37:19 2020-03-29 15:13:33 2020-03-29 20:07:38 4:54:05 3:39:32 1:14:33 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml thrashosds-health.yaml ubuntu_latest.yaml} 4
dead 4901658 2020-03-29 14:37:20 2020-03-29 15:15:36 2020-03-30 03:20:04 12:04:28 11:48:11 0:16:17 smithi master centos 8.1 rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml}}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=14938)

fail 4901659 2020-03-29 14:37:21 2020-03-29 15:15:36 2020-03-29 20:57:42 5:42:06 5:24:21 0:17:45 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi094 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33fa4d8815d50123cf49055d852a6d2a9f1c5bdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 4901660 2020-03-29 14:37:22 2020-03-29 15:17:55 2020-03-29 15:39:54 0:21:59 0:11:38 0:10:21 smithi master ubuntu 18.04 rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
pass 4901661 2020-03-29 14:37:23 2020-03-29 15:19:46 2020-03-29 15:37:45 0:17:59 0:12:00 0:05:59 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_rand_read.yaml} 1
dead 4901662 2020-03-29 14:37:23 2020-03-29 15:19:46 2020-03-30 03:22:14 12:02:28 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
pass 4901663 2020-03-29 14:37:24 2020-03-29 15:21:54 2020-03-29 15:39:53 0:17:59 0:09:36 0:08:23 smithi master centos 8.1 rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
fail 4901664 2020-03-29 14:37:25 2020-03-29 15:21:54 2020-03-29 18:57:57 3:36:03 3:25:39 0:10:24 smithi master centos 8.1 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_cls_all.yaml} 2
Failure Reason:

Command failed (workunit test cls/test_cls_rgw.sh) on smithi068 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=33fa4d8815d50123cf49055d852a6d2a9f1c5bdd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh'

fail 4901665 2020-03-29 14:37:26 2020-03-29 15:21:54 2020-03-29 15:43:54 0:22:00 0:06:45 0:15:15 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 3
Failure Reason:

Command failed on smithi002 with status 5: 'sudo systemctl stop ceph-f8da6e14-71d3-11ea-924b-001a4aab830c@mon.a'

pass 4901666 2020-03-29 14:37:27 2020-03-29 15:23:50 2020-03-29 15:43:50 0:20:00 0:07:46 0:12:14 smithi master centos 8.1 rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_clock_with_skews.yaml} 3
fail 4901667 2020-03-29 14:37:28 2020-03-29 15:23:51 2020-03-29 17:19:52 1:56:01 1:44:20 0:11:41 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/radosbench-high-concurrency.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 4901668 2020-03-29 14:37:29 2020-03-29 15:25:43 2020-03-29 15:41:42 0:15:59 0:07:49 0:08:10 smithi master centos 8.1 rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
pass 4901669 2020-03-29 14:37:30 2020-03-29 15:25:43 2020-03-29 16:03:43 0:38:00 0:27:54 0:10:06 smithi master centos 8.1 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} 2
fail 4901670 2020-03-29 14:37:31 2020-03-29 15:25:43 2020-03-29 15:49:43 0:24:00 0:04:58 0:19:02 smithi master centos 7.6 rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml} 2
Failure Reason:

empty file

fail 4901671 2020-03-29 14:37:32 2020-03-29 15:25:43 2020-03-29 15:39:42 0:13:59 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} 2
Failure Reason:

Command failed on smithi042 with status 1: 'sudo yum install -y kernel'

pass 4901672 2020-03-29 14:37:33 2020-03-29 15:25:43 2020-03-29 15:39:43 0:14:00 0:07:02 0:06:58 smithi master ubuntu 18.04 rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
fail 4901673 2020-03-29 14:37:34 2020-03-29 15:25:43 2020-03-30 01:05:54 9:40:11 9:30:17 0:09:54 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 4901674 2020-03-29 14:37:35 2020-03-29 15:27:06 2020-03-29 15:47:05 0:19:59 0:10:28 0:09:31 smithi master ubuntu 18.04 rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} 2
pass 4901675 2020-03-29 14:37:35 2020-03-29 15:27:08 2020-03-29 15:45:07 0:17:59 0:07:45 0:10:14 smithi master centos 8.1 rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
pass 4901676 2020-03-29 14:37:36 2020-03-29 15:27:11 2020-03-29 16:01:11 0:34:00 0:23:25 0:10:35 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4901677 2020-03-29 14:37:37 2020-03-29 15:27:27 2020-03-29 16:13:27 0:46:00 0:38:15 0:07:45 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8.yaml} workloads/mon.yaml} 1
pass 4901678 2020-03-29 14:37:38 2020-03-29 15:27:34 2020-03-29 16:03:33 0:35:59 0:11:06 0:24:53 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4901679 2020-03-29 14:37:39 2020-03-29 15:27:38 2020-03-29 15:49:37 0:21:59 0:08:27 0:13:32 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/workunits.yaml} 2
dead 4901680 2020-03-29 14:37:40 2020-03-29 15:27:39 2020-03-30 03:30:06 12:02:27 smithi master centos 8.0 rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{centos_8.0.yaml} fixed-2.yaml} 2
pass 4901681 2020-03-29 14:37:41 2020-03-29 15:27:42 2020-03-29 15:45:41 0:17:59 0:10:41 0:07:18 smithi master ubuntu 18.04 rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_seq_read.yaml} 1
pass 4901682 2020-03-29 14:37:42 2020-03-29 15:29:54 2020-03-29 16:03:54 0:34:00 0:13:51 0:20:09 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 4901683 2020-03-29 14:37:42 2020-03-29 15:29:54 2020-03-29 15:47:53 0:17:59 0:09:07 0:08:52 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
fail 4901684 2020-03-29 14:37:43 2020-03-29 15:29:54 2020-03-29 21:06:00 5:36:06 5:11:32 0:24:34 smithi master centos 8.1 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

Command failed on smithi129 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json'

dead 4901685 2020-03-29 14:37:44 2020-03-29 15:31:49 2020-03-30 03:34:12 12:02:23 smithi master centos 8.1 rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
pass 4901686 2020-03-29 14:37:45 2020-03-29 15:31:49 2020-03-29 15:47:48 0:15:59 0:08:16 0:07:43 smithi master centos 8.1 rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} 1
dead 4901687 2020-03-29 14:37:46 2020-03-29 15:31:49 2020-03-30 03:34:16 12:02:27 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2