Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5182862 2020-06-27 03:47:24 2020-06-27 03:49:28 2020-06-27 04:09:27 0:19:59 0:13:49 0:06:10 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
Failure Reason:

Test failure: test_create_multiple_exports (tasks.cephfs.test_nfs.TestNFS)

dead 5182863 2020-06-27 03:47:25 2020-06-27 03:49:28 2020-06-27 06:07:31 2:18:03 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
pass 5182864 2020-06-27 03:47:26 2020-06-27 03:49:29 2020-06-27 04:11:28 0:21:59 0:11:37 0:10:22 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
dead 5182865 2020-06-27 03:47:27 2020-06-27 03:49:28 2020-06-27 06:07:31 2:18:03 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
dead 5182866 2020-06-27 03:47:28 2020-06-27 03:49:28 2020-06-27 06:07:31 2:18:03 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
dead 5182867 2020-06-27 03:47:29 2020-06-27 03:49:28 2020-06-27 06:07:31 2:18:03 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
fail 5182868 2020-06-27 03:47:30 2020-06-27 03:51:24 2020-06-27 04:09:24 0:18:00 0:10:41 0:07:19 smithi master rhel 8.1 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command failed (workunit test objectstore/test_fuse.sh) on smithi200 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=77ddaecfcb04c342c0c9aaa7e71da5c0501c57e5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/objectstore/test_fuse.sh'

pass 5182869 2020-06-27 03:47:31 2020-06-27 03:51:25 2020-06-27 04:19:24 0:27:59 0:17:32 0:10:27 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_latest} fixed-2} 2
dead 5182870 2020-06-27 03:47:32 2020-06-27 03:51:25 2020-06-27 06:07:27 2:16:02 2:07:53 0:08:09 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=23612)

dead 5182871 2020-06-27 03:47:33 2020-06-27 03:51:25 2020-06-27 06:07:27 2:16:02 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
dead 5182872 2020-06-27 03:47:34 2020-06-27 03:53:20 2020-06-27 06:07:23 2:14:03 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
dead 5182873 2020-06-27 03:47:35 2020-06-27 03:53:20 2020-06-27 06:07:23 2:14:03 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
dead 5182874 2020-06-27 03:47:36 2020-06-27 03:53:20 2020-06-27 06:07:23 2:14:03 smithi master centos 8.1 rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} 1
dead 5182875 2020-06-27 03:47:36 2020-06-27 03:53:20 2020-06-27 06:07:23 2:14:03 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async start tasks/rados_python} 2
dead 5182876 2020-06-27 03:47:37 2020-06-27 03:53:24 2020-06-27 06:07:26 2:14:02 2:05:37 0:08:25 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
Failure Reason:

SSH connection to smithi058 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'

dead 5182877 2020-06-27 03:47:38 2020-06-27 03:53:24 2020-06-27 06:07:26 2:14:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
dead 5182878 2020-06-27 03:47:39 2020-06-27 03:55:29 2020-06-27 06:07:32 2:12:03 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
dead 5182879 2020-06-27 03:47:40 2020-06-27 03:55:30 2020-06-27 06:07:32 2:12:02 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
dead 5182880 2020-06-27 03:47:41 2020-06-27 03:55:30 2020-06-27 06:07:32 2:12:02 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} 2
pass 5182881 2020-06-27 03:47:42 2020-06-27 03:57:23 2020-06-27 04:19:22 0:21:59 0:10:12 0:11:47 smithi master ubuntu 18.04 rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
dead 5182882 2020-06-27 03:47:43 2020-06-27 03:57:24 2020-06-27 06:07:26 2:10:02 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} 2
fail 5182883 2020-06-27 03:47:45 2020-06-27 03:57:33 2020-06-27 04:13:33 0:16:00 0:06:03 0:09:57 smithi master ubuntu 18.04 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'"

dead 5182884 2020-06-27 03:47:46 2020-06-27 03:59:20 2020-06-27 06:07:23 2:08:03 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
fail 5182885 2020-06-27 03:47:47 2020-06-27 03:59:20 2020-06-27 04:39:20 0:40:00 0:24:47 0:15:13 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5182886 2020-06-27 03:47:48 2020-06-27 03:59:23 2020-06-27 04:21:23 0:22:00 0:15:08 0:06:52 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
dead 5182887 2020-06-27 03:47:48 2020-06-27 03:59:38 2020-06-27 06:07:40 2:08:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
dead 5182888 2020-06-27 03:47:49 2020-06-27 04:01:30 2020-06-27 06:07:32 2:06:02 smithi master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
dead 5182889 2020-06-27 03:47:50 2020-06-27 04:01:30 2020-06-27 06:07:32 2:06:02 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
fail 5182890 2020-06-27 03:47:51 2020-06-27 04:01:30 2020-06-27 04:27:30 0:26:00 0:15:23 0:10:37 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
Failure Reason:

Test failure: test_create_multiple_exports (tasks.cephfs.test_nfs.TestNFS)

dead 5182891 2020-06-27 03:47:52 2020-06-27 04:01:30 2020-06-27 06:07:32 2:06:02 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
dead 5182892 2020-06-27 03:47:53 2020-06-27 04:01:30 2020-06-27 06:07:32 2:06:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} 2
dead 5182893 2020-06-27 03:47:54 2020-06-27 04:01:30 2020-06-27 06:07:33 2:06:03 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} 2
dead 5182894 2020-06-27 03:47:55 2020-06-27 04:03:31 2020-06-27 06:07:33 2:04:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} 2
dead 5182895 2020-06-27 03:47:56 2020-06-27 04:03:31 2020-06-27 06:07:33 2:04:02 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
fail 5182896 2020-06-27 03:47:57 2020-06-27 04:03:31 2020-06-27 04:39:31 0:36:00 0:24:44 0:11:16 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

dead 5182897 2020-06-27 03:47:58 2020-06-27 04:03:31 2020-06-27 06:07:33 2:04:02 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
dead 5182898 2020-06-27 03:47:59 2020-06-27 04:03:31 2020-06-27 06:07:33 2:04:02 1:56:18 0:07:44 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=11630)

fail 5182899 2020-06-27 03:48:00 2020-06-27 04:03:33 2020-06-27 04:25:33 0:22:00 0:16:21 0:05:39 smithi master centos 8.1 rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2020-06-27T04:13:10.026243+0000 mon.a (mon.0) 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 5182900 2020-06-27 03:48:01 2020-06-27 04:05:27 2020-06-27 04:27:27 0:22:00 0:12:41 0:09:19 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
pass 5182901 2020-06-27 03:48:02 2020-06-27 04:05:28 2020-06-27 04:25:27 0:19:59 0:11:35 0:08:24 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
dead 5182902 2020-06-27 03:48:03 2020-06-27 04:05:28 2020-06-27 06:07:30 2:02:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 2
dead 5182903 2020-06-27 03:48:03 2020-06-27 04:05:28 2020-06-27 06:07:30 2:02:02 smithi master centos 8.1 rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} 1
dead 5182904 2020-06-27 03:48:04 2020-06-27 04:05:28 2020-06-27 06:07:30 2:02:02 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async start tasks/rados_python} 2
dead 5182905 2020-06-27 03:48:05 2020-06-27 04:05:28 2020-06-27 06:07:30 2:02:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} 2
pass 5182906 2020-06-27 03:48:06 2020-06-27 04:05:28 2020-06-27 05:15:29 1:10:01 0:57:26 0:12:35 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
dead 5182907 2020-06-27 03:48:07 2020-06-27 04:05:30 2020-06-27 06:07:32 2:02:02 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} 3
fail 5182908 2020-06-27 03:48:08 2020-06-27 04:07:19 2020-06-27 04:37:19 0:30:00 0:10:58 0:19:02 smithi master rhel 8.1 rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\''

dead 5182909 2020-06-27 03:48:09 2020-06-27 04:07:21 2020-06-27 06:07:24 2:00:03 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
dead 5182910 2020-06-27 03:48:10 2020-06-27 04:07:25 2020-06-27 06:07:27 2:00:02 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} 2
pass 5182911 2020-06-27 03:48:11 2020-06-27 04:07:26 2020-06-27 04:57:26 0:50:00 0:43:18 0:06:42 smithi master centos 8.1 rados/singleton/{all/thrash-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 5182912 2020-06-27 03:48:11 2020-06-27 04:07:26 2020-06-27 04:29:25 0:21:59 0:12:43 0:09:16 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
dead 5182913 2020-06-27 03:48:12 2020-06-27 04:07:26 2020-06-27 06:07:28 2:00:02 1:51:47 0:08:15 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=30474)

fail 5182914 2020-06-27 03:48:13 2020-06-27 04:07:27 2020-06-27 04:27:27 0:20:00 0:13:41 0:06:19 smithi master centos 8.1 rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} 1
Failure Reason:

Test failure: test_create_multiple_exports (tasks.cephfs.test_nfs.TestNFS)

dead 5182915 2020-06-27 03:48:14 2020-06-27 04:09:31 2020-06-27 06:07:33 1:58:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect} 2
pass 5182916 2020-06-27 03:48:15 2020-06-27 04:09:31 2020-06-27 04:49:31 0:40:00 0:34:17 0:05:43 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
dead 5182917 2020-06-27 03:48:16 2020-06-27 04:09:31 2020-06-27 06:07:33 1:58:02 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
dead 5182918 2020-06-27 03:48:17 2020-06-27 04:09:31 2020-06-27 06:07:33 1:58:02 smithi master rhel 8.1 rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 2
dead 5182919 2020-06-27 03:48:18 2020-06-27 04:09:31 2020-06-27 06:07:33 1:58:02 smithi master rhel 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
dead 5182920 2020-06-27 03:48:19 2020-06-27 04:09:33 2020-06-27 06:09:36 2:00:03 0:28:24 1:31:39 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=11793)

dead 5182921 2020-06-27 03:48:20 2020-06-27 04:11:28 2020-06-27 06:07:30 1:56:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
dead 5182922 2020-06-27 03:48:21 2020-06-27 04:11:28 2020-06-27 06:07:30 1:56:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} 2
pass 5182923 2020-06-27 03:48:21 2020-06-27 04:11:29 2020-06-27 04:33:29 0:22:00 0:15:11 0:06:49 smithi master centos 8.1 rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2} 2
dead 5182924 2020-06-27 03:48:22 2020-06-27 04:13:44 2020-06-27 06:07:46 1:54:02 1:43:21 0:10:41 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunk-promote-flush} 2
Failure Reason:

SSH connection to smithi042 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --low_tier_pool low_tier --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0'

dead 5182925 2020-06-27 03:48:23 2020-06-27 04:13:45 2020-06-27 06:07:47 1:54:02 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} 2
dead 5182926 2020-06-27 03:48:24 2020-06-27 04:13:44 2020-06-27 06:07:46 1:54:02 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
dead 5182927 2020-06-27 03:48:25 2020-06-27 04:15:27 2020-06-27 06:07:29 1:52:02 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} 2
dead 5182928 2020-06-27 03:48:26 2020-06-27 04:15:27 2020-06-27 06:07:29 1:52:02 smithi master centos 8.1 rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
dead 5182929 2020-06-27 03:48:27 2020-06-27 04:15:28 2020-06-27 06:07:30 1:52:02 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_python} 2
fail 5182930 2020-06-27 03:48:28 2020-06-27 04:15:29 2020-06-27 05:19:29 1:04:00 0:53:03 0:10:57 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 5182931 2020-06-27 03:48:29 2020-06-27 04:19:40 2020-06-27 06:07:42 1:48:02 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
fail 5182932 2020-06-27 03:48:30 2020-06-27 04:19:40 2020-06-27 05:11:40 0:52:00 0:44:51 0:07:09 smithi master rhel 8.1 rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 5182933 2020-06-27 03:48:31 2020-06-27 04:19:40 2020-06-27 06:07:42 1:48:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
pass 5182934 2020-06-27 03:48:31 2020-06-27 04:19:40 2020-06-27 04:41:39 0:21:59 0:13:29 0:08:30 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
fail 5182935 2020-06-27 03:48:32 2020-06-27 04:19:40 2020-06-27 05:13:40 0:54:00 0:25:02 0:28:58 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

dead 5182936 2020-06-27 03:48:33 2020-06-27 04:21:38 2020-06-27 06:07:40 1:46:02 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} 2
dead 5182937 2020-06-27 03:48:34 2020-06-27 04:21:38 2020-06-27 06:07:40 1:46:02 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
dead 5182938 2020-06-27 03:48:35 2020-06-27 04:23:27 2020-06-27 06:07:29 1:44:02 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
dead 5182939 2020-06-27 03:48:36 2020-06-27 04:23:28 2020-06-27 06:07:29 1:44:01 smithi master rhel 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
fail 5182940 2020-06-27 03:48:37 2020-06-27 04:23:28 2020-06-27 04:49:27 0:25:59 0:15:47 0:10:12 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} 1
Failure Reason:

Test failure: test_create_multiple_exports (tasks.cephfs.test_nfs.TestNFS)

dead 5182941 2020-06-27 03:48:38 2020-06-27 04:23:28 2020-06-27 06:07:29 1:44:01 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
dead 5182942 2020-06-27 03:48:39 2020-06-27 04:23:28 2020-06-27 06:07:29 1:44:01 smithi master centos 8.1 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} 2
dead 5182943 2020-06-27 03:48:40 2020-06-27 04:25:36 2020-06-27 06:07:38 1:42:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5182944 2020-06-27 03:48:41 2020-06-27 04:25:36 2020-06-27 04:59:36 0:34:00 0:21:24 0:12:36 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 5182945 2020-06-27 03:48:42 2020-06-27 04:25:36 2020-06-27 04:49:36 0:24:00 0:12:22 0:11:38 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} 2
fail 5182946 2020-06-27 03:48:43 2020-06-27 04:27:43 2020-06-27 04:57:42 0:29:59 0:09:19 0:20:40 smithi master centos 8.1 rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/repair_test} 2
Failure Reason:

Command failed on smithi151 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok truncobj repair_pool_1 repair_test_obj 1'

dead 5182947 2020-06-27 03:48:44 2020-06-27 04:27:43 2020-06-27 06:07:44 1:40:01 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
dead 5182948 2020-06-27 03:48:45 2020-06-27 04:27:43 2020-06-27 06:07:44 1:40:01 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
pass 5182949 2020-06-27 03:48:46 2020-06-27 04:29:33 2020-06-27 04:59:33 0:30:00 0:11:16 0:18:44 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
fail 5182950 2020-06-27 03:48:46 2020-06-27 04:29:33 2020-06-27 05:29:33 1:00:00 0:26:26 0:33:34 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} 2
Failure Reason:

"2020-06-27T05:08:53.257573+0000 osd.2 (osd.2) 3 : cluster [WRN] slow request osd_op(client.4177.0:2 2.1 2.3e6a8311 (undecoded) ondisk+read+known_if_redirected e18) initiated 2020-06-27T05:08:22.459748+0000 currently delayed" in cluster log

dead 5182951 2020-06-27 03:48:47 2020-06-27 04:31:44 2020-06-27 06:07:46 1:36:02 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} 2
fail 5182952 2020-06-27 03:48:48 2020-06-27 04:33:44 2020-06-27 05:39:45 1:06:01 0:54:36 0:11:25 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Scrubbing terminated -- not all pgs were active and clean.

dead 5182953 2020-06-27 03:48:49 2020-06-27 04:37:35 2020-06-27 06:07:36 1:30:01 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
dead 5182954 2020-06-27 03:48:50 2020-06-27 04:39:36 2020-06-27 06:07:38 1:28:02 smithi master ubuntu 18.04 rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
dead 5182955 2020-06-27 03:48:51 2020-06-27 04:39:36 2020-06-27 06:07:38 1:28:02 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
dead 5182956 2020-06-27 03:48:52 2020-06-27 04:39:36 2020-06-27 06:07:38 1:28:02 1:19:09 0:08:53 smithi master rhel 8.1 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=24353)

dead 5182957 2020-06-27 03:48:53 2020-06-27 04:41:54 2020-06-27 06:07:55 1:26:01 smithi master rhel 8.1 rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} 1
pass 5182958 2020-06-27 03:48:54 2020-06-27 04:43:40 2020-06-27 05:09:40 0:26:00 0:12:28 0:13:32 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
dead 5182959 2020-06-27 03:48:55 2020-06-27 04:43:40 2020-06-27 06:07:42 1:24:02 1:11:47 0:12:15 smithi master centos 8.1 rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} 2
Failure Reason:

Test failure: test_get_export (tasks.mgr.dashboard.test_ganesha.GaneshaTest), tearDownClass (tasks.mgr.dashboard.test_ganesha.GaneshaTest)

dead 5182960 2020-06-27 03:48:56 2020-06-27 04:49:43 2020-06-27 06:07:44 1:18:01 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
dead 5182961 2020-06-27 03:48:57 2020-06-27 04:49:43 2020-06-27 06:09:44 1:20:01 1:06:07 0:13:54 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small}
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=11738)