Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5664951 2020-11-29 07:02:50 2020-11-29 11:16:42 2020-11-29 11:58:42 0:42:00 0:26:45 0:15:15 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
fail 5664952 2020-11-29 07:02:51 2020-11-29 11:16:46 2020-11-29 11:46:46 0:30:00 0:23:34 0:06:26 smithi master centos 8.2 rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 5664953 2020-11-29 07:02:51 2020-11-29 11:16:53 2020-11-29 12:32:54 1:16:01 1:06:50 0:09:11 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5664954 2020-11-29 07:02:52 2020-11-29 11:18:36 2020-11-29 11:34:36 0:16:00 0:07:50 0:08:10 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 5664955 2020-11-29 07:02:53 2020-11-29 11:18:36 2020-11-29 11:38:36 0:20:00 0:12:36 0:07:24 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/pool-create-delete} 2
fail 5664956 2020-11-29 07:02:54 2020-11-29 11:18:38 2020-11-29 11:46:38 0:28:00 0:06:03 0:21:57 smithi master centos 8.2 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
Failure Reason:

"2020-11-29T11:44:13.548838+0000 mon.a (mon.0) 23 : cluster [WRN] Health check failed: 1/21 mons down, quorum a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,t,u (MON_DOWN)" in cluster log

pass 5664957 2020-11-29 07:02:54 2020-11-29 11:21:02 2020-11-29 11:41:01 0:19:59 0:10:56 0:09:03 smithi master centos 8.2 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 5664958 2020-11-29 07:02:55 2020-11-29 11:21:02 2020-11-29 11:49:02 0:28:00 0:18:07 0:09:53 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
pass 5664959 2020-11-29 07:02:56 2020-11-29 11:21:02 2020-11-29 11:43:01 0:21:59 0:13:12 0:08:47 smithi master rhel 8.3 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
pass 5664960 2020-11-29 07:02:57 2020-11-29 11:21:04 2020-11-29 11:37:03 0:15:59 0:05:56 0:10:03 smithi master centos 8.2 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5664961 2020-11-29 07:02:57 2020-11-29 11:21:19 2020-11-29 12:11:19 0:50:00 0:38:38 0:11:22 smithi master rhel 8.3 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5664962 2020-11-29 07:02:58 2020-11-29 11:23:38 2020-11-29 11:45:38 0:22:00 0:12:42 0:09:18 smithi master centos 8.2 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5664963 2020-11-29 07:02:59 2020-11-29 11:23:56 2020-11-29 11:45:56 0:22:00 0:14:41 0:07:19 smithi master rhel 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} 1
pass 5664964 2020-11-29 07:03:00 2020-11-29 11:24:06 2020-11-29 11:56:05 0:31:59 0:24:09 0:07:50 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5664965 2020-11-29 07:03:01 2020-11-29 11:24:08 2020-11-29 12:02:08 0:38:00 0:27:02 0:10:58 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5664966 2020-11-29 07:03:02 2020-11-29 11:26:50 2020-11-29 12:12:50 0:46:00 0:26:39 0:19:21 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5664967 2020-11-29 07:03:02 2020-11-29 11:26:50 2020-11-29 12:00:50 0:34:00 0:25:17 0:08:43 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5664968 2020-11-29 07:03:03 2020-11-29 11:26:50 2020-11-29 12:02:50 0:36:00 0:26:20 0:09:40 smithi master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5664969 2020-11-29 07:03:04 2020-11-29 11:27:18 2020-11-29 11:49:17 0:21:59 0:11:27 0:10:32 smithi master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5664970 2020-11-29 07:03:05 2020-11-29 11:29:04 2020-11-29 17:21:11 5:52:07 5:18:18 0:33:49 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} 4
pass 5664971 2020-11-29 07:03:06 2020-11-29 11:29:04 2020-11-29 11:53:04 0:24:00 0:16:51 0:07:09 smithi master centos 8.2 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 5664972 2020-11-29 07:03:06 2020-11-29 11:30:49 2020-11-29 11:46:49 0:16:00 0:09:27 0:06:33 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} 2
pass 5664973 2020-11-29 07:03:07 2020-11-29 11:30:49 2020-11-29 11:48:49 0:18:00 0:10:27 0:07:33 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} 2
pass 5664974 2020-11-29 07:03:08 2020-11-29 11:30:49 2020-11-29 11:56:49 0:26:00 0:14:20 0:11:40 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} 2
pass 5664975 2020-11-29 07:03:09 2020-11-29 11:30:49 2020-11-29 11:46:49 0:16:00 0:10:27 0:05:33 smithi master centos 8.2 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5664976 2020-11-29 07:03:10 2020-11-29 11:32:33 2020-11-29 11:50:33 0:18:00 0:11:52 0:06:08 smithi master centos 8.2 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5664977 2020-11-29 07:03:10 2020-11-29 11:32:34 2020-11-29 11:58:33 0:25:59 0:12:48 0:13:11 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5664978 2020-11-29 07:03:11 2020-11-29 11:32:34 2020-11-29 12:14:33 0:41:59 0:32:43 0:09:16 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-big} 2
pass 5664979 2020-11-29 07:03:12 2020-11-29 11:32:33 2020-11-29 12:16:33 0:44:00 0:29:16 0:14:44 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
fail 5664980 2020-11-29 07:03:13 2020-11-29 11:33:23 2020-11-29 11:55:22 0:21:59 0:14:28 0:07:31 smithi master rhel 8.3 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} 2
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5664981 2020-11-29 07:03:14 2020-11-29 11:34:55 2020-11-29 11:52:55 0:18:00 0:07:14 0:10:46 smithi master centos 8.2 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 5664982 2020-11-29 07:03:14 2020-11-29 11:34:55 2020-11-29 12:50:56 1:16:01 1:05:05 0:10:56 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5664983 2020-11-29 07:03:15 2020-11-29 11:35:03 2020-11-29 11:51:02 0:15:59 0:08:23 0:07:36 smithi master rhel 8.3 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5664984 2020-11-29 07:03:16 2020-11-29 11:35:27 2020-11-29 12:25:27 0:50:00 0:37:04 0:12:56 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5664985 2020-11-29 07:03:17 2020-11-29 11:36:50 2020-11-29 11:54:49 0:17:59 0:10:52 0:07:07 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 5664986 2020-11-29 07:03:17 2020-11-29 11:37:05 2020-11-29 12:05:04 0:27:59 0:21:13 0:06:46 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} 1
pass 5664987 2020-11-29 07:03:18 2020-11-29 11:37:11 2020-11-29 12:23:12 0:46:01 0:39:28 0:06:33 smithi master centos 8.2 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} 1
fail 5664988 2020-11-29 07:03:19 2020-11-29 11:39:02 2020-11-29 11:57:02 0:18:00 0:10:04 0:07:56 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} 1
Failure Reason:

Command failed (workunit test cephadm/test_adoption.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh'

pass 5664989 2020-11-29 07:03:20 2020-11-29 11:39:02 2020-11-29 11:57:02 0:18:00 0:10:57 0:07:03 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} 2
pass 5664990 2020-11-29 07:03:20 2020-11-29 11:39:02 2020-11-29 12:09:02 0:30:00 0:20:05 0:09:55 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 2
pass 5664991 2020-11-29 07:03:21 2020-11-29 11:39:18 2020-11-29 11:53:17 0:13:59 0:07:52 0:06:07 smithi master centos 8.2 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 5664992 2020-11-29 07:03:22 2020-11-29 11:39:29 2020-11-29 11:55:28 0:15:59 0:09:33 0:06:26 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5664993 2020-11-29 07:03:23 2020-11-29 11:41:26 2020-11-29 13:39:28 1:58:02 1:50:53 0:07:09 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 5664994 2020-11-29 07:03:23 2020-11-29 11:41:26 2020-11-29 12:11:26 0:30:00 0:09:15 0:20:45 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5664995 2020-11-29 07:03:24 2020-11-29 11:41:26 2020-11-29 12:13:26 0:32:00 0:24:28 0:07:32 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5664996 2020-11-29 07:03:25 2020-11-29 11:43:11 2020-11-29 12:01:11 0:18:00 0:11:07 0:06:53 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} 2
pass 5664997 2020-11-29 07:03:26 2020-11-29 11:43:11 2020-11-29 12:01:11 0:18:00 0:08:59 0:09:01 smithi master centos 8.2 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5664998 2020-11-29 07:03:26 2020-11-29 11:43:11 2020-11-29 12:37:11 0:54:00 0:48:09 0:05:51 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} 2
pass 5664999 2020-11-29 07:03:27 2020-11-29 11:43:30 2020-11-29 12:17:30 0:34:00 0:27:23 0:06:37 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665000 2020-11-29 07:03:28 2020-11-29 11:45:19 2020-11-29 11:55:19 0:10:00 0:04:34 0:05:26 smithi master ubuntu 18.04 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 5665001 2020-11-29 07:03:29 2020-11-29 11:45:19 2020-11-29 12:19:19 0:34:00 0:25:24 0:08:36 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5665002 2020-11-29 07:03:30 2020-11-29 11:45:28 2020-11-29 12:01:27 0:15:59 0:08:57 0:07:02 smithi master rhel 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} 2
pass 5665003 2020-11-29 07:03:30 2020-11-29 11:45:39 2020-11-29 12:17:39 0:32:00 0:23:45 0:08:15 smithi master centos 8.2 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 5665004 2020-11-29 07:03:31 2020-11-29 11:45:57 2020-11-29 12:01:56 0:15:59 0:08:50 0:07:09 smithi master rhel 8.3 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5665005 2020-11-29 07:03:32 2020-11-29 11:47:23 2020-11-29 13:01:23 1:14:00 1:06:06 0:07:54 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665006 2020-11-29 07:03:33 2020-11-29 11:47:23 2020-11-29 12:03:23 0:16:00 0:09:44 0:06:16 smithi master centos 8.2 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} 1
pass 5665007 2020-11-29 07:03:34 2020-11-29 11:47:23 2020-11-29 12:11:23 0:24:00 0:15:08 0:08:52 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} 2
pass 5665008 2020-11-29 07:03:34 2020-11-29 11:47:23 2020-11-29 12:03:22 0:15:59 0:09:27 0:06:32 smithi master centos 8.2 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5665009 2020-11-29 07:03:35 2020-11-29 11:48:09 2020-11-29 12:04:09 0:16:00 0:09:49 0:06:11 smithi master centos 8.2 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5665010 2020-11-29 07:03:36 2020-11-29 11:49:32 2020-11-29 12:15:31 0:25:59 0:19:46 0:06:13 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} 2
pass 5665011 2020-11-29 07:03:37 2020-11-29 11:49:32 2020-11-29 12:07:31 0:17:59 0:11:14 0:06:45 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 5665012 2020-11-29 07:03:38 2020-11-29 11:49:32 2020-11-29 12:11:31 0:21:59 0:16:06 0:05:53 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} 1
pass 5665013 2020-11-29 07:03:38 2020-11-29 11:51:16 2020-11-29 12:35:16 0:44:00 0:36:33 0:07:27 smithi master ubuntu 18.04 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665014 2020-11-29 07:03:39 2020-11-29 11:51:16 2020-11-29 12:21:16 0:30:00 0:22:39 0:07:21 smithi master centos 8.2 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5665015 2020-11-29 07:03:40 2020-11-29 11:51:16 2020-11-29 12:11:15 0:19:59 0:13:15 0:06:44 smithi master centos 8.2 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} 1
pass 5665016 2020-11-29 07:03:41 2020-11-29 11:53:29 2020-11-29 12:11:28 0:17:59 0:11:24 0:06:35 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} 2
pass 5665017 2020-11-29 07:03:41 2020-11-29 11:53:29 2020-11-29 12:05:28 0:11:59 0:05:07 0:06:52 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665018 2020-11-29 07:03:42 2020-11-29 11:53:29 2020-11-29 12:21:29 0:28:00 0:19:27 0:08:33 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 5665019 2020-11-29 07:03:43 2020-11-29 11:53:29 2020-11-29 12:23:29 0:30:00 0:21:28 0:08:32 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
fail 5665020 2020-11-29 07:03:44 2020-11-29 11:55:23 2020-11-29 12:19:23 0:24:00 0:14:54 0:09:06 smithi master rhel 8.3 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} 2
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5665021 2020-11-29 07:03:44 2020-11-29 11:55:23 2020-11-29 12:25:23 0:30:00 0:18:18 0:11:42 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
pass 5665022 2020-11-29 07:03:45 2020-11-29 11:55:23 2020-11-29 12:11:23 0:16:00 0:09:53 0:06:07 smithi master centos 8.2 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5665023 2020-11-29 07:03:46 2020-11-29 11:55:23 2020-11-29 13:15:24 1:20:01 1:08:20 0:11:41 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665024 2020-11-29 07:03:47 2020-11-29 11:55:23 2020-11-29 12:43:23 0:48:00 0:39:51 0:08:09 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 5665025 2020-11-29 07:03:47 2020-11-29 11:55:29 2020-11-29 12:07:29 0:12:00 0:05:33 0:06:27 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665026 2020-11-29 07:03:48 2020-11-29 11:56:07 2020-11-29 12:16:06 0:19:59 0:11:50 0:08:09 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 5665027 2020-11-29 07:03:49 2020-11-29 11:57:33 2020-11-29 12:31:33 0:34:00 0:08:50 0:25:10 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665028 2020-11-29 07:03:50 2020-11-29 11:57:33 2020-11-29 12:29:33 0:32:00 0:23:14 0:08:46 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} 2
pass 5665029 2020-11-29 07:03:50 2020-11-29 11:57:33 2020-11-29 12:17:32 0:19:59 0:11:17 0:08:42 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 5665030 2020-11-29 07:03:51 2020-11-29 11:59:16 2020-11-29 12:29:16 0:30:00 0:11:05 0:18:55 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/insights} 2
pass 5665031 2020-11-29 07:03:52 2020-11-29 11:59:16 2020-11-29 12:49:16 0:50:00 0:43:10 0:06:50 smithi master centos 8.2 rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5665032 2020-11-29 07:03:53 2020-11-29 12:00:00 2020-11-29 12:20:00 0:20:00 0:13:42 0:06:18 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5665033 2020-11-29 07:03:53 2020-11-29 12:01:24 2020-11-29 13:15:24 1:14:00 0:25:33 0:48:27 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5665034 2020-11-29 07:03:54 2020-11-29 12:01:24 2020-11-29 12:33:23 0:31:59 0:19:58 0:12:01 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} 2
pass 5665035 2020-11-29 07:03:55 2020-11-29 12:01:24 2020-11-29 12:53:24 0:52:00 0:24:38 0:27:22 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665036 2020-11-29 07:03:56 2020-11-29 12:01:24 2020-11-29 12:19:23 0:17:59 0:09:19 0:08:40 smithi master ubuntu 18.04 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 5665037 2020-11-29 07:03:57 2020-11-29 12:01:28 2020-11-29 12:45:28 0:44:00 0:28:08 0:15:52 smithi master centos 8.2 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 5665038 2020-11-29 07:03:58 2020-11-29 12:01:58 2020-11-29 12:47:58 0:46:00 0:30:21 0:15:39 smithi master centos 8.2 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} 2
pass 5665039 2020-11-29 07:03:58 2020-11-29 12:02:09 2020-11-29 12:54:10 0:52:01 0:36:20 0:15:41 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 5665040 2020-11-29 07:03:59 2020-11-29 12:03:34 2020-11-29 12:21:33 0:17:59 0:12:13 0:05:46 smithi master centos 8.2 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5665041 2020-11-29 07:04:00 2020-11-29 12:03:34 2020-11-29 12:41:34 0:38:00 0:29:29 0:08:31 smithi master ubuntu 18.04 rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 5665042 2020-11-29 07:04:01 2020-11-29 12:03:34 2020-11-29 12:23:33 0:19:59 0:12:55 0:07:04 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} 2
pass 5665043 2020-11-29 07:04:02 2020-11-29 12:04:01 2020-11-29 12:26:01 0:22:00 0:11:17 0:10:43 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} 2
pass 5665044 2020-11-29 07:04:02 2020-11-29 12:04:10 2020-11-29 12:36:09 0:31:59 0:25:50 0:06:09 smithi master ubuntu 18.04 rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665045 2020-11-29 07:04:03 2020-11-29 12:05:48 2020-11-29 13:19:49 1:14:01 1:06:53 0:07:08 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665046 2020-11-29 07:04:04 2020-11-29 12:05:48 2020-11-29 12:19:47 0:13:59 0:06:13 0:07:46 smithi master centos 8.2 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 5665047 2020-11-29 07:04:05 2020-11-29 12:07:54 2020-11-29 12:21:53 0:13:59 0:08:04 0:05:55 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} 1
pass 5665048 2020-11-29 07:04:06 2020-11-29 12:07:54 2020-11-29 12:23:53 0:15:59 0:09:43 0:06:16 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665049 2020-11-29 07:04:06 2020-11-29 12:07:54 2020-11-29 12:49:54 0:42:00 0:25:38 0:16:22 smithi master rhel 8.3 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 5665050 2020-11-29 07:04:07 2020-11-29 12:09:43 2020-11-29 12:33:43 0:24:00 0:12:08 0:11:52 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} 2
pass 5665051 2020-11-29 07:04:08 2020-11-29 12:09:43 2020-11-29 12:43:43 0:34:00 0:23:28 0:10:32 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5665052 2020-11-29 07:04:09 2020-11-29 12:11:58 2020-11-29 12:27:58 0:16:00 0:08:26 0:07:34 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 5665053 2020-11-29 07:04:09 2020-11-29 12:11:59 2020-11-29 12:37:58 0:25:59 0:18:46 0:07:13 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 5665054 2020-11-29 07:04:10 2020-11-29 12:11:59 2020-11-29 12:29:58 0:17:59 0:07:28 0:10:31 smithi master rhel 8.3 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 5665055 2020-11-29 07:04:11 2020-11-29 12:11:59 2020-11-29 12:57:58 0:45:59 0:36:52 0:09:07 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665056 2020-11-29 07:04:12 2020-11-29 12:11:59 2020-11-29 12:33:58 0:21:59 0:10:10 0:11:49 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5665057 2020-11-29 07:04:12 2020-11-29 12:11:59 2020-11-29 12:27:58 0:15:59 0:06:11 0:09:48 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665058 2020-11-29 07:04:13 2020-11-29 12:11:59 2020-11-29 12:41:59 0:30:00 0:14:46 0:15:14 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
pass 5665059 2020-11-29 07:04:14 2020-11-29 12:12:51 2020-11-29 12:38:51 0:26:00 0:13:54 0:12:06 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} 2
pass 5665060 2020-11-29 07:04:15 2020-11-29 12:14:11 2020-11-29 12:30:10 0:15:59 0:09:03 0:06:56 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665061 2020-11-29 07:04:16 2020-11-29 12:14:35 2020-11-29 13:32:35 1:18:00 1:05:37 0:12:23 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665062 2020-11-29 07:04:16 2020-11-29 12:16:15 2020-11-29 13:06:15 0:50:00 0:09:36 0:40:24 smithi master centos 8.2 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 5665063 2020-11-29 07:04:17 2020-11-29 12:16:15 2020-11-29 12:58:15 0:42:00 0:31:15 0:10:45 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5665064 2020-11-29 07:04:18 2020-11-29 12:16:15 2020-11-29 12:46:15 0:30:00 0:21:04 0:08:56 smithi master centos 8.2 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5665065 2020-11-29 07:04:19 2020-11-29 12:16:35 2020-11-29 12:50:34 0:33:59 0:28:17 0:05:42 smithi master rhel 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/module_selftest} 2
fail 5665066 2020-11-29 07:04:20 2020-11-29 12:17:03 2020-11-29 12:53:03 0:36:00 0:27:57 0:08:03 smithi master rhel 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} 1
Failure Reason:

Command failed (workunit test mon/mon-last-epoch-clean.sh) on smithi176 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh'

pass 5665067 2020-11-29 07:04:20 2020-11-29 12:18:12 2020-11-29 13:00:12 0:42:00 0:36:10 0:05:50 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} 2
pass 5665068 2020-11-29 07:04:21 2020-11-29 12:18:12 2020-11-29 12:36:12 0:18:00 0:10:25 0:07:35 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665069 2020-11-29 07:04:22 2020-11-29 12:18:12 2020-11-29 12:46:12 0:28:00 0:08:11 0:19:49 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5665070 2020-11-29 07:04:23 2020-11-29 12:20:03 2020-11-29 12:52:02 0:31:59 0:25:05 0:06:54 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} 2
pass 5665071 2020-11-29 07:04:24 2020-11-29 12:20:03 2020-11-29 12:56:03 0:36:00 0:26:45 0:09:15 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665072 2020-11-29 07:04:24 2020-11-29 12:20:03 2020-11-29 13:00:03 0:40:00 0:29:49 0:10:11 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
pass 5665073 2020-11-29 07:04:25 2020-11-29 12:20:03 2020-11-29 12:38:02 0:17:59 0:07:44 0:10:15 smithi master rhel 8.3 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
pass 5665074 2020-11-29 07:04:26 2020-11-29 12:20:03 2020-11-29 14:06:05 1:46:02 1:34:53 0:11:09 smithi master centos 8.2 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} 2
pass 5665075 2020-11-29 07:04:27 2020-11-29 12:20:42 2020-11-29 13:18:42 0:58:00 0:50:07 0:07:53 smithi master centos 8.2 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} 2
pass 5665076 2020-11-29 07:04:28 2020-11-29 12:21:59 2020-11-29 12:37:59 0:16:00 0:09:00 0:07:00 smithi master ubuntu 18.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665077 2020-11-29 07:04:28 2020-11-29 12:22:00 2020-11-29 13:04:00 0:42:00 0:34:56 0:07:04 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5665078 2020-11-29 07:04:29 2020-11-29 12:22:00 2020-11-29 13:12:00 0:50:00 0:44:08 0:05:52 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5665079 2020-11-29 07:04:30 2020-11-29 12:22:00 2020-11-29 12:35:59 0:13:59 0:08:22 0:05:37 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
fail 5665080 2020-11-29 07:04:31 2020-11-29 12:23:55 2020-11-29 12:41:55 0:18:00 0:10:42 0:07:18 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 5665081 2020-11-29 07:04:32 2020-11-29 12:23:55 2020-11-29 12:43:55 0:20:00 0:13:59 0:06:01 smithi master rhel 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5665082 2020-11-29 07:04:32 2020-11-29 12:23:55 2020-11-29 12:41:55 0:18:00 0:11:31 0:06:29 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} 2
pass 5665083 2020-11-29 07:04:33 2020-11-29 12:23:56 2020-11-29 12:37:55 0:13:59 0:06:38 0:07:21 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_striper} 2
pass 5665084 2020-11-29 07:04:34 2020-11-29 12:23:56 2020-11-29 12:41:55 0:17:59 0:11:33 0:06:26 smithi master centos 8.2 rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 5665085 2020-11-29 07:04:35 2020-11-29 12:24:30 2020-11-29 13:40:31 1:16:01 1:07:24 0:08:37 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665086 2020-11-29 07:04:36 2020-11-29 12:24:44 2020-11-29 14:58:46 2:34:02 2:28:21 0:05:41 smithi master rhel 8.3 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 5665087 2020-11-29 07:04:36 2020-11-29 12:26:07 2020-11-29 12:52:07 0:26:00 0:18:45 0:07:15 smithi master centos 8.2 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 5665088 2020-11-29 07:04:37 2020-11-29 12:26:08 2020-11-29 12:46:07 0:19:59 0:10:40 0:09:19 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5665089 2020-11-29 07:04:38 2020-11-29 12:26:08 2020-11-29 14:18:09 1:52:01 1:39:41 0:12:20 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench} 2
pass 5665090 2020-11-29 07:04:39 2020-11-29 12:26:08 2020-11-29 12:52:07 0:25:59 0:15:32 0:10:27 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} 2
pass 5665091 2020-11-29 07:04:40 2020-11-29 12:28:43 2020-11-29 12:56:43 0:28:00 0:20:50 0:07:10 smithi master centos 8.2 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} 2
pass 5665092 2020-11-29 07:04:40 2020-11-29 12:28:43 2020-11-29 15:46:47 3:18:04 3:11:14 0:06:50 smithi master ubuntu 18.04 rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 5665093 2020-11-29 07:04:41 2020-11-29 12:29:17 2020-11-29 14:09:18 1:40:01 1:31:37 0:08:24 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 5665094 2020-11-29 07:04:42 2020-11-29 12:29:34 2020-11-29 12:49:33 0:19:59 0:13:27 0:06:32 smithi master rhel 8.3 rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 5665095 2020-11-29 07:04:43 2020-11-29 12:30:41 2020-11-29 13:04:41 0:34:00 0:25:12 0:08:48 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 5665096 2020-11-29 07:04:43 2020-11-29 12:30:41 2020-11-29 13:06:41 0:36:00 0:10:56 0:25:04 smithi master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665097 2020-11-29 07:04:44 2020-11-29 12:30:44 2020-11-29 12:50:43 0:19:59 0:11:40 0:08:19 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect} 2
pass 5665098 2020-11-29 07:04:45 2020-11-29 12:31:36 2020-11-29 12:47:35 0:15:59 0:08:44 0:07:15 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 5665099 2020-11-29 07:04:46 2020-11-29 12:33:24 2020-11-29 12:53:24 0:20:00 0:11:45 0:08:15 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} 2
pass 5665100 2020-11-29 07:04:47 2020-11-29 12:33:24 2020-11-29 13:01:24 0:28:00 0:18:39 0:09:21 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 5665101 2020-11-29 07:04:48 2020-11-29 12:33:24 2020-11-29 12:57:24 0:24:00 0:16:17 0:07:43 smithi master centos 8.2 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5665102 2020-11-29 07:04:48 2020-11-29 12:33:44 2020-11-29 12:57:44 0:24:00 0:17:30 0:06:30 smithi master rhel 8.3 rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 5665103 2020-11-29 07:04:49 2020-11-29 12:33:59 2020-11-29 13:58:00 1:24:01 1:05:28 0:18:33 smithi master ubuntu 18.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
pass 5665104 2020-11-29 07:04:50 2020-11-29 12:35:58 2020-11-29 12:53:58 0:18:00 0:11:15 0:06:45 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5665105 2020-11-29 07:04:51 2020-11-29 12:36:00 2020-11-29 13:16:00 0:40:00 0:28:00 0:12:00 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5665106 2020-11-29 07:04:52 2020-11-29 12:36:10 2020-11-29 13:20:11 0:44:01 0:26:18 0:17:43 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} 2
pass 5665107 2020-11-29 07:04:52 2020-11-29 12:36:13 2020-11-29 13:06:13 0:30:00 0:22:51 0:07:09 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665108 2020-11-29 07:04:53 2020-11-29 12:37:55 2020-11-29 12:55:55 0:18:00 0:05:12 0:12:48 smithi master ubuntu 18.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5665109 2020-11-29 07:04:54 2020-11-29 12:37:56 2020-11-29 13:07:56 0:30:00 0:20:43 0:09:17 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} 2
fail 5665110 2020-11-29 07:04:55 2020-11-29 12:37:59 2020-11-29 16:08:03 3:30:04 3:17:28 0:12:36 smithi master centos 8.2 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} 2
Failure Reason:

Command failed (workunit test mon/caps.sh) on smithi166 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

pass 5665111 2020-11-29 07:04:56 2020-11-29 12:38:00 2020-11-29 12:53:59 0:15:59 0:10:39 0:05:20 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} 1
pass 5665112 2020-11-29 07:04:56 2020-11-29 12:38:03 2020-11-29 13:02:03 0:24:00 0:13:40 0:10:20 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} 2
fail 5665113 2020-11-29 07:04:57 2020-11-29 12:38:52 2020-11-29 13:08:52 0:30:00 0:18:11 0:11:49 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/misc.log:2020-11-29T12:58:04.228924+00:00 smithi059 bash[8299]: debug 2020-11-29T12:58:04.221+0000 7f2480d91700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... ' in syslog

pass 5665114 2020-11-29 07:04:58 2020-11-29 12:42:29 2020-11-29 13:02:28 0:19:59 0:12:11 0:07:48 smithi master rhel 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5665115 2020-11-29 07:04:59 2020-11-29 12:42:29 2020-11-29 13:24:28 0:41:59 0:33:00 0:08:59 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 5665116 2020-11-29 07:05:00 2020-11-29 12:42:28 2020-11-29 13:00:28 0:18:00 0:11:08 0:06:52 smithi master centos 8.2 rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 5665117 2020-11-29 07:05:00 2020-11-29 12:42:29 2020-11-29 13:10:28 0:27:59 0:20:17 0:07:42 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 5665118 2020-11-29 07:05:01 2020-11-29 12:42:29 2020-11-29 13:16:29 0:34:00 0:23:32 0:10:28 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
fail 5665119 2020-11-29 07:05:02 2020-11-29 12:44:08 2020-11-29 13:14:08 0:30:00 0:22:28 0:07:32 smithi master centos 8.2 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} 1
Failure Reason:

Command failed (workunit test scrub/osd-recovery-scrub.sh) on smithi039 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh'

pass 5665120 2020-11-29 07:05:03 2020-11-29 12:58:35 2020-11-29 13:18:33 0:19:58 0:12:27 0:07:31 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 5665121 2020-11-29 07:05:04 2020-11-29 12:58:33 2020-11-29 13:18:31 0:19:58 0:11:47 0:08:11 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} 2
pass 5665122 2020-11-29 07:05:05 2020-11-29 12:58:33 2020-11-29 13:14:32 0:15:59 0:10:12 0:05:47 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 5665123 2020-11-29 07:05:05 2020-11-29 12:58:35 2020-11-29 13:32:34 0:33:59 0:26:16 0:07:43 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665124 2020-11-29 07:05:06 2020-11-29 12:58:33 2020-11-29 13:46:32 0:47:59 0:36:31 0:11:28 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 5665125 2020-11-29 07:05:07 2020-11-29 12:58:36 2020-11-29 13:24:35 0:25:59 0:19:00 0:06:59 smithi master centos 8.2 rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5665126 2020-11-29 07:05:08 2020-11-29 12:58:36 2020-11-29 14:28:37 1:30:01 1:07:30 0:22:31 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665127 2020-11-29 07:05:09 2020-11-29 12:58:32 2020-11-29 15:36:33 2:38:01 2:30:59 0:07:02 smithi master centos 8.2 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 5665128 2020-11-29 07:05:09 2020-11-29 12:58:34 2020-11-29 13:18:33 0:19:59 0:13:33 0:06:26 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} 2
pass 5665129 2020-11-29 07:05:10 2020-11-29 12:58:31 2020-11-29 13:16:30 0:17:59 0:11:14 0:06:45 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5665130 2020-11-29 07:05:11 2020-11-29 12:58:36 2020-11-29 13:30:35 0:31:59 0:09:47 0:22:12 smithi master centos 8.2 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665131 2020-11-29 07:05:12 2020-11-29 12:58:36 2020-11-29 13:22:34 0:23:58 0:16:19 0:07:39 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
pass 5665132 2020-11-29 07:05:13 2020-11-29 12:58:36 2020-11-29 13:22:36 0:24:00 0:11:04 0:12:56 smithi master centos 8.2 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5665133 2020-11-29 07:05:14 2020-11-29 12:58:32 2020-11-29 13:18:31 0:19:59 0:14:12 0:05:47 smithi master ubuntu 18.04 rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665134 2020-11-29 07:05:14 2020-11-29 12:58:35 2020-11-29 13:44:35 0:46:00 0:37:39 0:08:21 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 5665135 2020-11-29 07:05:15 2020-11-29 12:58:32 2020-11-29 13:14:31 0:15:59 0:09:04 0:06:55 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
pass 5665136 2020-11-29 07:05:16 2020-11-29 12:58:36 2020-11-29 13:20:35 0:21:59 0:12:39 0:09:20 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} 2
fail 5665137 2020-11-29 07:05:17 2020-11-29 12:58:36 2020-11-29 13:24:35 0:25:59 0:11:54 0:14:05 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi078 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 5665138 2020-11-29 07:05:18 2020-11-29 12:58:33 2020-11-29 13:16:31 0:17:58 0:10:56 0:07:02 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5665139 2020-11-29 07:05:18 2020-11-29 12:58:34 2020-11-29 15:18:35 2:20:01 2:12:12 0:07:49 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} 2
pass 5665140 2020-11-29 07:05:19 2020-11-29 12:58:33 2020-11-29 13:34:32 0:35:59 0:27:42 0:08:17 smithi master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665141 2020-11-29 07:05:20 2020-11-29 12:58:32 2020-11-29 13:26:32 0:28:00 0:19:47 0:08:13 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-balanced} 2
pass 5665142 2020-11-29 07:05:21 2020-11-29 12:58:34 2020-11-29 13:14:32 0:15:58 0:10:34 0:05:24 smithi master rhel 8.3 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
pass 5665143 2020-11-29 07:05:21 2020-11-29 12:58:32 2020-11-29 13:28:31 0:29:59 0:22:30 0:07:29 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 5665144 2020-11-29 07:05:22 2020-11-29 12:58:35 2020-11-29 13:16:34 0:17:59 0:09:10 0:08:49 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 5665145 2020-11-29 07:05:23 2020-11-29 12:58:34 2020-11-29 13:32:34 0:34:00 0:25:48 0:08:12 smithi master centos 8.2 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} 2
pass 5665146 2020-11-29 07:05:24 2020-11-29 12:58:34 2020-11-29 13:28:32 0:29:58 0:23:12 0:06:46 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
pass 5665147 2020-11-29 07:05:25 2020-11-29 12:58:31 2020-11-29 13:34:31 0:36:00 0:29:47 0:06:13 smithi master centos 8.2 rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5665148 2020-11-29 07:05:26 2020-11-29 12:58:36 2020-11-29 13:48:36 0:50:00 0:36:10 0:13:50 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665149 2020-11-29 07:05:26 2020-11-29 12:58:34 2020-11-29 14:12:34 1:14:00 1:07:18 0:06:42 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665150 2020-11-29 07:05:27 2020-11-29 12:58:35 2020-11-29 13:18:34 0:19:59 0:12:24 0:07:35 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665151 2020-11-29 07:05:28 2020-11-29 12:58:32 2020-11-29 13:18:31 0:19:59 0:13:40 0:06:19 smithi master centos 8.2 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} 1
pass 5665152 2020-11-29 07:05:29 2020-11-29 12:58:33 2020-11-29 18:14:37 5:16:04 5:09:13 0:06:51 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} 4
pass 5665153 2020-11-29 07:05:30 2020-11-29 12:58:36 2020-11-29 13:30:35 0:31:59 0:24:00 0:07:59 smithi master centos 8.2 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 5665154 2020-11-29 07:05:30 2020-11-29 12:58:32 2020-11-29 13:24:31 0:25:59 0:18:20 0:07:39 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
fail 5665155 2020-11-29 07:05:31 2020-11-29 13:00:46 2020-11-29 13:38:46 0:38:00 0:27:47 0:10:13 smithi master centos 8.2 rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi146 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 5665156 2020-11-29 07:05:32 2020-11-29 13:00:46 2020-11-29 13:14:46 0:14:00 0:08:23 0:05:37 smithi master rhel 8.3 rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 5665157 2020-11-29 07:05:33 2020-11-29 13:00:46 2020-11-29 13:34:46 0:34:00 0:21:03 0:12:57 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} 2
pass 5665158 2020-11-29 07:05:34 2020-11-29 13:01:25 2020-11-29 13:23:24 0:21:59 0:10:57 0:11:02 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665159 2020-11-29 07:05:34 2020-11-29 13:01:25 2020-11-29 13:19:24 0:17:59 0:10:33 0:07:26 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} 2
pass 5665160 2020-11-29 07:05:35 2020-11-29 13:02:45 2020-11-29 13:26:44 0:23:59 0:14:29 0:09:30 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} 2
pass 5665161 2020-11-29 07:05:36 2020-11-29 13:02:45 2020-11-29 13:28:44 0:25:59 0:12:46 0:13:13 smithi master centos 8.0 rados/cephadm/smoke-roleless/{distro/centos_8.0 start} 2
pass 5665162 2020-11-29 07:05:37 2020-11-29 13:02:45 2020-11-29 13:24:44 0:21:59 0:13:09 0:08:50 smithi master centos 8.2 rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 5665163 2020-11-29 07:05:37 2020-11-29 13:02:46 2020-11-29 14:18:47 1:16:01 1:08:27 0:07:34 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665164 2020-11-29 07:05:38 2020-11-29 13:04:44 2020-11-29 13:20:44 0:16:00 0:08:33 0:07:27 smithi master ubuntu 18.04 rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} 1
pass 5665165 2020-11-29 07:05:39 2020-11-29 13:04:45 2020-11-29 13:22:44 0:17:59 0:09:19 0:08:40 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665166 2020-11-29 07:05:40 2020-11-29 13:07:05 2020-11-29 13:21:04 0:13:59 0:06:54 0:07:05 smithi master centos 8.2 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5665167 2020-11-29 07:05:41 2020-11-29 13:07:05 2020-11-29 13:37:05 0:30:00 0:19:19 0:10:41 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} 2
pass 5665168 2020-11-29 07:05:41 2020-11-29 13:07:05 2020-11-29 13:23:04 0:15:59 0:09:11 0:06:48 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
fail 5665169 2020-11-29 07:05:42 2020-11-29 13:07:06 2020-11-29 13:35:05 0:27:59 0:14:46 0:13:13 smithi master rhel 8.3 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} 2
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5665170 2020-11-29 07:05:43 2020-11-29 13:07:06 2020-11-29 13:51:06 0:44:00 0:29:30 0:14:30 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5665171 2020-11-29 07:05:44 2020-11-29 13:07:57 2020-11-29 13:31:57 0:24:00 0:10:47 0:13:13 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/workunits} 2
pass 5665172 2020-11-29 07:05:45 2020-11-29 13:09:34 2020-11-29 13:55:34 0:46:00 0:39:06 0:06:54 smithi master centos 8.2 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 5665173 2020-11-29 07:05:45 2020-11-29 13:10:30 2020-11-29 13:28:29 0:17:59 0:11:25 0:06:34 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} 2
pass 5665174 2020-11-29 07:05:46 2020-11-29 13:12:45 2020-11-29 13:54:45 0:42:00 0:35:07 0:06:53 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 5665175 2020-11-29 07:05:47 2020-11-29 13:14:51 2020-11-29 13:34:50 0:19:59 0:12:35 0:07:24 smithi master ubuntu 18.04 rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 2
pass 5665176 2020-11-29 07:05:48 2020-11-29 13:14:51 2020-11-29 13:46:51 0:32:00 0:24:57 0:07:03 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 5665177 2020-11-29 07:05:49 2020-11-29 13:14:51 2020-11-29 13:34:50 0:19:59 0:12:35 0:07:24 smithi master rhel 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5665178 2020-11-29 07:05:49 2020-11-29 13:14:51 2020-11-29 13:48:51 0:34:00 0:25:02 0:08:58 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 5665179 2020-11-29 07:05:50 2020-11-29 13:14:51 2020-11-29 13:48:51 0:34:00 0:26:06 0:07:54 smithi master ubuntu 18.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5665180 2020-11-29 07:05:51 2020-11-29 13:14:51 2020-11-29 13:32:50 0:17:59 0:09:17 0:08:42 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} 2
pass 5665181 2020-11-29 07:05:52 2020-11-29 13:15:25 2020-11-29 13:49:25 0:34:00 0:25:00 0:09:00 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665182 2020-11-29 07:05:53 2020-11-29 13:15:25 2020-11-29 14:01:26 0:46:01 0:39:07 0:06:54 smithi master rhel 8.0 rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5665183 2020-11-29 07:05:53 2020-11-29 13:16:44 2020-11-29 13:30:43 0:13:59 0:05:49 0:08:10 smithi master centos 8.2 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 5665184 2020-11-29 07:05:54 2020-11-29 13:16:44 2020-11-29 13:44:43 0:27:59 0:21:11 0:06:48 smithi master centos 8.2 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 5665185 2020-11-29 07:05:55 2020-11-29 13:16:44 2020-11-29 13:40:43 0:23:59 0:16:51 0:07:08 smithi master rhel 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/many workloads/pool-create-delete} 2
pass 5665186 2020-11-29 07:05:56 2020-11-29 13:16:44 2020-11-29 13:30:43 0:13:59 0:07:50 0:06:09 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} 1
pass 5665187 2020-11-29 07:05:57 2020-11-29 13:16:44 2020-11-29 13:30:43 0:13:59 0:06:22 0:07:37 smithi master centos 8.2 rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 5665188 2020-11-29 07:05:58 2020-11-29 13:19:13 2020-11-29 14:35:13 1:16:00 1:07:41 0:08:19 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665189 2020-11-29 07:05:58 2020-11-29 13:19:13 2020-11-29 13:41:12 0:21:59 0:15:14 0:06:45 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} 2
pass 5665190 2020-11-29 07:05:59 2020-11-29 13:19:14 2020-11-29 13:37:13 0:17:59 0:08:23 0:09:36 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665191 2020-11-29 07:06:00 2020-11-29 13:19:14 2020-11-29 13:57:13 0:37:59 0:26:51 0:11:08 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
pass 5665192 2020-11-29 07:06:01 2020-11-29 13:19:13 2020-11-29 13:35:12 0:15:59 0:08:03 0:07:56 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 5665193 2020-11-29 07:06:02 2020-11-29 13:19:13 2020-11-29 13:37:12 0:17:59 0:09:37 0:08:22 smithi master centos 8.2 rados/cephadm/smoke-roleless/{distro/centos_latest start} 2
pass 5665194 2020-11-29 07:06:02 2020-11-29 13:19:14 2020-11-29 14:45:14 1:26:00 1:19:41 0:06:19 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 5665195 2020-11-29 07:06:03 2020-11-29 13:19:25 2020-11-29 13:43:25 0:24:00 0:16:42 0:07:18 smithi master centos 8.2 rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 5665196 2020-11-29 07:06:04 2020-11-29 13:19:50 2020-11-29 13:41:49 0:21:59 0:14:40 0:07:19 smithi master rhel 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 5665197 2020-11-29 07:06:05 2020-11-29 13:20:54 2020-11-29 13:40:54 0:20:00 0:11:34 0:08:26 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} 2
pass 5665198 2020-11-29 07:06:06 2020-11-29 13:20:55 2020-11-29 13:34:54 0:13:59 0:06:02 0:07:57 smithi master centos 8.2 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 5665199 2020-11-29 07:06:06 2020-11-29 13:20:55 2020-11-29 13:46:54 0:25:59 0:08:59 0:17:00 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665200 2020-11-29 07:06:07 2020-11-29 13:21:05 2020-11-29 13:55:05 0:34:00 0:26:21 0:07:39 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 2
fail 5665201 2020-11-29 07:06:08 2020-11-29 13:23:20 2020-11-29 14:31:20 1:08:00 1:00:41 0:07:19 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} 2
Failure Reason:

'/home/ubuntu/cephtest/archive/syslog/misc.log:2020-11-29T13:36:25.699872+00:00 smithi078 bash[8638]: debug 2020-11-29T13:36:25.696+0000 7f8cc94bb700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... ' in syslog

pass 5665202 2020-11-29 07:06:09 2020-11-29 13:23:20 2020-11-29 13:41:20 0:18:00 0:10:53 0:07:07 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
pass 5665203 2020-11-29 07:06:10 2020-11-29 13:23:20 2020-11-29 13:57:20 0:34:00 0:24:49 0:09:11 smithi master ubuntu 18.04 rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 5665204 2020-11-29 07:06:10 2020-11-29 13:23:20 2020-11-29 13:39:19 0:15:59 0:08:57 0:07:02 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} 2
pass 5665205 2020-11-29 07:06:11 2020-11-29 13:23:25 2020-11-29 14:43:26 1:20:01 1:08:43 0:11:18 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665206 2020-11-29 07:06:12 2020-11-29 13:25:12 2020-11-29 13:45:12 0:20:00 0:13:09 0:06:51 smithi master rhel 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} 1
pass 5665207 2020-11-29 07:06:13 2020-11-29 13:25:13 2020-11-29 13:51:12 0:25:59 0:18:44 0:07:15 smithi master centos 8.2 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 5665208 2020-11-29 07:06:14 2020-11-29 13:25:13 2020-11-29 13:59:13 0:34:00 0:25:35 0:08:25 smithi master rhel 8.3 rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 5665209 2020-11-29 07:06:14 2020-11-29 13:25:13 2020-11-29 13:39:12 0:13:59 0:06:45 0:07:14 smithi master centos 8.2 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5665210 2020-11-29 07:06:15 2020-11-29 13:25:13 2020-11-29 13:45:12 0:19:59 0:11:54 0:08:05 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 5665211 2020-11-29 07:06:16 2020-11-29 13:27:18 2020-11-29 13:47:17 0:19:59 0:11:18 0:08:41 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5665212 2020-11-29 07:06:17 2020-11-29 13:27:18 2020-11-29 13:41:17 0:13:59 0:07:20 0:06:39 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 5665213 2020-11-29 07:06:18 2020-11-29 13:29:13 2020-11-29 13:51:12 0:21:59 0:14:12 0:07:47 smithi master rhel 8.0 rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} 2
pass 5665214 2020-11-29 07:06:18 2020-11-29 13:29:13 2020-11-29 13:53:12 0:23:59 0:08:55 0:15:04 smithi master centos 8.2 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5665215 2020-11-29 07:06:19 2020-11-29 13:29:13 2020-11-29 14:25:13 0:56:00 0:47:49 0:08:11 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} 2
pass 5665216 2020-11-29 07:06:20 2020-11-29 13:29:13 2020-11-29 14:05:13 0:36:00 0:27:42 0:08:18 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665217 2020-11-29 07:06:21 2020-11-29 13:31:21 2020-11-29 13:49:20 0:17:59 0:12:39 0:05:20 smithi master centos 8.2 rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5665218 2020-11-29 07:06:22 2020-11-29 13:31:21 2020-11-29 13:45:20 0:13:59 0:04:57 0:09:02 smithi master ubuntu 18.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 5665219 2020-11-29 07:06:22 2020-11-29 13:31:22 2020-11-29 13:57:21 0:25:59 0:18:36 0:07:23 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects} 2
pass 5665220 2020-11-29 07:06:23 2020-11-29 13:31:21 2020-11-29 13:45:20 0:13:59 0:06:22 0:07:37 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} 2
pass 5665221 2020-11-29 07:06:24 2020-11-29 13:31:21 2020-11-29 13:57:21 0:26:00 0:19:27 0:06:33 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
pass 5665222 2020-11-29 07:06:25 2020-11-29 13:31:59 2020-11-29 13:51:58 0:19:59 0:13:20 0:06:39 smithi master rhel 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 5665223 2020-11-29 07:06:26 2020-11-29 13:33:19 2020-11-29 13:51:18 0:17:59 0:10:38 0:07:21 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 5665224 2020-11-29 07:06:26 2020-11-29 13:33:19 2020-11-29 14:01:19 0:28:00 0:20:18 0:07:42 smithi master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 5665225 2020-11-29 07:06:27 2020-11-29 13:33:19 2020-11-29 14:09:19 0:36:00 0:28:46 0:07:14 smithi master ubuntu 18.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 5665226 2020-11-29 07:06:28 2020-11-29 13:33:19 2020-11-29 14:29:19 0:56:00 0:48:17 0:07:43 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 5665227 2020-11-29 07:06:29 2020-11-29 13:35:15 2020-11-29 13:59:15 0:24:00 0:13:04 0:10:56 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} 2
pass 5665228 2020-11-29 07:06:30 2020-11-29 13:35:15 2020-11-29 13:59:15 0:24:00 0:18:05 0:05:55 smithi master centos 8.2 rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 5665229 2020-11-29 07:06:31 2020-11-29 13:35:15 2020-11-29 14:53:16 1:18:01 1:06:45 0:11:16 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665230 2020-11-29 07:06:31 2020-11-29 13:35:15 2020-11-29 14:21:15 0:46:00 0:34:36 0:11:24 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5665231 2020-11-29 07:06:32 2020-11-29 13:35:15 2020-11-29 13:51:15 0:16:00 0:09:57 0:06:03 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665232 2020-11-29 07:06:33 2020-11-29 13:35:16 2020-11-29 14:21:16 0:46:00 0:35:26 0:10:34 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
pass 5665233 2020-11-29 07:06:34 2020-11-29 13:35:16 2020-11-29 14:01:15 0:25:59 0:08:53 0:17:06 smithi master centos 8.2 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665234 2020-11-29 07:06:35 2020-11-29 13:35:16 2020-11-29 14:09:15 0:33:59 0:23:03 0:10:56 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} 2
pass 5665235 2020-11-29 07:06:35 2020-11-29 13:37:51 2020-11-29 14:05:50 0:27:59 0:21:59 0:06:00 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 5665236 2020-11-29 07:06:36 2020-11-29 13:37:51 2020-11-29 13:59:50 0:21:59 0:14:18 0:07:41 smithi master centos 8.2 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 5665237 2020-11-29 07:06:37 2020-11-29 13:37:51 2020-11-29 13:55:50 0:17:59 0:10:07 0:07:52 smithi master rhel 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 5665238 2020-11-29 07:06:38 2020-11-29 13:38:47 2020-11-29 13:58:47 0:20:00 0:12:07 0:07:53 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} 2
pass 5665239 2020-11-29 07:06:39 2020-11-29 13:40:00 2020-11-29 14:24:00 0:44:00 0:36:43 0:07:17 smithi master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665240 2020-11-29 07:06:39 2020-11-29 13:40:00 2020-11-29 14:00:00 0:20:00 0:10:14 0:09:46 smithi master rhel 8.3 rados/cephadm/smoke-roleless/{distro/rhel_latest start} 2
pass 5665241 2020-11-29 07:06:40 2020-11-29 13:40:00 2020-11-29 14:02:00 0:22:00 0:10:40 0:11:20 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/failover} 2
pass 5665242 2020-11-29 07:06:41 2020-11-29 13:40:32 2020-11-29 13:54:31 0:13:59 0:08:58 0:05:01 smithi master rhel 8.3 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 5665243 2020-11-29 07:06:42 2020-11-29 13:40:44 2020-11-29 13:58:44 0:18:00 0:11:08 0:06:52 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} 1
Failure Reason:

Command failed (workunit test cephadm/test_adoption.sh) on smithi012 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh'

pass 5665244 2020-11-29 07:06:42 2020-11-29 13:40:55 2020-11-29 14:00:55 0:20:00 0:10:03 0:09:57 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} 2
pass 5665245 2020-11-29 07:06:43 2020-11-29 13:41:56 2020-11-29 13:59:56 0:18:00 0:11:48 0:06:12 smithi master centos 8.2 rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 5665246 2020-11-29 07:06:44 2020-11-29 13:41:57 2020-11-29 14:57:57 1:16:00 1:06:22 0:09:38 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665247 2020-11-29 07:06:45 2020-11-29 13:41:57 2020-11-29 14:15:57 0:34:00 0:26:29 0:07:31 smithi master centos 8.2 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} 1
pass 5665248 2020-11-29 07:06:45 2020-11-29 13:41:57 2020-11-29 14:07:56 0:25:59 0:14:00 0:11:59 smithi master centos 8.0 rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} 2
fail 5665249 2020-11-29 07:06:46 2020-11-29 13:44:08 2020-11-29 14:14:08 0:30:00 0:23:33 0:06:27 smithi master rhel 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} 1
Failure Reason:

Command failed (workunit test mon/mon-last-epoch-clean.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh'

pass 5665250 2020-11-29 07:06:47 2020-11-29 13:44:36 2020-11-29 14:16:36 0:32:00 0:24:52 0:07:08 smithi master centos 8.2 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 5665251 2020-11-29 07:06:48 2020-11-29 13:44:45 2020-11-29 14:12:44 0:27:59 0:21:41 0:06:18 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} 2
pass 5665252 2020-11-29 07:06:48 2020-11-29 13:45:59 2020-11-29 14:15:58 0:29:59 0:22:46 0:07:13 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 5665253 2020-11-29 07:06:49 2020-11-29 13:45:59 2020-11-29 13:55:58 0:09:59 0:02:10 0:07:49 smithi master ubuntu 18.04 rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} 2
Failure Reason:

Command failed on smithi055 with status 5: 'sudo systemctl stop ceph-55731d88-324a-11eb-980d-001a4aab830c@mon.a'

pass 5665254 2020-11-29 07:06:50 2020-11-29 13:45:59 2020-11-29 14:05:58 0:19:59 0:13:17 0:06:42 smithi master rhel 8.3 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 5665255 2020-11-29 07:06:51 2020-11-29 13:45:59 2020-11-29 14:13:58 0:27:59 0:20:08 0:07:51 smithi master ubuntu 18.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 5665256 2020-11-29 07:06:51 2020-11-29 13:46:34 2020-11-29 14:16:33 0:29:59 0:23:09 0:06:50 smithi master ubuntu 18.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5665257 2020-11-29 07:06:52 2020-11-29 13:46:52 2020-11-29 14:22:52 0:36:00 0:28:20 0:07:40 smithi master centos 8.2 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} 2
pass 5665258 2020-11-29 07:06:53 2020-11-29 13:46:56 2020-11-29 14:20:56 0:34:00 0:25:22 0:08:38 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 5665259 2020-11-29 07:06:54 2020-11-29 13:48:03 2020-11-29 14:12:02 0:23:59 0:18:14 0:05:45 smithi master centos 8.2 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 5665260 2020-11-29 07:06:55 2020-11-29 13:48:03 2020-11-29 14:16:02 0:27:59 0:21:05 0:06:54 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 5665261 2020-11-29 07:06:55 2020-11-29 13:48:37 2020-11-29 14:06:37 0:18:00 0:11:22 0:06:38 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 5665262 2020-11-29 07:06:56 2020-11-29 13:48:52 2020-11-29 14:16:52 0:28:00 0:19:32 0:08:28 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} 3
pass 5665263 2020-11-29 07:06:57 2020-11-29 13:48:52 2020-11-29 14:06:51 0:17:59 0:10:59 0:07:00 smithi master centos 8.2 rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} 2
pass 5665264 2020-11-29 07:06:58 2020-11-29 13:50:03 2020-11-29 14:10:02 0:19:59 0:13:45 0:06:14 smithi master rhel 8.3 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 5665265 2020-11-29 07:06:59 2020-11-29 13:50:03 2020-11-29 14:08:02 0:17:59 0:10:23 0:07:36 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} 2
pass 5665266 2020-11-29 07:07:00 2020-11-29 13:50:05 2020-11-29 14:08:04 0:17:59 0:08:49 0:09:10 smithi master ubuntu 18.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 5665267 2020-11-29 07:07:00 2020-11-29 13:51:49 2020-11-29 15:29:50 1:38:01 1:27:13 0:10:48 smithi master centos 8.2 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 5665268 2020-11-29 07:07:01 2020-11-29 13:51:49 2020-11-29 15:07:50 1:16:01 1:07:50 0:08:11 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665269 2020-11-29 07:07:02 2020-11-29 13:51:49 2020-11-29 14:13:49 0:22:00 0:11:21 0:10:39 smithi master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665270 2020-11-29 07:07:03 2020-11-29 13:51:49 2020-11-29 14:25:49 0:34:00 0:23:59 0:10:01 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 5665271 2020-11-29 07:07:04 2020-11-29 13:51:49 2020-11-29 14:33:49 0:42:00 0:29:53 0:12:07 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} 3
pass 5665272 2020-11-29 07:07:04 2020-11-29 13:51:59 2020-11-29 14:15:59 0:24:00 0:15:52 0:08:08 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} 2
pass 5665273 2020-11-29 07:07:05 2020-11-29 13:54:08 2020-11-29 14:20:07 0:25:59 0:19:36 0:06:23 smithi master centos 8.2 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} 2
pass 5665274 2020-11-29 07:07:06 2020-11-29 13:54:33 2020-11-29 14:26:32 0:31:59 0:25:16 0:06:43 smithi master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 5665275 2020-11-29 07:07:06 2020-11-29 13:54:46 2020-11-29 14:12:46 0:18:00 0:10:24 0:07:36 smithi master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 5665276 2020-11-29 07:07:07 2020-11-29 13:55:06 2020-11-29 17:11:10 3:16:04 3:09:57 0:06:07 smithi master rhel 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} 1
pass 5665277 2020-11-29 07:07:08 2020-11-29 13:56:21 2020-11-29 14:32:21 0:36:00 0:29:23 0:06:37 smithi master centos 8.2 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 2
pass 5665278 2020-11-29 07:07:09 2020-11-29 13:56:21 2020-11-29 14:44:21 0:48:00 0:36:37 0:11:23 smithi master centos 8.0 rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 5665279 2020-11-29 07:07:09 2020-11-29 13:56:21 2020-11-29 14:24:21 0:28:00 0:19:47 0:08:13 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} 2
pass 5665280 2020-11-29 07:07:10 2020-11-29 13:57:14 2020-11-29 14:13:14 0:16:00 0:08:16 0:07:44 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 5665281 2020-11-29 07:07:11 2020-11-29 13:58:01 2020-11-29 14:14:01 0:16:00 0:10:03 0:05:57 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 5665282 2020-11-29 07:07:12 2020-11-29 13:58:01 2020-11-29 14:20:01 0:22:00 0:15:20 0:06:40 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665283 2020-11-29 07:07:13 2020-11-29 13:58:01 2020-11-29 14:18:01 0:20:00 0:11:30 0:08:30 smithi master rhel 8.3 rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} 2
pass 5665284 2020-11-29 07:07:13 2020-11-29 13:58:01 2020-11-29 14:28:01 0:30:00 0:21:17 0:08:43 smithi master ubuntu 18.04 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 5665285 2020-11-29 07:07:14 2020-11-29 13:58:02 2020-11-29 14:24:01 0:25:59 0:11:09 0:14:50 smithi master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 5665286 2020-11-29 07:07:15 2020-11-29 13:58:45 2020-11-29 16:10:47 2:12:02 2:05:51 0:06:11 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} 2
pass 5665287 2020-11-29 07:07:16 2020-11-29 13:58:48 2020-11-29 15:12:48 1:14:00 1:07:12 0:06:48 smithi master rhel 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} 2
pass 5665288 2020-11-29 07:07:16 2020-11-29 13:59:58 2020-11-29 19:34:04 5:34:06 5:19:04 0:15:02 smithi master ubuntu 18.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} 1
pass 5665289 2020-11-29 07:07:17 2020-11-29 13:59:58 2020-11-29 14:37:57 0:37:59 0:31:10 0:06:49 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5665290 2020-11-29 07:07:18 2020-11-29 13:59:58 2020-11-29 14:17:57 0:17:59 0:11:14 0:06:45 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} 2
pass 5665291 2020-11-29 07:07:19 2020-11-29 13:59:58 2020-11-29 14:13:57 0:13:59 0:05:52 0:08:07 smithi master centos 8.2 rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 5665292 2020-11-29 07:07:19 2020-11-29 13:59:58 2020-11-29 14:31:57 0:31:59 0:23:53 0:08:06 smithi master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 5665293 2020-11-29 07:07:20 2020-11-29 14:00:01 2020-11-29 14:58:01 0:58:00 0:47:44 0:10:16 smithi master centos 8.2 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 5665294 2020-11-29 07:07:21 2020-11-29 14:00:56 2020-11-29 14:32:56 0:32:00 0:24:55 0:07:05 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} 2
pass 5665295 2020-11-29 07:07:22 2020-11-29 14:02:04 2020-11-29 15:24:06 1:22:02 1:03:34 0:18:28 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} 3
pass 5665296 2020-11-29 07:07:22 2020-11-29 14:02:05 2020-11-29 14:22:04 0:19:59 0:11:48 0:08:11 smithi master rhel 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 5665297 2020-11-29 07:07:23 2020-11-29 14:02:05 2020-11-29 14:30:04 0:27:59 0:18:45 0:09:14 smithi master rhel 8.0 rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} 2
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

fail 5665298 2020-11-29 07:07:24 2020-11-29 14:02:05 2020-11-29 14:42:05 0:40:00 0:25:19 0:14:41 smithi master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi076 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fd3c0f905b4ddc20dd0f60ffb1ac5c52da940845 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5665299 2020-11-29 07:07:25 2020-11-29 14:06:04 2020-11-29 14:38:04 0:32:00 0:23:23 0:08:37 smithi master centos 8.2 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 2
pass 5665300 2020-11-29 07:07:26 2020-11-29 14:06:04 2020-11-29 14:26:04 0:20:00 0:11:59 0:08:01 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 5665301 2020-11-29 07:07:26 2020-11-29 14:06:04 2020-11-29 14:30:04 0:24:00 0:09:20 0:14:40 smithi master ubuntu 18.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 5665302 2020-11-29 07:07:27 2020-11-29 14:06:06 2020-11-29 15:54:07 1:48:01 1:40:58 0:07:03 smithi master centos 8.2 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} 1
pass 5665303 2020-11-29 07:07:28 2020-11-29 14:06:38 2020-11-29 14:22:37 0:15:59 0:10:03 0:05:56 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache} 2
pass 5665304 2020-11-29 07:07:29 2020-11-29 14:06:53 2020-11-29 14:30:52 0:23:59 0:18:14 0:05:45 smithi master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} 1
dead 5665305 2020-11-29 07:07:29 2020-11-29 14:08:49 2020-11-29 14:26:48 0:17:59 smithi master centos 8.2 rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
Failure Reason:

reached maximum tries (60) after waiting for 900 seconds

pass 5665306 2020-11-29 07:07:30 2020-11-29 14:08:49 2020-11-29 14:40:48 0:31:59 0:25:55 0:06:04 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5665307 2020-11-29 07:07:31 2020-11-29 14:08:49 2020-11-29 14:22:48 0:13:59 0:06:16 0:07:43 smithi master centos 8.2 rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 5665308 2020-11-29 07:07:32 2020-11-29 14:09:17 2020-11-29 15:23:17 1:14:00 1:05:13 0:08:47 smithi master centos 8.2 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} 2
pass 5665309 2020-11-29 07:07:33 2020-11-29 14:09:20 2020-11-29 14:41:19 0:31:59 0:19:03 0:12:56 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
pass 5665310 2020-11-29 07:07:34 2020-11-29 14:09:20 2020-11-29 14:45:20 0:36:00 0:27:16 0:08:44 smithi master centos 8.2 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/module_selftest} 2
pass 5665311 2020-11-29 07:07:34 2020-11-29 14:10:48 2020-11-29 14:32:48 0:22:00 0:13:11 0:08:49 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} 2
pass 5665312 2020-11-29 07:07:35 2020-11-29 14:12:48 2020-11-29 14:50:47 0:37:59 0:30:28 0:07:31 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 5665313 2020-11-29 07:07:36 2020-11-29 14:12:48 2020-11-29 14:30:47 0:17:59 0:10:32 0:07:27 smithi master ubuntu 18.04 rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} 2
pass 5665314 2020-11-29 07:07:37 2020-11-29 14:12:49 2020-11-29 14:30:47 0:17:58 0:11:05 0:06:53 smithi master centos 8.2 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 5665315 2020-11-29 07:07:37 2020-11-29 14:12:49 2020-11-29 14:28:47 0:15:58 0:07:40 0:08:18 smithi master rhel 8.3 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 5665316 2020-11-29 07:07:38 2020-11-29 14:13:15 2020-11-29 14:27:14 0:13:59 0:07:43 0:06:16 smithi master ubuntu 18.04 rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} 1
pass 5665317 2020-11-29 07:07:39 2020-11-29 14:14:35 2020-11-29 14:34:35 0:20:00 0:12:27 0:07:33 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} 2