Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6483320 2021-11-03 23:47:00 2021-11-04 06:35:53 2021-11-04 07:02:48 0:26:55 0:20:15 0:06:40 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6483321 2021-11-03 23:47:01 2021-11-04 06:35:53 2021-11-04 07:01:15 0:25:22 0:12:58 0:12:24 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6483322 2021-11-03 23:47:02 2021-11-04 06:38:04 2021-11-04 07:06:10 0:28:06 0:19:54 0:08:12 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} 2
fail 6483323 2021-11-03 23:47:03 2021-11-04 06:38:44 2021-11-04 07:00:11 0:21:27 0:10:42 0:10:45 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

Command failed on smithi150 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 302d02de-3d3c-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6483324 2021-11-03 23:47:04 2021-11-04 06:38:45 2021-11-04 07:30:59 0:52:14 0:42:04 0:10:10 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483325 2021-11-03 23:47:05 2021-11-04 06:39:15 2021-11-04 07:51:25 1:12:10 1:05:17 0:06:53 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} 1
pass 6483326 2021-11-03 23:47:06 2021-11-04 06:39:55 2021-11-04 07:01:29 0:21:34 0:11:32 0:10:02 smithi master centos 8.3 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 1
pass 6483327 2021-11-03 23:47:07 2021-11-04 06:40:06 2021-11-04 07:27:30 0:47:24 0:41:04 0:06:20 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6483328 2021-11-03 23:47:08 2021-11-04 06:40:16 2021-11-04 07:23:47 0:43:31 0:35:28 0:08:03 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 6483329 2021-11-03 23:47:09 2021-11-04 06:42:17 2021-11-04 07:03:17 0:21:00 0:07:09 0:13:51 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6483330 2021-11-03 23:47:10 2021-11-04 06:42:37 2021-11-04 07:07:31 0:24:54 0:18:38 0:06:16 smithi master rhel 8.4 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
pass 6483331 2021-11-03 23:47:11 2021-11-04 06:42:37 2021-11-04 07:04:04 0:21:27 0:11:36 0:09:51 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6483332 2021-11-03 23:47:12 2021-11-04 06:42:38 2021-11-04 07:25:12 0:42:34 0:29:54 0:12:40 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6483333 2021-11-03 23:47:13 2021-11-04 06:43:59 2021-11-04 07:14:36 0:30:37 0:18:45 0:11:52 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6483334 2021-11-03 23:47:14 2021-11-04 06:44:39 2021-11-04 07:15:47 0:31:08 0:18:07 0:13:01 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6483335 2021-11-03 23:47:15 2021-11-04 06:45:50 2021-11-04 07:06:39 0:20:49 0:12:45 0:08:04 smithi master centos 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6483336 2021-11-03 23:47:16 2021-11-04 06:45:50 2021-11-04 07:09:52 0:24:02 0:13:19 0:10:43 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} 1
pass 6483337 2021-11-03 23:47:17 2021-11-04 06:46:10 2021-11-04 07:13:12 0:27:02 0:13:05 0:13:57 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483338 2021-11-03 23:47:18 2021-11-04 06:49:31 2021-11-04 07:23:23 0:33:52 0:21:24 0:12:28 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6483339 2021-11-03 23:47:19 2021-11-04 06:50:12 2021-11-04 07:22:17 0:32:05 0:25:34 0:06:31 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6483340 2021-11-03 23:47:20 2021-11-04 06:50:52 2021-11-04 07:40:51 0:49:59 0:39:45 0:10:14 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 6483341 2021-11-03 23:47:21 2021-11-04 06:51:22 2021-11-04 07:43:22 0:52:00 0:36:07 0:15:53 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6483342 2021-11-03 23:47:22 2021-11-04 06:53:23 2021-11-04 07:36:50 0:43:27 0:32:46 0:10:41 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483343 2021-11-03 23:47:24 2021-11-04 06:53:23 2021-11-04 07:16:45 0:23:22 0:12:59 0:10:23 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6483344 2021-11-03 23:47:25 2021-11-04 06:53:34 2021-11-04 07:25:24 0:31:50 0:17:13 0:14:37 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.0} 3
pass 6483345 2021-11-03 23:47:25 2021-11-04 06:55:14 2021-11-04 07:44:13 0:48:59 0:42:58 0:06:01 smithi master rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6483346 2021-11-03 23:47:27 2021-11-04 06:55:15 2021-11-04 08:05:52 1:10:37 0:57:35 0:13:02 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} 2
pass 6483347 2021-11-03 23:47:28 2021-11-04 06:56:45 2021-11-04 07:21:26 0:24:41 0:17:38 0:07:03 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6483348 2021-11-03 23:47:29 2021-11-04 06:57:46 2021-11-04 07:43:23 0:45:37 0:35:20 0:10:17 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/one workloads/snaps-few-objects} 2
pass 6483349 2021-11-03 23:47:30 2021-11-04 06:58:06 2021-11-04 07:36:37 0:38:31 0:27:18 0:11:13 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 6483350 2021-11-03 23:47:31 2021-11-04 06:59:36 2021-11-04 07:34:51 0:35:15 0:23:36 0:11:39 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6483351 2021-11-03 23:47:32 2021-11-04 06:59:47 2021-11-04 07:35:09 0:35:22 0:29:45 0:05:37 smithi master rhel 8.4 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6483352 2021-11-03 23:47:33 2021-11-04 06:59:57 2021-11-04 08:27:45 1:27:48 1:18:14 0:09:34 smithi master centos 8.2 rados/upgrade/parallel/{0-distro$/{centos_8.2_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6483353 2021-11-03 23:47:33 2021-11-04 06:59:57 2021-11-04 07:21:21 0:21:24 0:11:43 0:09:41 smithi master centos 8.stream rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 1
pass 6483354 2021-11-03 23:47:34 2021-11-04 07:00:18 2021-11-04 07:23:54 0:23:36 0:13:28 0:10:08 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6483355 2021-11-03 23:47:35 2021-11-04 07:00:38 2021-11-04 08:18:21 1:17:43 1:10:13 0:07:30 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6483356 2021-11-03 23:47:37 2021-11-04 07:01:09 2021-11-04 07:27:11 0:26:02 0:12:50 0:13:12 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483357 2021-11-03 23:47:38 2021-11-04 07:01:39 2021-11-04 07:45:14 0:43:35 0:32:59 0:10:36 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6483358 2021-11-03 23:47:39 2021-11-04 07:02:09 2021-11-04 07:22:46 0:20:37 0:08:35 0:12:02 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} 2
pass 6483359 2021-11-03 23:47:40 2021-11-04 07:02:50 2021-11-04 07:53:08 0:50:18 0:38:02 0:12:16 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
pass 6483360 2021-11-03 23:47:41 2021-11-04 07:03:20 2021-11-04 07:28:41 0:25:21 0:12:22 0:12:59 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6483361 2021-11-03 23:47:42 2021-11-04 07:03:21 2021-11-04 07:57:05 0:53:44 0:43:07 0:10:37 smithi master centos 8.stream rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
pass 6483362 2021-11-03 23:47:43 2021-11-04 07:04:11 2021-11-04 07:25:37 0:21:26 0:11:35 0:09:51 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483363 2021-11-03 23:47:44 2021-11-04 07:04:11 2021-11-04 07:49:24 0:45:13 0:32:59 0:12:14 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6483364 2021-11-03 23:47:45 2021-11-04 07:06:12 2021-11-04 07:43:55 0:37:43 0:27:48 0:09:55 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6483365 2021-11-03 23:47:46 2021-11-04 07:06:42 2021-11-04 08:19:07 1:12:25 1:00:19 0:12:06 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 6483366 2021-11-03 23:47:47 2021-11-04 07:07:33 2021-11-04 07:30:42 0:23:09 0:13:50 0:09:19 smithi master centos 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 6483367 2021-11-03 23:47:48 2021-11-04 07:07:53 2021-11-04 07:30:10 0:22:17 0:11:24 0:10:53 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 6483368 2021-11-03 23:47:49 2021-11-04 07:08:13 2021-11-04 07:29:35 0:21:22 0:08:45 0:12:37 smithi master centos 8.3 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 6483369 2021-11-03 23:47:50 2021-11-04 07:09:54 2021-11-04 08:14:54 1:05:00 0:55:50 0:09:10 smithi master centos 8.3 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 6483370 2021-11-03 23:47:51 2021-11-04 07:09:54 2021-11-04 07:36:10 0:26:16 0:14:28 0:11:48 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6483371 2021-11-03 23:47:52 2021-11-04 07:10:55 2021-11-04 07:43:13 0:32:18 0:24:46 0:07:32 smithi master rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6483372 2021-11-03 23:47:53 2021-11-04 07:11:55 2021-11-04 08:36:59 1:25:04 1:18:58 0:06:06 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} 1
pass 6483373 2021-11-03 23:47:54 2021-11-04 07:11:55 2021-11-04 07:34:16 0:22:21 0:12:20 0:10:01 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 6483374 2021-11-03 23:47:55 2021-11-04 07:12:36 2021-11-04 07:48:14 0:35:38 0:22:54 0:12:44 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} 3
pass 6483375 2021-11-03 23:47:55 2021-11-04 07:14:46 2021-11-04 07:35:02 0:20:16 0:10:20 0:09:56 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_adoption} 1
pass 6483376 2021-11-03 23:47:56 2021-11-04 07:14:47 2021-11-04 07:57:25 0:42:38 0:30:58 0:11:40 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/module_selftest} 2
pass 6483377 2021-11-03 23:47:57 2021-11-04 07:15:57 2021-11-04 07:49:59 0:34:02 0:22:43 0:11:19 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 6483378 2021-11-03 23:47:58 2021-11-04 07:16:48 2021-11-04 07:45:40 0:28:52 0:11:02 0:17:50 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} 2
pass 6483379 2021-11-03 23:47:59 2021-11-04 07:21:29 2021-11-04 08:08:24 0:46:55 0:38:51 0:08:04 smithi master centos 8.3 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6483380 2021-11-03 23:48:00 2021-11-04 07:21:29 2021-11-04 07:49:34 0:28:05 0:20:42 0:07:23 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6483381 2021-11-03 23:48:01 2021-11-04 07:22:19 2021-11-04 07:46:47 0:24:28 0:10:17 0:14:11 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6483382 2021-11-03 23:48:02 2021-11-04 07:22:50 2021-11-04 08:04:35 0:41:45 0:31:22 0:10:23 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483383 2021-11-03 23:48:03 2021-11-04 07:23:30 2021-11-04 07:44:26 0:20:56 0:11:16 0:09:40 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483384 2021-11-03 23:48:04 2021-11-04 07:23:30 2021-11-04 07:47:02 0:23:32 0:17:02 0:06:30 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6483385 2021-11-03 23:48:05 2021-11-04 07:23:51 2021-11-04 07:59:13 0:35:22 0:25:16 0:10:06 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} 2
pass 6483386 2021-11-03 23:48:06 2021-11-04 07:24:01 2021-11-04 08:06:34 0:42:33 0:30:50 0:11:43 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 6483387 2021-11-03 23:48:07 2021-11-04 07:25:22 2021-11-04 07:47:34 0:22:12 0:11:42 0:10:30 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6483388 2021-11-03 23:48:08 2021-11-04 07:25:22 2021-11-04 08:04:57 0:39:35 0:33:22 0:06:13 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6483389 2021-11-03 23:48:09 2021-11-04 07:25:32 2021-11-04 07:51:23 0:25:51 0:19:02 0:06:49 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6483390 2021-11-03 23:48:10 2021-11-04 07:25:43 2021-11-04 07:54:41 0:28:58 0:17:28 0:11:30 smithi master centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/sync-many workloads/pool-create-delete} 2
pass 6483391 2021-11-03 23:48:11 2021-11-04 07:27:13 2021-11-04 07:52:26 0:25:13 0:14:38 0:10:35 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6483392 2021-11-03 23:48:12 2021-11-04 07:27:13 2021-11-04 07:46:44 0:19:31 0:10:52 0:08:39 smithi master centos 8.stream rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
pass 6483393 2021-11-03 23:48:13 2021-11-04 07:27:34 2021-11-04 07:57:24 0:29:50 0:15:46 0:14:04 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6483394 2021-11-03 23:48:14 2021-11-04 07:28:44 2021-11-04 07:55:57 0:27:13 0:12:56 0:14:17 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483395 2021-11-03 23:48:15 2021-11-04 07:30:15 2021-11-04 07:49:11 0:18:56 0:10:03 0:08:53 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6483396 2021-11-03 23:48:16 2021-11-04 07:30:15 2021-11-04 07:55:57 0:25:42 0:15:04 0:10:38 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 6483397 2021-11-03 23:48:17 2021-11-04 07:30:45 2021-11-04 08:21:54 0:51:09 0:37:32 0:13:37 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6483398 2021-11-03 23:48:18 2021-11-04 07:34:26 2021-11-04 08:08:00 0:33:34 0:23:06 0:10:28 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} 2
pass 6483399 2021-11-03 23:48:19 2021-11-04 07:34:57 2021-11-04 07:57:59 0:23:02 0:10:02 0:13:00 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 6483400 2021-11-03 23:48:20 2021-11-04 07:35:17 2021-11-04 08:17:27 0:42:10 0:34:39 0:07:31 smithi master rhel 8.4 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6483401 2021-11-03 23:48:21 2021-11-04 07:35:47 2021-11-04 08:02:10 0:26:23 0:14:28 0:11:55 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6483402 2021-11-03 23:48:22 2021-11-04 07:36:18 2021-11-04 07:57:14 0:20:56 0:11:58 0:08:58 smithi master centos 8.stream rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483403 2021-11-03 23:48:23 2021-11-04 07:36:18 2021-11-04 08:02:05 0:25:47 0:14:29 0:11:18 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 6483404 2021-11-03 23:48:24 2021-11-04 07:36:38 2021-11-04 08:02:59 0:26:21 0:14:26 0:11:55 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6483405 2021-11-03 23:48:25 2021-11-04 07:36:59 2021-11-04 08:08:30 0:31:31 0:21:40 0:09:51 smithi master rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
pass 6483406 2021-11-03 23:48:26 2021-11-04 07:41:00 2021-11-04 08:25:13 0:44:13 0:29:50 0:14:23 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6483407 2021-11-03 23:48:27 2021-11-04 07:43:30 2021-11-04 08:04:36 0:21:06 0:11:05 0:10:01 smithi master centos 8.3 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
dead 6483408 2021-11-03 23:48:28 2021-11-04 07:43:31 2021-11-04 19:53:43 12:10:12 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6483409 2021-11-03 23:48:29 2021-11-04 07:43:31 2021-11-04 08:04:12 0:20:41 0:10:15 0:10:26 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6483410 2021-11-03 23:48:30 2021-11-04 07:44:01 2021-11-04 08:03:12 0:19:11 0:10:31 0:08:40 smithi master centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6483411 2021-11-03 23:48:31 2021-11-04 07:44:01 2021-11-04 12:15:37 4:31:36 4:22:17 0:09:19 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/osd-backfill} 1
pass 6483412 2021-11-03 23:48:32 2021-11-04 07:44:22 2021-11-04 08:19:29 0:35:07 0:26:00 0:09:07 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6483413 2021-11-03 23:48:33 2021-11-04 07:44:32 2021-11-04 08:18:35 0:34:03 0:22:06 0:11:57 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} 2
pass 6483414 2021-11-03 23:48:34 2021-11-04 07:45:23 2021-11-04 08:09:28 0:24:05 0:13:13 0:10:52 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6483415 2021-11-03 23:48:35 2021-11-04 07:45:43 2021-11-04 08:26:12 0:40:29 0:32:21 0:08:08 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/progress} 2
pass 6483416 2021-11-03 23:48:36 2021-11-04 07:46:53 2021-11-04 08:12:05 0:25:12 0:15:23 0:09:49 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 6483417 2021-11-03 23:48:37 2021-11-04 07:46:54 2021-11-04 08:27:01 0:40:07 0:29:20 0:10:47 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6483418 2021-11-03 23:48:37 2021-11-04 07:47:04 2021-11-04 08:13:40 0:26:36 0:18:40 0:07:56 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6483419 2021-11-03 23:48:38 2021-11-04 07:48:15 2021-11-04 08:25:42 0:37:27 0:23:06 0:14:21 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6483420 2021-11-03 23:48:40 2021-11-04 07:49:15 2021-11-04 08:26:23 0:37:08 0:26:21 0:10:47 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483421 2021-11-03 23:48:40 2021-11-04 07:49:25 2021-11-04 08:14:47 0:25:22 0:19:07 0:06:15 smithi master rhel 8.4 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6483422 2021-11-03 23:48:41 2021-11-04 07:49:36 2021-11-04 08:06:32 0:16:56 0:07:25 0:09:31 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 6483423 2021-11-03 23:48:42 2021-11-04 07:49:36 2021-11-04 10:11:12 2:21:36 2:10:03 0:11:33 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} 2
pass 6483424 2021-11-03 23:48:43 2021-11-04 07:50:07 2021-11-04 08:14:43 0:24:36 0:12:27 0:12:09 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6483425 2021-11-03 23:48:44 2021-11-04 07:51:27 2021-11-04 08:09:36 0:18:09 0:07:51 0:10:18 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483426 2021-11-03 23:48:46 2021-11-04 07:51:27 2021-11-04 08:13:58 0:22:31 0:11:01 0:11:30 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} 2
pass 6483427 2021-11-03 23:48:47 2021-11-04 07:52:28 2021-11-04 08:38:25 0:45:57 0:34:29 0:11:28 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6483428 2021-11-03 23:48:48 2021-11-04 07:53:08 2021-11-04 08:34:16 0:41:08 0:33:11 0:07:57 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 6483429 2021-11-03 23:48:49 2021-11-04 07:54:49 2021-11-04 08:21:22 0:26:33 0:11:13 0:15:20 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483430 2021-11-03 23:48:50 2021-11-04 07:55:59 2021-11-04 08:44:08 0:48:09 0:36:10 0:11:59 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 6483431 2021-11-03 23:48:51 2021-11-04 07:57:10 2021-11-04 08:20:16 0:23:06 0:15:08 0:07:58 smithi master centos 8.3 rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6483432 2021-11-03 23:48:52 2021-11-04 07:57:20 2021-11-04 08:41:03 0:43:43 0:32:13 0:11:30 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
pass 6483433 2021-11-03 23:48:53 2021-11-04 07:57:31 2021-11-04 08:36:14 0:38:43 0:27:50 0:10:53 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6483434 2021-11-03 23:48:54 2021-11-04 07:58:01 2021-11-04 08:17:12 0:19:11 0:10:25 0:08:46 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
fail 6483435 2021-11-03 23:48:55 2021-11-04 07:58:01 2021-11-04 08:18:37 0:20:36 0:09:06 0:11:30 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Command failed on smithi079 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 313b3334-3d47-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6483436 2021-11-03 23:48:56 2021-11-04 07:59:22 2021-11-04 10:42:16 2:42:54 2:16:34 0:26:20 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} 1
pass 6483437 2021-11-03 23:48:57 2021-11-04 08:02:13 2021-11-04 08:43:26 0:41:13 0:32:03 0:09:10 smithi master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6483438 2021-11-03 23:48:58 2021-11-04 08:02:13 2021-11-04 08:22:10 0:19:57 0:10:29 0:09:28 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 6483439 2021-11-03 23:48:59 2021-11-04 08:02:13 2021-11-04 08:26:32 0:24:19 0:17:22 0:06:57 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6483440 2021-11-03 23:48:59 2021-11-04 08:03:04 2021-11-04 08:42:43 0:39:39 0:30:29 0:09:10 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} 1
pass 6483441 2021-11-03 23:49:00 2021-11-04 08:03:04 2021-11-04 08:41:43 0:38:39 0:27:06 0:11:33 smithi master centos 8.stream rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream}} 2
pass 6483442 2021-11-03 23:49:01 2021-11-04 08:04:15 2021-11-04 08:44:11 0:39:56 0:32:22 0:07:34 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6483443 2021-11-03 23:49:02 2021-11-04 08:04:45 2021-11-04 08:37:58 0:33:13 0:22:22 0:10:51 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 6483444 2021-11-03 23:49:03 2021-11-04 08:04:46 2021-11-04 08:32:30 0:27:44 0:20:13 0:07:31 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
pass 6483445 2021-11-03 23:49:04 2021-11-04 08:05:06 2021-11-04 08:45:09 0:40:03 0:32:15 0:07:48 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6483446 2021-11-03 23:49:05 2021-11-04 08:05:56 2021-11-04 08:25:48 0:19:52 0:08:48 0:11:04 smithi master centos 8.3 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
fail 6483447 2021-11-03 23:49:06 2021-11-04 08:06:37 2021-11-04 08:37:19 0:30:42 0:17:50 0:12:52 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi058 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6483448 2021-11-03 23:49:07 2021-11-04 08:08:07 2021-11-04 08:35:01 0:26:54 0:20:48 0:06:06 smithi master rhel 8.4 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6483449 2021-11-03 23:49:08 2021-11-04 08:08:07 2021-11-04 08:39:50 0:31:43 0:22:17 0:09:26 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
fail 6483450 2021-11-03 23:49:09 2021-11-04 08:08:28 2021-11-04 08:28:04 0:19:36 0:08:45 0:10:51 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Command failed on smithi167 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7d3acba4-3d48-11ec-8c28-001a4aab830c -- ceph orch apply mon '2;smithi138:172.21.15.138=smithi138;smithi167:172.21.15.167=smithi167'"

pass 6483451 2021-11-03 23:49:10 2021-11-04 08:08:38 2021-11-04 08:37:20 0:28:42 0:17:09 0:11:33 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6483452 2021-11-03 23:49:11 2021-11-04 08:09:39 2021-11-04 08:35:21 0:25:42 0:14:26 0:11:16 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8.stream} tasks/prometheus} 2
pass 6483453 2021-11-03 23:49:12 2021-11-04 08:09:39 2021-11-04 08:53:52 0:44:13 0:30:03 0:14:10 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6483454 2021-11-03 23:49:13 2021-11-04 08:12:10 2021-11-04 08:43:47 0:31:37 0:19:11 0:12:26 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} 2
pass 6483455 2021-11-03 23:49:14 2021-11-04 08:13:50 2021-11-04 08:39:11 0:25:21 0:18:09 0:07:12 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6483456 2021-11-03 23:49:15 2021-11-04 08:14:01 2021-11-04 08:52:59 0:38:58 0:27:31 0:11:27 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6483457 2021-11-03 23:49:16 2021-11-04 08:14:51 2021-11-04 08:35:40 0:20:49 0:11:49 0:09:00 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6483458 2021-11-03 23:49:17 2021-11-04 08:14:51 2021-11-04 11:37:16 3:22:25 3:12:39 0:09:46 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 6483459 2021-11-03 23:49:18 2021-11-04 08:15:02 2021-11-04 08:43:17 0:28:15 0:10:26 0:17:49 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6483460 2021-11-03 23:49:20 2021-11-04 08:18:23 2021-11-04 08:58:27 0:40:04 0:27:50 0:12:14 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483461 2021-11-03 23:49:21 2021-11-04 08:18:43 2021-11-04 09:22:13 1:03:30 0:52:16 0:11:14 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6483462 2021-11-03 23:49:21 2021-11-04 08:18:43 2021-11-04 08:40:24 0:21:41 0:11:37 0:10:04 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} 2
pass 6483463 2021-11-03 23:49:22 2021-11-04 08:19:14 2021-11-04 09:18:28 0:59:14 0:49:36 0:09:38 smithi master centos 8.stream rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 1
pass 6483464 2021-11-03 23:49:23 2021-11-04 08:19:14 2021-11-04 09:01:22 0:42:08 0:35:32 0:06:36 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 6483465 2021-11-03 23:49:24 2021-11-04 08:20:25 2021-11-04 08:59:56 0:39:31 0:27:01 0:12:30 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
dead 6483466 2021-11-03 23:49:25 2021-11-04 08:21:25 2021-11-04 20:32:41 12:11:16 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6483467 2021-11-03 23:49:26 2021-11-04 08:21:26 2021-11-04 08:43:52 0:22:26 0:11:10 0:11:16 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 6483468 2021-11-03 23:49:27 2021-11-04 08:21:56 2021-11-04 09:00:14 0:38:18 0:26:38 0:11:40 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6483469 2021-11-03 23:49:28 2021-11-04 08:22:16 2021-11-04 08:52:13 0:29:57 0:10:43 0:19:14 smithi master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483470 2021-11-03 23:49:29 2021-11-04 08:25:47 2021-11-04 08:47:29 0:21:42 0:11:17 0:10:25 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483471 2021-11-03 23:49:30 2021-11-04 08:25:47 2021-11-04 08:49:09 0:23:22 0:13:57 0:09:25 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 6483472 2021-11-03 23:49:31 2021-11-04 08:25:58 2021-11-04 08:47:33 0:21:35 0:11:00 0:10:35 smithi master centos 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 2
pass 6483473 2021-11-03 23:49:32 2021-11-04 08:26:18 2021-11-04 08:50:14 0:23:56 0:13:20 0:10:36 smithi master ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 6483474 2021-11-03 23:49:33 2021-11-04 08:26:28 2021-11-04 11:14:06 2:47:38 2:18:20 0:29:18 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
pass 6483475 2021-11-03 23:49:34 2021-11-04 08:26:29 2021-11-04 08:48:40 0:22:11 0:11:27 0:10:44 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 6483476 2021-11-03 23:49:35 2021-11-04 08:26:39 2021-11-04 08:55:06 0:28:27 0:17:25 0:11:02 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6483477 2021-11-03 23:49:36 2021-11-04 08:27:10 2021-11-04 08:51:27 0:24:17 0:16:50 0:07:27 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6483478 2021-11-03 23:49:37 2021-11-04 08:27:50 2021-11-04 08:53:58 0:26:08 0:16:15 0:09:53 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483479 2021-11-03 23:49:38 2021-11-04 08:28:10 2021-11-04 09:11:41 0:43:31 0:28:17 0:15:14 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6483480 2021-11-03 23:49:39 2021-11-04 08:32:31 2021-11-04 09:02:51 0:30:20 0:17:37 0:12:43 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6483481 2021-11-03 23:49:40 2021-11-04 08:34:22 2021-11-04 08:53:40 0:19:18 0:10:37 0:08:41 smithi master centos 8.3 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6483482 2021-11-03 23:49:41 2021-11-04 08:34:22 2021-11-04 08:57:58 0:23:36 0:13:25 0:10:11 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 6483483 2021-11-03 23:49:42 2021-11-04 08:35:02 2021-11-04 08:57:24 0:22:22 0:08:53 0:13:29 smithi master centos 8.3 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
pass 6483484 2021-11-03 23:49:43 2021-11-04 08:35:43 2021-11-04 09:11:17 0:35:34 0:21:30 0:14:04 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 6483485 2021-11-03 23:49:44 2021-11-04 08:37:03 2021-11-04 09:02:51 0:25:48 0:15:18 0:10:30 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6483486 2021-11-03 23:49:45 2021-11-04 08:37:24 2021-11-04 08:59:16 0:21:52 0:10:28 0:11:24 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/workunits} 2
pass 6483487 2021-11-03 23:49:46 2021-11-04 08:38:04 2021-11-04 09:11:51 0:33:47 0:22:19 0:11:28 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8.stream}} 2
pass 6483488 2021-11-03 23:49:47 2021-11-04 08:38:35 2021-11-04 09:20:43 0:42:08 0:30:48 0:11:20 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6483489 2021-11-03 23:49:48 2021-11-04 08:39:15 2021-11-04 09:29:21 0:50:06 0:42:23 0:07:43 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 6483490 2021-11-03 23:49:49 2021-11-04 08:39:56 2021-11-04 09:04:11 0:24:15 0:14:44 0:09:31 smithi master ubuntu 20.04 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483491 2021-11-03 23:49:50 2021-11-04 08:40:26 2021-11-04 09:02:36 0:22:10 0:11:06 0:11:04 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6483492 2021-11-03 23:49:51 2021-11-04 08:40:26 2021-11-04 09:34:30 0:54:04 0:46:50 0:07:14 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 6483493 2021-11-03 23:49:52 2021-11-04 08:41:07 2021-11-04 09:16:59 0:35:52 0:25:05 0:10:47 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6483494 2021-11-03 23:49:53 2021-11-04 08:41:47 2021-11-04 09:20:15 0:38:28 0:27:18 0:11:10 smithi master centos 8.stream rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6483495 2021-11-03 23:49:54 2021-11-04 08:42:48 2021-11-04 09:29:03 0:46:15 0:32:59 0:13:16 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6483496 2021-11-03 23:49:55 2021-11-04 08:43:18 2021-11-04 09:23:01 0:39:43 0:28:51 0:10:52 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483497 2021-11-03 23:49:56 2021-11-04 08:43:48 2021-11-04 09:21:11 0:37:23 0:27:57 0:09:26 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 6483498 2021-11-03 23:49:57 2021-11-04 08:43:59 2021-11-04 15:27:50 6:43:51 6:33:45 0:10:06 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi042 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6483499 2021-11-03 23:49:58 2021-11-04 08:44:09 2021-11-04 09:07:30 0:23:21 0:13:08 0:10:13 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6483500 2021-11-03 23:49:59 2021-11-04 08:44:20 2021-11-04 09:12:55 0:28:35 0:18:47 0:09:48 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483501 2021-11-03 23:50:00 2021-11-04 08:45:10 2021-11-04 11:32:32 2:47:22 2:37:22 0:10:00 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/scrub} 1
pass 6483502 2021-11-03 23:50:01 2021-11-04 08:45:10 2021-11-04 10:16:57 1:31:47 1:19:25 0:12:22 smithi master centos 8.3 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
pass 6483503 2021-11-03 23:50:02 2021-11-04 08:47:41 2021-11-04 09:56:12 1:08:31 0:56:59 0:11:32 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 6483504 2021-11-03 23:50:03 2021-11-04 08:48:41 2021-11-04 09:26:24 0:37:43 0:27:26 0:10:17 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6483505 2021-11-03 23:50:04 2021-11-04 08:49:12 2021-11-04 09:17:34 0:28:22 0:16:25 0:11:57 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/repair_test} 2
pass 6483506 2021-11-03 23:50:05 2021-11-04 08:50:22 2021-11-04 09:17:45 0:27:23 0:14:09 0:13:14 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6483507 2021-11-03 23:50:06 2021-11-04 08:51:33 2021-11-04 09:17:52 0:26:19 0:13:41 0:12:38 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483508 2021-11-03 23:50:07 2021-11-04 08:52:23 2021-11-04 09:16:15 0:23:52 0:16:55 0:06:57 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6483509 2021-11-03 23:50:08 2021-11-04 08:53:04 2021-11-04 09:33:02 0:39:58 0:29:55 0:10:03 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} 1
dead 6483510 2021-11-03 23:50:09 2021-11-04 08:53:04 2021-11-04 21:03:52 12:10:48 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6483511 2021-11-03 23:50:10 2021-11-04 08:53:54 2021-11-04 09:13:10 0:19:16 0:10:33 0:08:43 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483512 2021-11-03 23:50:11 2021-11-04 08:53:55 2021-11-04 09:38:44 0:44:49 0:33:31 0:11:18 smithi master centos 8.3 rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 2
pass 6483513 2021-11-03 23:50:12 2021-11-04 08:55:15 2021-11-04 09:22:52 0:27:37 0:14:37 0:13:00 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6483514 2021-11-03 23:50:13 2021-11-04 08:57:26 2021-11-04 09:17:11 0:19:45 0:10:06 0:09:39 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 6483515 2021-11-03 23:50:14 2021-11-04 08:57:26 2021-11-04 09:32:32 0:35:06 0:23:26 0:11:40 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6483516 2021-11-03 23:50:15 2021-11-04 08:58:06 2021-11-04 09:24:01 0:25:55 0:17:47 0:08:08 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
fail 6483517 2021-11-03 23:50:16 2021-11-04 08:58:37 2021-11-04 09:21:02 0:22:25 0:12:01 0:10:24 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
Failure Reason:

"2021-11-04T09:17:30.719719+0000 osd.2 (osd.2) 3 : cluster [WRN] slow request osd_op(client.4201.0:30 3.cf 3:f3a2504b:::benchmark_data_smithi142_20966_object970:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) initiated 2021-11-04T09:17:00.296875+0000 currently delayed" in cluster log

pass 6483518 2021-11-03 23:50:17 2021-11-04 08:59:17 2021-11-04 09:38:30 0:39:13 0:30:34 0:08:39 smithi master centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6483519 2021-11-03 23:50:18 2021-11-04 08:59:17 2021-11-04 09:45:23 0:46:06 0:36:00 0:10:06 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 6483520 2021-11-03 23:50:19 2021-11-04 08:59:58 2021-11-04 09:31:30 0:31:32 0:20:50 0:10:42 smithi master centos 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 6483521 2021-11-03 23:50:20 2021-11-04 09:00:18 2021-11-04 09:38:36 0:38:18 0:22:31 0:15:47 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
pass 6483522 2021-11-03 23:50:21 2021-11-04 09:02:39 2021-11-04 09:41:25 0:38:46 0:25:58 0:12:48 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 6483523 2021-11-03 23:50:22 2021-11-04 09:02:59 2021-11-04 09:32:40 0:29:41 0:23:21 0:06:20 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/crash} 2
pass 6483524 2021-11-03 23:50:23 2021-11-04 09:35:00 1270 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6483525 2021-11-03 23:50:24 2021-11-04 09:07:31 2021-11-04 09:37:34 0:30:03 0:14:29 0:15:34 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 6483526 2021-11-03 23:50:25 2021-11-04 09:11:21 2021-11-04 10:00:35 0:49:14 0:43:19 0:05:55 smithi master rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6483527 2021-11-03 23:50:26 2021-11-04 09:11:22 2021-11-04 09:38:12 0:26:50 0:14:34 0:12:16 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6483528 2021-11-03 23:50:27 2021-11-04 09:11:42 2021-11-04 09:55:05 0:43:23 0:36:55 0:06:28 smithi master rhel 8.4 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6483529 2021-11-03 23:50:28 2021-11-04 09:11:52 2021-11-04 09:39:08 0:27:16 0:21:45 0:05:31 smithi master rhel 8.4 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6483530 2021-11-03 23:50:29 2021-11-04 09:11:53 2021-11-04 09:34:38 0:22:45 0:14:36 0:08:09 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} 2
pass 6483531 2021-11-03 23:50:30 2021-11-04 09:13:13 2021-11-04 13:09:55 3:56:42 3:46:33 0:10:09 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} 2
pass 6483532 2021-11-03 23:50:31 2021-11-04 09:17:15 2021-11-04 09:43:47 0:26:32 0:14:40 0:11:52 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6483533 2021-11-03 23:50:32 2021-11-04 09:17:35 2021-11-04 09:39:52 0:22:17 0:10:12 0:12:05 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6483534 2021-11-03 23:50:33 2021-11-04 09:17:55 2021-11-04 10:03:22 0:45:27 0:38:56 0:06:31 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483535 2021-11-03 23:50:34 2021-11-04 09:17:56 2021-11-04 09:46:15 0:28:19 0:16:35 0:11:44 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} 2
pass 6483536 2021-11-03 23:50:35 2021-11-04 09:18:36 2021-11-04 09:48:49 0:30:13 0:16:13 0:14:00 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/host rook/1.7.0} 3
pass 6483537 2021-11-03 23:50:36 2021-11-04 09:20:47 2021-11-04 09:43:41 0:22:54 0:14:52 0:08:02 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} 1
pass 6483538 2021-11-03 23:50:37 2021-11-04 09:20:47 2021-11-04 09:49:32 0:28:45 0:16:23 0:12:22 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6483539 2021-11-03 23:50:38 2021-11-04 09:21:17 2021-11-04 09:53:30 0:32:13 0:20:30 0:11:43 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} 2
pass 6483540 2021-11-03 23:50:39 2021-11-04 09:22:18 2021-11-04 09:50:44 0:28:26 0:16:26 0:12:00 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} 2
pass 6483541 2021-11-03 23:50:39 2021-11-04 09:22:58 2021-11-04 10:08:22 0:45:24 0:34:05 0:11:19 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 6483542 2021-11-03 23:50:40 2021-11-04 09:23:09 2021-11-04 09:41:24 0:18:15 0:09:08 0:09:07 smithi master centos 8.3 rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6483543 2021-11-03 23:50:41 2021-11-04 09:24:09 2021-11-04 10:00:48 0:36:39 0:23:28 0:13:11 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 6483544 2021-11-03 23:50:42 2021-11-04 09:29:10 2021-11-04 10:04:23 0:35:13 0:25:14 0:09:59 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6483545 2021-11-03 23:50:43 2021-11-04 09:29:10 2021-11-04 09:50:57 0:21:47 0:09:12 0:12:35 smithi master centos 8.3 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 6483546 2021-11-03 23:50:44 2021-11-04 09:29:31 2021-11-04 09:52:27 0:22:56 0:13:40 0:09:16 smithi master centos 8.3 rados/rest/{mgr-restful supported-random-distro$/{centos_8}} 1
pass 6483547 2021-11-03 23:50:45 2021-11-04 10:00:39 1150 smithi master centos 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6483548 2021-11-03 23:50:46 2021-11-04 09:31:32 2021-11-04 09:53:13 0:21:41 0:11:55 0:09:46 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} 1
pass 6483549 2021-11-03 23:50:47 2021-11-04 09:31:32 2021-11-04 11:02:29 1:30:57 1:19:48 0:11:09 smithi master centos 8.3 rados/upgrade/parallel/{0-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6483550 2021-11-03 23:50:48 2021-11-04 09:32:42 2021-11-04 10:06:10 0:33:28 0:25:04 0:08:24 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6483551 2021-11-03 23:50:49 2021-11-04 09:32:43 2021-11-04 10:14:46 0:42:03 0:29:44 0:12:19 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6483552 2021-11-03 23:50:50 2021-11-04 09:33:03 2021-11-04 09:57:13 0:24:10 0:10:12 0:13:58 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6483553 2021-11-03 23:50:51 2021-11-04 09:34:34 2021-11-04 09:58:10 0:23:36 0:12:50 0:10:46 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6483554 2021-11-03 23:50:52 2021-11-04 09:34:44 2021-11-04 10:14:28 0:39:44 0:29:02 0:10:42 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6483555 2021-11-03 23:50:53 2021-11-04 09:35:04 2021-11-04 10:01:47 0:26:43 0:12:40 0:14:03 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6483556 2021-11-03 23:50:54 2021-11-04 09:37:35 2021-11-04 09:55:16 0:17:41 0:06:59 0:10:42 smithi master ubuntu 20.04 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483557 2021-11-03 23:50:55 2021-11-04 09:37:35 2021-11-04 10:23:39 0:46:04 0:35:55 0:10:09 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6483558 2021-11-03 23:50:56 2021-11-04 09:38:16 2021-11-04 10:15:57 0:37:41 0:27:04 0:10:37 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6483559 2021-11-03 23:50:57 2021-11-04 09:38:46 2021-11-04 09:56:43 0:17:57 0:08:26 0:09:31 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483560 2021-11-03 23:50:58 2021-11-04 09:38:46 2021-11-04 10:23:49 0:45:03 0:35:46 0:09:17 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
dead 6483561 2021-11-03 23:50:59 2021-11-04 09:38:47 2021-11-04 21:49:48 12:11:01 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6483562 2021-11-03 23:51:00 2021-11-04 09:39:17 2021-11-04 09:59:11 0:19:54 0:08:39 0:11:15 smithi master centos 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 2
pass 6483563 2021-11-03 23:51:01 2021-11-04 09:39:58 2021-11-04 10:08:52 0:28:54 0:20:08 0:08:46 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} 2
pass 6483564 2021-11-03 23:51:02 2021-11-04 09:41:28 2021-11-04 10:06:39 0:25:11 0:15:41 0:09:30 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6483565 2021-11-03 23:51:03 2021-11-04 09:41:28 2021-11-04 10:15:01 0:33:33 0:23:01 0:10:32 smithi master centos 8.stream rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 1
fail 6483566 2021-11-03 23:51:04 2021-11-04 09:43:49 2021-11-04 10:20:57 0:37:08 0:27:24 0:09:44 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Found coredumps on ubuntu@smithi071.front.sepia.ceph.com

pass 6483567 2021-11-03 23:51:05 2021-11-04 09:43:49 2021-11-04 10:16:41 0:32:52 0:23:56 0:08:56 smithi master rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6483568 2021-11-03 23:51:06 2021-11-04 09:45:30 2021-11-04 10:19:59 0:34:29 0:25:47 0:08:42 smithi master rhel 8.4 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 6483569 2021-11-03 23:51:07 2021-11-04 09:46:20 2021-11-04 10:22:00 0:35:40 0:22:53 0:12:47 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} 2
pass 6483570 2021-11-03 23:51:08 2021-11-04 09:48:51 2021-11-04 10:10:02 0:21:11 0:11:35 0:09:36 smithi master centos 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 6483571 2021-11-03 23:51:09 2021-11-04 09:48:51 2021-11-04 10:15:12 0:26:21 0:19:09 0:07:12 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6483572 2021-11-03 23:51:10 2021-11-04 09:49:32 2021-11-04 10:26:56 0:37:24 0:31:22 0:06:02 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6483573 2021-11-03 23:51:11 2021-11-04 09:49:32 2021-11-04 10:07:23 0:17:51 0:07:41 0:10:10 smithi master ubuntu 20.04 rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483574 2021-11-03 23:51:12 2021-11-04 09:49:42 2021-11-04 10:07:27 0:17:45 0:08:53 0:08:52 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6483575 2021-11-03 23:51:13 2021-11-04 09:49:43 2021-11-04 10:32:16 0:42:33 0:30:31 0:12:02 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6483576 2021-11-03 23:51:15 2021-11-04 09:51:03 2021-11-04 10:34:16 0:43:13 0:30:14 0:12:59 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6483577 2021-11-03 23:51:16 2021-11-04 09:53:14 2021-11-04 10:42:52 0:49:38 0:38:27 0:11:11 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

saw valgrind issues

pass 6483578 2021-11-03 23:51:16 2021-11-04 09:53:34 2021-11-04 10:10:25 0:16:51 0:06:53 0:09:58 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 6483579 2021-11-03 23:51:18 2021-11-04 09:55:15 2021-11-04 10:12:56 0:17:41 0:07:40 0:10:01 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483580 2021-11-03 23:51:18 2021-11-04 09:55:15 2021-11-04 10:18:36 0:23:21 0:14:40 0:08:41 smithi master centos 8.stream rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8.stream}} 1
fail 6483581 2021-11-03 23:51:19 2021-11-04 09:55:25 2021-11-04 10:15:43 0:20:18 0:09:11 0:11:07 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Command failed on smithi107 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1fc5c50f942497cfdd5964d2d4cdf839a489d78 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9528f1fa-3d57-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6483582 2021-11-03 23:51:20 2021-11-04 09:56:16 2021-11-04 10:34:48 0:38:32 0:25:12 0:13:20 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} 2
pass 6483583 2021-11-03 23:51:21 2021-11-04 09:57:16 2021-11-04 10:18:28 0:21:12 0:09:33 0:11:39 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} 2
pass 6483584 2021-11-03 23:51:22 2021-11-04 09:58:17 2021-11-04 10:32:14 0:33:57 0:23:28 0:10:29 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483585 2021-11-03 23:51:23 2021-11-04 10:00:47 2021-11-04 10:24:09 0:23:22 0:12:41 0:10:41 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6483586 2021-11-03 23:51:24 2021-11-04 10:00:58 2021-11-04 10:22:15 0:21:17 0:08:39 0:12:38 smithi master ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483587 2021-11-03 23:51:25 2021-11-04 10:00:58 2021-11-04 10:25:59 0:25:01 0:17:34 0:07:27 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6483588 2021-11-03 23:51:26 2021-11-04 10:01:48 2021-11-04 10:20:59 0:19:11 0:10:19 0:08:52 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483589 2021-11-03 23:51:27 2021-11-04 10:01:49 2021-11-04 10:40:18 0:38:29 0:31:12 0:07:17 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} 1
pass 6483590 2021-11-03 23:51:28 2021-11-04 10:03:29 2021-11-04 11:19:36 1:16:07 1:05:47 0:10:20 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 6483591 2021-11-03 23:51:29 2021-11-04 10:04:30 2021-11-04 10:41:16 0:36:46 0:24:03 0:12:43 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6483592 2021-11-03 23:51:30 2021-11-04 10:06:10 2021-11-04 10:43:53 0:37:43 0:28:01 0:09:42 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} 2
pass 6483593 2021-11-03 23:51:31 2021-11-04 10:06:41 2021-11-04 10:43:25 0:36:44 0:25:29 0:11:15 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 6483594 2021-11-03 23:51:32 2021-11-04 10:07:31 2021-11-04 10:29:42 0:22:11 0:12:23 0:09:48 smithi master centos 8.stream rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream}} 1
pass 6483595 2021-11-03 23:51:33 2021-11-04 10:08:31 2021-11-04 10:34:01 0:25:30 0:18:59 0:06:31 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 6483596 2021-11-03 23:51:34 2021-11-04 10:08:32 2021-11-04 11:33:30 1:24:58 1:12:25 0:12:33 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 6483597 2021-11-03 23:51:35 2021-11-04 10:10:02 2021-11-04 10:28:13 0:18:11 0:07:46 0:10:25 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483598 2021-11-03 23:51:36 2021-11-04 10:10:33 2021-11-04 10:42:29 0:31:56 0:22:21 0:09:35 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_nfs} 1
pass 6483599 2021-11-03 23:51:37 2021-11-04 10:11:13 2021-11-04 10:36:45 0:25:32 0:12:21 0:13:11 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 6483600 2021-11-03 23:51:38 2021-11-04 10:13:04 2021-11-04 10:41:00 0:27:56 0:18:53 0:09:03 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6483601 2021-11-03 23:51:39 2021-11-04 10:14:34 2021-11-04 10:47:09 0:32:35 0:22:10 0:10:25 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6483602 2021-11-03 23:51:40 2021-11-04 10:14:55 2021-11-04 10:40:16 0:25:21 0:18:36 0:06:45 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6483603 2021-11-03 23:51:41 2021-11-04 10:15:05 2021-11-04 10:42:41 0:27:36 0:20:24 0:07:12 smithi master rhel 8.4 rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6483604 2021-11-03 23:51:42 2021-11-04 10:15:15 2021-11-04 10:37:04 0:21:49 0:11:20 0:10:29 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} 2
pass 6483605 2021-11-03 23:51:43 2021-11-04 10:15:46 2021-11-04 10:58:04 0:42:18 0:29:06 0:13:12 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 6483606 2021-11-03 23:51:44 2021-11-04 10:16:06 2021-11-04 11:00:27 0:44:21 0:35:46 0:08:35 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
dead 6483607 2021-11-03 23:51:45 2021-11-04 10:16:46 2021-11-04 22:27:25 12:10:39 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6483608 2021-11-03 23:51:46 2021-11-04 10:17:07 2021-11-04 10:35:52 0:18:45 0:08:56 0:09:49 smithi master centos 8.3 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6483609 2021-11-03 23:51:47 2021-11-04 10:18:37 2021-11-04 10:41:52 0:23:15 0:16:53 0:06:22 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6483610 2021-11-03 23:51:48 2021-11-04 10:18:38 2021-11-04 10:59:47 0:41:09 0:31:44 0:09:25 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6483611 2021-11-03 23:51:49 2021-11-04 10:20:08 2021-11-04 10:46:27 0:26:19 0:13:16 0:13:03 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6483612 2021-11-03 23:51:50 2021-11-04 10:21:09 2021-11-04 10:57:21 0:36:12 0:25:34 0:10:38 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483613 2021-11-03 23:51:51 2021-11-04 10:22:09 2021-11-04 10:51:52 0:29:43 0:16:55 0:12:48 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} 2
pass 6483614 2021-11-03 23:51:52 2021-11-04 10:23:40 2021-11-04 11:04:52 0:41:12 0:29:41 0:11:31 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
pass 6483615 2021-11-03 23:51:53 2021-11-04 10:23:50 2021-11-04 11:26:49 1:02:59 0:51:28 0:11:31 smithi master ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483616 2021-11-03 23:51:54 2021-11-04 10:23:50 2021-11-04 10:42:07 0:18:17 0:07:29 0:10:48 smithi master ubuntu 20.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 6483617 2021-11-03 23:51:55 2021-11-04 10:24:11 2021-11-04 10:56:12 0:32:01 0:22:52 0:09:09 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-mixed} 2
pass 6483618 2021-11-03 23:51:56 2021-11-04 10:26:01 2021-11-04 11:08:33 0:42:32 0:32:04 0:10:28 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6483619 2021-11-03 23:51:57 2021-11-04 10:27:02 2021-11-04 10:57:50 0:30:48 0:13:27 0:17:21 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483620 2021-11-03 23:51:58 2021-11-04 10:32:23 2021-11-04 11:17:51 0:45:28 0:38:28 0:07:00 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} 2
pass 6483621 2021-11-03 23:51:59 2021-11-04 10:32:23 2021-11-04 10:51:35 0:19:12 0:09:30 0:09:42 smithi master centos 8.3 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6483622 2021-11-03 23:52:00 2021-11-04 10:32:23 2021-11-04 11:25:38 0:53:15 0:46:30 0:06:45 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6483623 2021-11-03 23:52:01 2021-11-04 10:32:24 2021-11-04 11:01:31 0:29:07 0:16:46 0:12:21 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} tasks/rados_cls_all} 2
fail 6483624 2021-11-03 23:52:02 2021-11-04 10:34:04 2021-11-04 10:53:21 0:19:17 0:08:40 0:10:37 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi058 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c32288a0-3d5c-11ec-8c28-001a4aab830c -- ceph mon dump -f json'

pass 6483625 2021-11-03 23:52:03 2021-11-04 10:34:25 2021-11-04 11:53:40 1:19:15 1:12:15 0:07:00 smithi master rhel 8.4 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6483626 2021-11-03 23:52:04 2021-11-04 10:34:25 2021-11-04 11:15:37 0:41:12 0:29:28 0:11:44 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483627 2021-11-03 23:52:05 2021-11-04 10:34:55 2021-11-04 11:05:57 0:31:02 0:18:41 0:12:21 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/on distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6483628 2021-11-03 23:52:06 2021-11-04 10:35:56 2021-11-04 10:57:48 0:21:52 0:12:01 0:09:51 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6483629 2021-11-03 23:52:07 2021-11-04 10:35:56 2021-11-04 11:01:58 0:26:02 0:15:43 0:10:19 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/dedup-io-snaps} 2
pass 6483630 2021-11-03 23:52:08 2021-11-04 10:36:47 2021-11-04 10:58:33 0:21:46 0:13:05 0:08:41 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 6483631 2021-11-03 23:52:09 2021-11-04 10:37:07 2021-11-04 11:04:30 0:27:23 0:20:42 0:06:41 smithi master rhel 8.4 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6483632 2021-11-03 23:52:10 2021-11-04 10:37:07 2021-11-04 12:25:35 1:48:28 1:38:03 0:10:25 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} 1
pass 6483633 2021-11-03 23:52:11 2021-11-04 10:40:18 2021-11-04 11:05:40 0:25:22 0:15:41 0:09:41 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6483634 2021-11-03 23:52:12 2021-11-04 10:40:28 2021-11-04 10:58:02 0:17:34 0:08:20 0:09:14 smithi master centos 8.3 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6483635 2021-11-03 23:52:13 2021-11-04 10:41:09 2021-11-04 11:21:07 0:39:58 0:29:12 0:10:46 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
pass 6483636 2021-11-03 23:52:15 2021-11-04 10:41:09 2021-11-04 11:06:45 0:25:36 0:17:44 0:07:52 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 6483637 2021-11-03 23:52:15 2021-11-04 10:41:19 2021-11-04 11:09:27 0:28:08 0:17:25 0:10:43 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8.stream} tasks/module_selftest} 2
Failure Reason:

Test failure: test_module_commands (tasks.mgr.test_module_selftest.TestModuleSelftest)

pass 6483638 2021-11-03 23:52:16 2021-11-04 10:42:00 2021-11-04 11:09:47 0:27:47 0:16:33 0:11:14 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6483639 2021-11-03 23:52:18 2021-11-04 10:42:20 2021-11-04 11:16:27 0:34:07 0:25:54 0:08:13 smithi master rhel 8.4 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
fail 6483640 2021-11-03 23:52:19 2021-11-04 10:43:00 2021-11-04 11:12:43 0:29:43 0:18:12 0:11:31 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6483641 2021-11-03 23:52:20 2021-11-04 10:43:31 2021-11-04 11:02:19 0:18:48 0:10:46 0:08:02 smithi master centos 8.stream rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6483642 2021-11-03 23:52:20 2021-11-04 10:43:31 2021-11-04 11:26:09 0:42:38 0:30:19 0:12:19 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6483643 2021-11-03 23:52:21 2021-11-04 10:44:02 2021-11-04 11:25:44 0:41:42 0:27:33 0:14:09 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6483644 2021-11-03 23:52:22 2021-11-04 10:46:32 2021-11-04 12:09:33 1:23:01 1:16:53 0:06:08 smithi master rhel 8.4 rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6483645 2021-11-03 23:52:23 2021-11-04 10:46:32 2021-11-04 11:36:56 0:50:24 0:36:21 0:14:03 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6483646 2021-11-03 23:52:24 2021-11-04 10:51:43 2021-11-04 11:35:18 0:43:35 0:35:44 0:07:51 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6483647 2021-11-03 23:52:25 2021-11-04 10:51:54 2021-11-04 13:24:21 2:32:27 2:22:57 0:09:30 smithi master centos 8.stream rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8.stream}} 1
pass 6483648 2021-11-03 23:52:26 2021-11-04 10:53:24 2021-11-04 11:36:27 0:43:03 0:31:47 0:11:16 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6483649 2021-11-03 23:52:27 2021-11-04 10:56:15 2021-11-04 12:02:41 1:06:26 0:52:35 0:13:51 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6483650 2021-11-03 23:52:28 2021-11-04 10:57:26 2021-11-04 11:37:10 0:39:44 0:28:40 0:11:04 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483651 2021-11-03 23:52:29 2021-11-04 10:57:56 2021-11-04 11:18:46 0:20:50 0:11:45 0:09:05 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6483652 2021-11-03 23:52:30 2021-11-04 10:57:56 2021-11-04 11:21:24 0:23:28 0:16:54 0:06:34 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6483653 2021-11-03 23:52:31 2021-11-04 10:57:56 2021-11-04 11:23:19 0:25:23 0:15:51 0:09:32 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} tasks/rados_python} 2
pass 6483654 2021-11-03 23:52:32 2021-11-04 10:58:07 2021-11-04 12:13:55 1:15:48 1:04:37 0:11:11 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
pass 6483655 2021-11-03 23:52:33 2021-11-04 10:58:37 2021-11-04 11:36:25 0:37:48 0:22:13 0:15:35 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 6483656 2021-11-03 23:52:34 2021-11-04 11:00:38 2021-11-04 11:39:06 0:38:28 0:26:21 0:12:07 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} 2
pass 6483657 2021-11-03 23:52:35 2021-11-04 11:01:38 2021-11-04 11:22:19 0:20:41 0:10:26 0:10:15 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
fail 6483658 2021-11-03 23:52:36 2021-11-04 11:01:39 2021-11-08 19:56:16 4 days, 8:54:37 4 days, 8:40:43 0:13:54 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}}
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi181 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1fc5c50f942497cfdd5964d2d4cdf839a489d78 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 6483659 2021-11-03 23:52:37 2021-11-04 11:01:59 2021-11-04 12:38:01 1:36:02 1:26:29 0:09:33 smithi master centos 8.stream rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 1
pass 6483660 2021-11-03 23:52:38 2021-11-04 11:02:29 2021-11-04 11:34:23 0:31:54 0:23:15 0:08:39 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483661 2021-11-03 23:52:39 2021-11-04 11:05:00 2021-11-04 11:55:39 0:50:39 0:38:22 0:12:17 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 6483662 2021-11-03 23:52:40 2021-11-04 11:05:40 2021-11-04 11:39:16 0:33:36 0:25:44 0:07:52 smithi master rhel 8.4 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
pass 6483663 2021-11-03 23:52:41 2021-11-04 11:06:01 2021-11-04 11:39:17 0:33:16 0:20:50 0:12:26 smithi master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6483664 2021-11-03 23:52:42 2021-11-04 11:06:51 2021-11-04 11:34:08 0:27:17 0:15:03 0:12:14 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6483665 2021-11-03 23:52:43 2021-11-04 11:08:42 2021-11-04 11:32:09 0:23:27 0:14:38 0:08:49 smithi master centos 8.3 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6483666 2021-11-03 23:52:44 2021-11-04 11:08:42 2021-11-04 11:32:31 0:23:49 0:14:06 0:09:43 smithi master centos 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 6483667 2021-11-03 23:52:45 2021-11-04 11:09:33 2021-11-04 11:28:13 0:18:40 0:10:14 0:08:26 smithi master centos 8.stream rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
pass 6483668 2021-11-03 23:52:46 2021-11-04 11:09:33 2021-11-04 12:04:54 0:55:21 0:44:21 0:11:00 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6483669 2021-11-03 23:52:47 2021-11-04 11:09:53 2021-11-04 11:31:46 0:21:53 0:09:51 0:12:02 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_adoption} 1
pass 6483670 2021-11-03 23:52:48 2021-11-04 11:12:44 2021-11-04 11:37:56 0:25:12 0:13:44 0:11:28 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6483671 2021-11-03 23:52:49 2021-11-04 11:14:14 2021-11-04 11:44:29 0:30:15 0:16:29 0:13:46 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6483672 2021-11-03 23:52:50 2021-11-04 11:15:45 2021-11-04 11:43:33 0:27:48 0:17:14 0:10:34 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 6483673 2021-11-03 23:52:51 2021-11-04 11:16:35 2021-11-04 11:57:25 0:40:50 0:32:31 0:08:19 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6483674 2021-11-03 23:52:52 2021-11-04 11:16:36 2021-11-04 11:41:19 0:24:43 0:17:15 0:07:28 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6483675 2021-11-03 23:52:53 2021-11-04 11:17:56 2021-11-04 11:53:52 0:35:56 0:23:39 0:12:17 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8.stream} tasks/progress} 2
pass 6483676 2021-11-03 23:52:54 2021-11-04 11:18:47 2021-11-04 11:48:48 0:30:01 0:23:14 0:06:47 smithi master rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6483677 2021-11-03 23:52:55 2021-11-04 11:19:37 2021-11-04 11:51:04 0:31:27 0:18:03 0:13:24 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6483678 2021-11-03 23:52:56 2021-11-04 11:21:08 2021-11-04 11:52:10 0:31:02 0:09:00 0:22:02 smithi master centos 8.3 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 6483679 2021-11-03 23:52:57 2021-11-04 11:22:28 2021-11-04 12:40:44 1:18:16 1:11:12 0:07:04 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} 2
pass 6483680 2021-11-03 23:52:58 2021-11-04 11:23:29 2021-11-04 11:56:51 0:33:22 0:14:29 0:18:53 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6483681 2021-11-03 23:52:59 2021-11-04 11:25:39 2021-11-04 11:47:45 0:22:06 0:11:51 0:10:15 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6483682 2021-11-03 23:53:00 2021-11-04 11:25:49 2021-11-04 11:55:36 0:29:47 0:15:40 0:14:07 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 6483683 2021-11-03 23:53:01 2021-11-04 11:26:10 2021-11-04 11:49:32 0:23:22 0:14:48 0:08:34 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_cephadm} 1
pass 6483684 2021-11-03 23:53:02 2021-11-04 11:26:10 2021-11-04 12:02:04 0:35:54 0:22:27 0:13:27 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6483685 2021-11-03 23:53:03 2021-11-04 11:28:21 2021-11-04 14:19:29 2:51:08 2:37:46 0:13:22 smithi master centos 8.3 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} 1
pass 6483686 2021-11-03 23:53:04 2021-11-04 11:31:51 2021-11-04 11:57:49 0:25:58 0:14:46 0:11:12 smithi master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 6483687 2021-11-03 23:53:05 2021-11-04 11:32:12 2021-11-04 11:53:58 0:21:46 0:12:23 0:09:23 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6483688 2021-11-03 23:53:06 2021-11-04 11:32:42 2021-11-04 12:07:58 0:35:16 0:21:52 0:13:24 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
fail 6483689 2021-11-03 23:53:07 2021-11-04 11:33:33 2021-11-04 12:01:37 0:28:04 0:17:03 0:11:01 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

No module named 'tasks.thrashosds'

pass 6483690 2021-11-03 23:53:08 2021-11-04 11:34:13 2021-11-04 12:00:05 0:25:52 0:13:22 0:12:30 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6483691 2021-11-03 23:53:09 2021-11-04 11:34:34 2021-11-04 12:19:45 0:45:11 0:39:05 0:06:06 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6483692 2021-11-03 23:53:10 2021-11-04 11:34:34 2021-11-04 12:02:36 0:28:02 0:16:50 0:11:12 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 6483693 2021-11-03 23:53:11 2021-11-04 11:35:24 2021-11-04 12:05:22 0:29:58 0:17:24 0:12:34 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} 2
fail 6483694 2021-11-03 23:53:12 2021-11-04 11:36:35 2021-11-04 12:08:32 0:31:57 0:19:27 0:12:30 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

No module named 'tasks.workunit'

pass 6483695 2021-11-03 23:53:13 2021-11-04 11:36:35 2021-11-04 12:00:28 0:23:53 0:11:54 0:11:59 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6483696 2021-11-03 23:53:14 2021-11-04 11:37:16 2021-11-04 12:06:29 0:29:13 0:19:07 0:10:06 smithi master centos 8.3 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} 1
fail 6483697 2021-11-03 23:53:15 2021-11-04 11:37:16 2021-11-04 12:02:58 0:25:42 0:18:48 0:06:54 smithi master rhel 8.4 rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

No module named 'tasks.ceph'

pass 6483698 2021-11-03 23:53:16 2021-11-04 11:37:16 2021-11-04 12:15:09 0:37:53 0:28:21 0:09:32 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6483699 2021-11-03 23:53:16 2021-11-04 11:37:57 2021-11-04 12:18:35 0:40:38 0:28:37 0:12:01 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
pass 6483700 2021-11-03 23:53:17 2021-11-04 11:39:07 2021-11-04 12:04:44 0:25:37 0:14:08 0:11:29 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6483701 2021-11-03 23:53:18 2021-11-04 11:39:17 2021-11-04 12:19:15 0:39:58 0:29:40 0:10:18 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 6483702 2021-11-03 23:53:19 2021-11-04 11:39:18 2021-11-04 12:02:51 0:23:33 0:10:46 0:12:47 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

No module named 'tasks.thrashosds'

fail 6483703 2021-11-03 23:53:20 2021-11-04 11:41:28 2021-11-04 12:04:05 0:22:37 0:06:58 0:15:39 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi117 with status 1: 'sudo yum -y install cephfs-java'

fail 6483704 2021-11-03 23:53:21 2021-11-04 11:44:39 2021-11-04 12:03:04 0:18:25 0:06:21 0:12:04 smithi master centos 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi087 with status 1: 'sudo yum -y install cephfs-java'

fail 6483705 2021-11-03 23:53:22 2021-11-04 11:47:50 2021-11-04 12:02:31 0:14:41 0:03:26 0:11:15 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Command failed on smithi085 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-8755-ga1fc5c50-1focal ceph-mds=17.0.0-8755-ga1fc5c50-1focal ceph-common=17.0.0-8755-ga1fc5c50-1focal ceph-fuse=17.0.0-8755-ga1fc5c50-1focal ceph-test=17.0.0-8755-ga1fc5c50-1focal radosgw=17.0.0-8755-ga1fc5c50-1focal python-ceph=17.0.0-8755-ga1fc5c50-1focal libcephfs1=17.0.0-8755-ga1fc5c50-1focal libcephfs-java=17.0.0-8755-ga1fc5c50-1focal libcephfs-jni=17.0.0-8755-ga1fc5c50-1focal librados2=17.0.0-8755-ga1fc5c50-1focal librbd1=17.0.0-8755-ga1fc5c50-1focal rbd-fuse=17.0.0-8755-ga1fc5c50-1focal'

fail 6483706 2021-11-03 23:53:23 2021-11-04 11:48:50 2021-11-04 12:10:37 0:21:47 0:06:34 0:15:13 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi071 with status 1: 'sudo yum -y install cephfs-java'

fail 6483707 2021-11-03 23:53:24 2021-11-04 11:51:11 2021-11-04 12:07:52 0:16:41 0:05:33 0:11:08 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

No module named 'tasks.nvme_loop'

fail 6483708 2021-11-03 23:53:25 2021-11-04 11:52:11 2021-11-04 12:05:52 0:13:41 0:03:31 0:10:10 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
Failure Reason:

Command failed on smithi093 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-8755-ga1fc5c50-1focal ceph-mds=17.0.0-8755-ga1fc5c50-1focal ceph-common=17.0.0-8755-ga1fc5c50-1focal ceph-fuse=17.0.0-8755-ga1fc5c50-1focal ceph-test=17.0.0-8755-ga1fc5c50-1focal radosgw=17.0.0-8755-ga1fc5c50-1focal python-ceph=17.0.0-8755-ga1fc5c50-1focal libcephfs1=17.0.0-8755-ga1fc5c50-1focal libcephfs-java=17.0.0-8755-ga1fc5c50-1focal libcephfs-jni=17.0.0-8755-ga1fc5c50-1focal librados2=17.0.0-8755-ga1fc5c50-1focal librbd1=17.0.0-8755-ga1fc5c50-1focal rbd-fuse=17.0.0-8755-ga1fc5c50-1focal'