Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6521829 2021-11-23 11:52:39 2021-11-23 14:32:11 2021-11-23 14:57:54 0:25:43 0:16:33 0:09:10 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 6521830 2021-11-23 11:52:40 2021-11-23 14:32:11 2021-11-23 15:21:39 0:49:28 0:41:45 0:07:43 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6521831 2021-11-23 11:52:41 2021-11-23 14:32:12 2021-11-23 14:56:19 0:24:07 0:13:36 0:10:31 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} 2
pass 6521832 2021-11-23 11:52:42 2021-11-23 14:33:02 2021-11-23 15:13:36 0:40:34 0:28:28 0:12:06 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/rados_api_tests} 2
pass 6521833 2021-11-23 11:52:43 2021-11-23 14:33:23 2021-11-23 14:59:18 0:25:55 0:18:13 0:07:42 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6521834 2021-11-23 11:52:45 2021-11-23 14:34:03 2021-11-23 15:00:00 0:25:57 0:19:30 0:06:27 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 6521835 2021-11-23 11:52:46 2021-11-23 14:34:44 2021-11-23 15:09:21 0:34:37 0:23:38 0:10:59 smithi master ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521836 2021-11-23 11:52:47 2021-11-23 14:35:24 2021-11-23 15:17:03 0:41:39 0:31:52 0:09:47 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6521837 2021-11-23 11:52:48 2021-11-23 14:35:35 2021-11-23 15:09:28 0:33:53 0:24:40 0:09:13 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6521838 2021-11-23 11:52:49 2021-11-23 14:36:15 2021-11-23 15:15:43 0:39:28 0:29:36 0:09:52 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/force-sync-many workloads/rados_mon_workunits} 2
fail 6521839 2021-11-23 11:52:51 2021-11-23 14:36:16 2021-11-23 14:56:31 0:20:15 0:08:30 0:11:45 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi060 with status 5: 'sudo systemctl stop ceph-28b8994c-4c6d-11ec-8c2d-001a4aab830c@mon.a'

pass 6521840 2021-11-23 11:52:52 2021-11-23 14:37:16 2021-11-23 15:27:05 0:49:49 0:39:11 0:10:38 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6521841 2021-11-23 11:52:53 2021-11-23 14:37:37 2021-11-23 15:03:34 0:25:57 0:14:30 0:11:27 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.0} 1
pass 6521842 2021-11-23 11:52:54 2021-11-23 14:37:37 2021-11-23 15:06:07 0:28:30 0:20:01 0:08:29 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
fail 6521843 2021-11-23 11:52:55 2021-11-23 14:38:37 2021-11-23 15:11:50 0:33:13 0:23:44 0:09:29 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6521844 2021-11-23 11:52:56 2021-11-23 14:38:38 2021-11-23 15:09:54 0:31:16 0:24:26 0:06:50 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/crash} 2
pass 6521845 2021-11-23 11:52:57 2021-11-23 14:38:58 2021-11-23 14:58:59 0:20:01 0:09:48 0:10:13 smithi master centos 8.3 rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} 1
pass 6521846 2021-11-23 11:52:58 2021-11-23 14:39:48 2021-11-23 15:10:45 0:30:57 0:25:21 0:05:36 smithi master rhel 8.4 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
pass 6521847 2021-11-23 11:52:59 2021-11-23 14:39:49 2021-11-23 15:05:56 0:26:07 0:16:11 0:09:56 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521848 2021-11-23 11:53:01 2021-11-23 14:39:59 2021-11-23 15:05:08 0:25:09 0:16:08 0:09:01 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/c2c} 1
pass 6521849 2021-11-23 11:53:02 2021-11-23 14:39:59 2021-11-23 16:17:11 1:37:12 1:26:12 0:11:00 smithi master ubuntu 20.04 rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6521850 2021-11-23 11:53:03 2021-11-23 14:40:10 2021-11-23 15:17:42 0:37:32 0:27:49 0:09:43 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
pass 6521851 2021-11-23 11:53:04 2021-11-23 14:40:30 2021-11-23 15:17:56 0:37:26 0:30:53 0:06:33 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 6521852 2021-11-23 11:53:05 2021-11-23 14:40:31 2021-11-23 15:14:31 0:34:00 0:23:13 0:10:47 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_nfs} 1
pass 6521853 2021-11-23 11:53:06 2021-11-23 14:41:41 2021-11-23 15:26:44 0:45:03 0:33:52 0:11:11 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6521854 2021-11-23 11:53:07 2021-11-23 14:42:42 2021-11-23 15:09:53 0:27:11 0:21:47 0:05:24 smithi master rhel 8.4 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
dead 6521855 2021-11-23 11:53:08 2021-11-23 14:42:42 2021-11-24 02:52:36 12:09:54 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6521856 2021-11-23 11:53:09 2021-11-23 14:44:12 2021-11-23 15:03:02 0:18:50 0:07:51 0:10:59 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521857 2021-11-23 11:53:10 2021-11-23 14:44:23 2021-11-23 15:07:50 0:23:27 0:10:50 0:12:37 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
pass 6521858 2021-11-23 11:53:11 2021-11-23 14:45:53 2021-11-23 15:26:18 0:40:25 0:28:55 0:11:30 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6521859 2021-11-23 11:53:12 2021-11-23 14:46:54 2021-11-23 15:07:28 0:20:34 0:09:12 0:11:22 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6521860 2021-11-23 11:53:13 2021-11-23 14:47:04 2021-11-23 15:25:07 0:38:03 0:27:54 0:10:09 smithi master rhel 8.4 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 6521861 2021-11-23 11:53:14 2021-11-23 14:49:55 2021-11-23 15:17:21 0:27:26 0:21:12 0:06:14 smithi master rhel 8.4 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6521862 2021-11-23 11:53:16 2021-11-23 14:49:55 2021-11-23 15:16:42 0:26:47 0:16:25 0:10:22 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6521863 2021-11-23 11:53:17 2021-11-23 14:51:16 2021-11-23 15:13:17 0:22:01 0:10:50 0:11:11 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 6521864 2021-11-23 11:53:18 2021-11-23 14:51:36 2021-11-23 15:23:58 0:32:22 0:25:10 0:07:12 smithi master rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6521865 2021-11-23 11:53:19 2021-11-23 14:52:46 2021-11-23 15:16:17 0:23:31 0:12:58 0:10:33 smithi master centos 8.3 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.3_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 6521866 2021-11-23 11:53:20 2021-11-23 14:52:47 2021-11-23 15:40:15 0:47:28 0:37:41 0:09:47 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 6521867 2021-11-23 11:53:21 2021-11-23 14:52:57 2021-11-23 15:21:20 0:28:23 0:17:49 0:10:34 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} tasks/rados_cls_all} 2
pass 6521868 2021-11-23 11:53:22 2021-11-23 14:53:38 2021-11-23 15:17:24 0:23:46 0:14:25 0:09:21 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6521869 2021-11-23 11:53:23 2021-11-23 14:54:08 2021-11-23 15:20:24 0:26:16 0:16:21 0:09:55 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8.stream} tasks/failover} 2
pass 6521870 2021-11-23 11:53:24 2021-11-23 14:55:09 2021-11-23 15:51:06 0:55:57 0:49:35 0:06:22 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6521871 2021-11-23 11:53:25 2021-11-23 14:55:39 2021-11-23 15:17:21 0:21:42 0:12:23 0:09:19 smithi master centos 8.stream rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream}} 1
pass 6521872 2021-11-23 11:53:26 2021-11-23 14:55:39 2021-11-23 15:23:42 0:28:03 0:17:48 0:10:15 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/set-chunks-read} 2
pass 6521873 2021-11-23 11:53:27 2021-11-23 14:56:20 2021-11-23 15:23:33 0:27:13 0:18:10 0:09:03 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6521874 2021-11-23 11:53:28 2021-11-23 14:56:40 2021-11-23 15:23:39 0:26:59 0:20:41 0:06:18 smithi master rhel 8.4 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6521875 2021-11-23 11:53:30 2021-11-23 14:56:40 2021-11-23 16:03:16 1:06:36 0:54:42 0:11:54 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
pass 6521876 2021-11-23 11:53:31 2021-11-23 14:58:01 2021-11-23 15:25:11 0:27:10 0:14:42 0:12:28 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6521877 2021-11-23 11:53:32 2021-11-23 14:59:01 2021-11-23 15:22:13 0:23:12 0:13:56 0:09:16 smithi master centos 8.3 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} 1
pass 6521878 2021-11-23 11:53:33 2021-11-23 14:59:02 2021-11-23 15:26:38 0:27:36 0:17:20 0:10:16 smithi master centos 8.stream rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 3
pass 6521879 2021-11-23 11:53:34 2021-11-23 14:59:22 2021-11-23 15:23:04 0:23:42 0:14:26 0:09:16 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6521880 2021-11-23 11:53:35 2021-11-23 14:59:53 2021-11-23 15:38:11 0:38:18 0:27:55 0:10:23 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6521881 2021-11-23 11:53:36 2021-11-23 15:00:03 2021-11-23 15:50:22 0:50:19 0:39:01 0:11:18 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} 2
pass 6521882 2021-11-23 11:53:37 2021-11-23 15:00:53 2021-11-23 15:31:39 0:30:46 0:19:47 0:10:59 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/on distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6521883 2021-11-23 11:53:38 2021-11-23 15:01:14 2021-11-23 15:55:58 0:54:44 0:44:24 0:10:20 smithi master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
pass 6521884 2021-11-23 11:53:39 2021-11-23 15:02:14 2021-11-23 15:32:27 0:30:13 0:22:54 0:07:19 smithi master rhel 8.4 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6521885 2021-11-23 11:53:40 2021-11-23 15:02:14 2021-11-23 15:26:06 0:23:52 0:14:21 0:09:31 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_orch_cli} 1
pass 6521886 2021-11-23 11:53:41 2021-11-23 15:02:55 2021-11-23 15:44:22 0:41:27 0:34:39 0:06:48 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
pass 6521887 2021-11-23 11:53:42 2021-11-23 15:02:55 2021-11-23 15:24:07 0:21:12 0:09:34 0:11:38 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 6521888 2021-11-23 11:53:43 2021-11-23 15:03:06 2021-11-23 15:22:48 0:19:42 0:10:23 0:09:19 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6521889 2021-11-23 11:53:44 2021-11-23 15:03:06 2021-11-23 15:36:20 0:33:14 0:22:47 0:10:27 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/crush} 1
pass 6521890 2021-11-23 11:53:45 2021-11-23 15:03:06 2021-11-23 15:30:43 0:27:37 0:18:17 0:09:20 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6521891 2021-11-23 11:53:46 2021-11-23 15:05:17 2021-11-23 16:03:47 0:58:30 0:48:14 0:10:16 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 6521892 2021-11-23 11:53:48 2021-11-23 15:06:17 2021-11-23 15:52:51 0:46:34 0:34:22 0:12:12 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6521893 2021-11-23 11:53:49 2021-11-23 15:07:38 2021-11-23 16:04:02 0:56:24 0:45:42 0:10:42 smithi master ubuntu 20.04 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521894 2021-11-23 11:53:50 2021-11-23 15:07:58 2021-11-23 15:51:24 0:43:26 0:36:53 0:06:33 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6521895 2021-11-23 11:53:51 2021-11-23 15:08:09 2021-11-23 15:46:42 0:38:33 0:31:47 0:06:46 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
pass 6521896 2021-11-23 11:53:52 2021-11-23 15:09:30 2021-11-23 15:34:45 0:25:15 0:18:29 0:06:46 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6521897 2021-11-23 11:53:53 2021-11-23 15:09:30 2021-11-23 15:27:56 0:18:26 0:07:28 0:10:58 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
fail 6521898 2021-11-23 11:53:54 2021-11-23 15:10:00 2021-11-23 15:29:37 0:19:37 0:08:39 0:10:58 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi013 with status 5: 'sudo systemctl stop ceph-d819ffa8-4c71-11ec-8c2d-001a4aab830c@mon.a'

pass 6521899 2021-11-23 11:53:55 2021-11-23 15:10:11 2021-11-23 15:44:02 0:33:51 0:26:56 0:06:55 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/insights} 2
pass 6521900 2021-11-23 11:53:56 2021-11-23 15:10:51 2021-11-23 15:36:35 0:25:44 0:16:18 0:09:26 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/rados_python} 2
fail 6521901 2021-11-23 11:53:57 2021-11-23 15:11:12 2021-11-23 15:26:50 0:15:38 0:06:04 0:09:34 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-938c0dae-4c71-11ec-8c2d-001a4aab830c@mon.a'

pass 6521902 2021-11-23 11:53:58 2021-11-23 15:11:52 2021-11-23 16:23:25 1:11:33 1:00:04 0:11:29 smithi master ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521903 2021-11-23 11:53:59 2021-11-23 23:03:43 813 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6521904 2021-11-23 11:54:00 2021-11-23 22:40:28 2021-11-23 23:17:52 0:37:24 0:26:17 0:11:07 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
pass 6521905 2021-11-23 11:54:01 2021-11-23 22:42:39 2021-11-23 23:08:31 0:25:52 0:15:35 0:10:17 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6521906 2021-11-23 11:54:02 2021-11-23 22:43:19 2021-11-23 23:08:54 0:25:35 0:12:38 0:12:57 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6521907 2021-11-23 11:54:03 2021-11-23 22:45:30 2021-11-23 23:06:53 0:21:23 0:10:39 0:10:44 smithi master centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6521908 2021-11-23 11:54:04 2021-11-23 22:45:30 2021-11-23 23:06:36 0:21:06 0:10:43 0:10:23 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} 1
pass 6521909 2021-11-23 11:54:05 2021-11-23 22:47:41 2021-11-23 23:12:25 0:24:44 0:13:57 0:10:47 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
dead 6521910 2021-11-23 11:54:06 2021-11-23 22:48:31 2021-11-24 10:57:00 12:08:29 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6521911 2021-11-23 11:54:07 2021-11-23 22:49:12 2021-11-23 23:07:59 0:18:47 0:09:00 0:09:47 smithi master centos 8.3 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6521912 2021-11-23 11:54:08 2021-11-23 22:49:12 2021-11-23 23:08:50 0:19:38 0:09:23 0:10:15 smithi master centos 8.3 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 6521913 2021-11-23 11:54:10 2021-11-23 22:50:02 2021-11-23 23:27:15 0:37:13 0:25:45 0:11:28 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6521914 2021-11-23 11:54:11 2021-11-23 22:52:03 2021-11-23 23:21:45 0:29:42 0:18:24 0:11:18 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
pass 6521915 2021-11-23 11:54:12 2021-11-23 22:54:34 2021-11-23 23:24:29 0:29:55 0:19:23 0:10:32 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6521916 2021-11-23 11:54:13 2021-11-23 22:54:44 2021-11-23 23:14:03 0:19:19 0:06:36 0:12:43 smithi master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 6521917 2021-11-23 11:54:14 2021-11-23 22:55:34 2021-11-23 23:35:11 0:39:37 0:30:16 0:09:21 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6521918 2021-11-23 11:54:15 2021-11-23 22:55:55 2021-11-23 23:36:23 0:40:28 0:29:02 0:11:26 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6521919 2021-11-23 11:54:16 2021-11-23 22:56:55 2021-11-23 23:37:53 0:40:58 0:27:31 0:13:27 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6521920 2021-11-23 11:54:17 2021-11-23 23:00:26 2021-11-23 23:24:05 0:23:39 0:11:05 0:12:34 smithi master centos 8.stream rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6521921 2021-11-23 11:54:18 2021-11-23 23:02:57 2021-11-23 23:33:14 0:30:17 0:18:59 0:11:18 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} 2
pass 6521922 2021-11-23 11:54:19 2021-11-23 23:03:47 2021-11-23 23:45:31 0:41:44 0:34:35 0:07:09 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} 2
pass 6521923 2021-11-23 11:54:20 2021-11-23 23:04:08 2021-11-23 23:30:54 0:26:46 0:15:14 0:11:32 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6521924 2021-11-23 11:54:21 2021-11-23 23:05:38 2021-11-23 23:49:57 0:44:19 0:33:10 0:11:09 smithi master centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
pass 6521925 2021-11-23 11:54:22 2021-11-23 23:06:29 2021-11-24 00:21:40 1:15:11 1:05:56 0:09:15 smithi master centos 8.3 rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6521926 2021-11-23 11:54:23 2021-11-23 23:06:29 2021-11-23 23:47:41 0:41:12 0:31:22 0:09:50 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
pass 6521927 2021-11-23 11:54:24 2021-11-23 23:06:39 2021-11-23 23:49:53 0:43:14 0:32:50 0:10:24 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 6521928 2021-11-23 11:54:25 2021-11-23 23:06:40 2021-11-23 23:42:23 0:35:43 0:26:28 0:09:15 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
fail 6521929 2021-11-23 11:54:26 2021-11-23 23:06:40 2021-11-23 23:23:20 0:16:40 0:05:07 0:11:33 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

Command failed on smithi165 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-8936-g5c1ba840-1focal cephadm=17.0.0-8936-g5c1ba840-1focal ceph-mds=17.0.0-8936-g5c1ba840-1focal ceph-mgr=17.0.0-8936-g5c1ba840-1focal ceph-common=17.0.0-8936-g5c1ba840-1focal ceph-fuse=17.0.0-8936-g5c1ba840-1focal ceph-test=17.0.0-8936-g5c1ba840-1focal ceph-volume=17.0.0-8936-g5c1ba840-1focal radosgw=17.0.0-8936-g5c1ba840-1focal python3-rados=17.0.0-8936-g5c1ba840-1focal python3-rgw=17.0.0-8936-g5c1ba840-1focal python3-cephfs=17.0.0-8936-g5c1ba840-1focal python3-rbd=17.0.0-8936-g5c1ba840-1focal libcephfs2=17.0.0-8936-g5c1ba840-1focal libcephfs-dev=17.0.0-8936-g5c1ba840-1focal librados2=17.0.0-8936-g5c1ba840-1focal librbd1=17.0.0-8936-g5c1ba840-1focal rbd-fuse=17.0.0-8936-g5c1ba840-1focal'

dead 6521930 2021-11-23 11:54:27 2021-11-23 23:07:00 2021-11-23 23:22:22 0:15:22 0:04:06 0:11:16 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
Failure Reason:

Failure object was: {'smithi125.front.sepia.ceph.com': {'cache_updated': False, 'stdout': "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 61 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nErr:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1\n Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out [IP: 91.189.88.142 80]\nErr:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nErr:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nIgn:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18\nErr:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nErr:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nErr:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nErr:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18\n Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nFetched 3215 kB in 1min 2s (51.9 kB/s)\n", 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.18_all.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'autoclean': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1637709266, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.18_all.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stdout_lines': ['Reading package lists...', 'Building dependency tree...', 'Reading state information...', 'git is already the newest version (1:2.25.1-1ubuntu3.2).', 'The following packages were automatically installed and are no longer required:', ' libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic', ' linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic', ' linux-modules-extra-5.4.0-66-generic', "Use 'sudo apt autoremove' to remove them.", 'The following additional packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data', ' qemu-system-gui qemu-utils', 'Suggested packages:', ' samba vde2 debootstrap', 'The following NEW packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86', ' qemu-utils', 'The following packages will be upgraded:', ' qemu-system-data qemu-system-gui', '2 upgraded, 6 newly installed, 0 to remove and 61 not upgraded.', 'Need to get 14.3 MB of archives.', 'After this operation, 62.7 MB of additional disk space will be used.', 'Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]', 'Err:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1', ' Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out [IP: 91.189.88.142 80]', 'Err:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Err:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Ign:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18', 'Err:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Err:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Err:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Err:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18', ' Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'Fetched 3215 kB in 1min 2s (51.9 kB/s)'], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.88.152), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::24), connection timed out Could not connect to archive.ubuntu.com:80 (91.189.88.142), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1360:8001::23), connection timed out [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-data_4.2-3ubuntu6.18_all.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-gui_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.18_amd64.deb Unable to connect to archive.ubuntu.com:http: [IP: 91.189.88.142 80]', 'E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time')

pass 6521931 2021-11-23 11:54:28 2021-11-23 23:08:41 2021-11-23 23:29:41 0:21:00 0:10:57 0:10:03 smithi master centos 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6521932 2021-11-23 11:54:29 2021-11-23 23:08:41 2021-11-24 00:53:59 1:45:18 1:38:27 0:06:51 smithi master rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} 1
pass 6521933 2021-11-23 11:54:30 2021-11-23 23:08:52 2021-11-23 23:32:28 0:23:36 0:13:12 0:10:24 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6521934 2021-11-23 11:54:31 2021-11-23 23:09:02 2021-11-24 00:44:34 1:35:32 1:28:06 0:07:26 smithi master rhel 8.4 rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6521935 2021-11-23 11:54:32 2021-11-23 23:09:02 2021-11-23 23:37:11 0:28:09 0:16:43 0:11:26 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6521936 2021-11-23 11:54:33 2021-11-23 23:10:03 2021-11-23 23:50:05 0:40:02 0:29:42 0:10:20 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
pass 6521937 2021-11-23 11:54:35 2021-11-23 23:11:03 2021-11-23 23:36:15 0:25:12 0:16:29 0:08:43 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_cephadm} 1
pass 6521938 2021-11-23 11:54:36 2021-11-23 23:11:03 2021-11-23 23:36:30 0:25:27 0:13:12 0:12:15 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
fail 6521939 2021-11-23 11:54:37 2021-11-23 23:12:14 2021-11-23 23:22:29 0:10:15 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/host rook/master} 3
Failure Reason:

Command failed on smithi162 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04'

pass 6521940 2021-11-23 11:54:38 2021-11-23 23:14:05 2021-11-23 23:37:31 0:23:26 0:12:59 0:10:27 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 6521941 2021-11-23 11:54:39 2021-11-23 23:14:05 2021-11-23 23:47:22 0:33:17 0:18:46 0:14:31 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1ba840272b9f9cc9ad704c802bf7daf2491ad5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6521942 2021-11-23 11:54:40 2021-11-23 23:17:56 2021-11-23 23:37:21 0:19:25 0:09:51 0:09:34 smithi master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6521943 2021-11-23 11:54:41 2021-11-23 23:17:56 2021-11-23 23:37:11 0:19:15 0:09:09 0:10:06 smithi master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 1
pass 6521944 2021-11-23 11:54:42 2021-11-23 23:17:56 2021-11-23 23:47:13 0:29:17 0:17:58 0:11:19 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6521945 2021-11-23 11:54:43 2021-11-23 23:21:47 2021-11-23 23:46:01 0:24:14 0:13:33 0:10:41 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6521946 2021-11-23 11:54:44 2021-11-23 23:46:05 817 smithi master centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6521947 2021-11-23 11:54:45 2021-11-23 23:22:38 2021-11-23 23:54:44 0:32:06 0:21:51 0:10:15 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6521948 2021-11-23 11:54:46 2021-11-23 23:23:29 2021-11-24 00:08:40 0:45:11 0:32:39 0:12:32 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 6521949 2021-11-23 11:54:47 2021-11-23 23:24:09 2021-11-24 01:51:15 2:27:06 2:18:29 0:08:37 smithi master centos 8.stream rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8.stream}} 1
dead 6521950 2021-11-23 11:54:48 2021-11-23 23:24:09 2021-11-24 11:32:54 12:08:45 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6521951 2021-11-23 11:54:49 2021-11-23 23:24:30 2021-11-23 23:46:16 0:21:46 0:12:18 0:09:28 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
fail 6521952 2021-11-23 11:54:50 2021-11-23 23:24:50 2021-11-23 23:46:17 0:21:27 0:09:26 0:12:01 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Command failed on smithi027 with status 5: 'sudo systemctl stop ceph-4e1727c2-4cb7-11ec-8c2d-001a4aab830c@mon.a'

pass 6521953 2021-11-23 11:54:51 2021-11-23 23:27:21 2021-11-23 23:55:18 0:27:57 0:15:17 0:12:40 smithi master centos 8.3 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 6521954 2021-11-23 11:54:53 2021-11-23 23:29:52 2021-11-23 23:56:13 0:26:21 0:14:52 0:11:29 smithi master centos 8.stream rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream}} 1
pass 6521955 2021-11-23 11:54:54 2021-11-23 23:31:02 2021-11-24 00:21:47 0:50:45 0:39:47 0:10:58 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} 2
pass 6521956 2021-11-23 11:54:55 2021-11-23 23:32:33 2021-11-24 00:03:20 0:30:47 0:19:14 0:11:33 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 6521957 2021-11-23 11:54:56 2021-11-23 23:33:23 2021-11-24 00:10:41 0:37:18 0:24:21 0:12:57 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6521958 2021-11-23 11:54:57 2021-11-23 23:35:14 2021-11-23 23:58:07 0:22:53 0:13:56 0:08:57 smithi master centos 8.2 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 6521959 2021-11-23 11:54:58 2021-11-23 23:35:14 2021-11-23 23:57:51 0:22:37 0:10:47 0:11:50 smithi master centos 8.stream rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/mon_clock_with_skews} 2
pass 6521960 2021-11-23 11:54:59 2021-11-23 23:36:24 2021-11-24 00:05:46 0:29:22 0:23:28 0:05:54 smithi master rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6521961 2021-11-23 11:55:00 2021-11-23 23:36:35 2021-11-24 00:16:13 0:39:38 0:28:09 0:11:29 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6521962 2021-11-23 11:55:01 2021-11-23 23:37:15 2021-11-24 00:06:52 0:29:37 0:23:12 0:06:25 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} 2
pass 6521963 2021-11-23 11:55:02 2021-11-24 00:10:49 1368 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 6521964 2021-11-23 11:55:03 2021-11-23 23:37:36 2021-11-23 23:57:23 0:19:47 0:10:03 0:09:44 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/rados_striper} 2
pass 6521965 2021-11-23 11:55:04 2021-11-23 23:37:57 2021-11-24 00:27:59 0:50:02 0:39:41 0:10:21 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 6521966 2021-11-23 11:55:05 2021-11-23 23:56:24 2021-11-24 00:20:35 0:24:11 0:13:13 0:10:58 smithi master centos 8.3 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6521967 2021-11-23 11:55:06 2021-11-23 23:57:24 2021-11-24 00:31:21 0:33:57 0:24:20 0:09:37 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6521968 2021-11-23 11:55:07 2021-11-23 23:57:54 2021-11-24 00:19:55 0:22:01 0:10:58 0:11:03 smithi master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521969 2021-11-23 11:55:08 2021-11-23 23:57:55 2021-11-24 00:58:49 1:00:54 0:46:50 0:14:04 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
pass 6521970 2021-11-23 11:55:09 2021-11-24 00:01:36 2021-11-24 00:28:42 0:27:06 0:17:55 0:09:11 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 6521971 2021-11-23 11:55:10 2021-11-24 00:03:26 2021-11-24 00:23:59 0:20:33 0:10:00 0:10:33 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 6521972 2021-11-23 11:55:11 2021-11-24 00:03:27 2021-11-24 00:29:19 0:25:52 0:18:27 0:07:25 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6521973 2021-11-23 11:55:13 2021-11-24 00:04:07 2021-11-24 00:30:59 0:26:52 0:19:30 0:07:22 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6521974 2021-11-23 11:55:14 2021-11-24 00:05:48 2021-11-24 00:30:44 0:24:56 0:15:36 0:09:20 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6521975 2021-11-23 11:55:15 2021-11-24 00:05:48 2021-11-24 00:30:51 0:25:03 0:15:55 0:09:08 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} 1
pass 6521976 2021-11-23 11:55:16 2021-11-24 00:05:48 2021-11-24 00:41:10 0:35:22 0:25:23 0:09:59 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 6521977 2021-11-23 11:55:17 2021-11-24 00:05:59 2021-11-24 00:33:10 0:27:11 0:21:07 0:06:04 smithi master rhel 8.4 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6521978 2021-11-23 11:55:18 2021-11-24 00:05:59 2021-11-24 00:30:38 0:24:39 0:13:57 0:10:42 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/cache-agent-small} 2
pass 6521979 2021-11-23 11:55:19 2021-11-24 00:06:59 2021-11-24 00:25:32 0:18:33 0:07:06 0:11:27 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_cephadm_repos} 1
pass 6521980 2021-11-23 11:55:20 2021-11-24 00:08:30 2021-11-24 00:33:15 0:24:45 0:14:26 0:10:19 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6521981 2021-11-23 11:55:21 2021-11-24 00:08:50 2021-11-24 00:48:32 0:39:42 0:30:27 0:09:15 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6521982 2021-11-23 11:55:22 2021-11-24 00:09:31 2021-11-24 00:33:18 0:23:47 0:13:43 0:10:04 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 6521983 2021-11-23 11:55:23 2021-11-24 00:10:21 2021-11-24 00:29:55 0:19:34 0:08:30 0:11:04 smithi master ubuntu 20.04 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6521984 2021-11-23 11:55:24 2021-11-24 00:10:21 2021-11-24 00:34:31 0:24:10 0:13:04 0:11:06 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6521985 2021-11-23 11:55:25 2021-11-24 00:10:52 2021-11-24 00:48:48 0:37:56 0:26:40 0:11:16 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 2
pass 6521986 2021-11-23 11:55:26 2021-11-24 00:11:42 2021-11-24 00:41:20 0:29:38 0:15:13 0:14:25 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 6521987 2021-11-23 11:55:27 2021-11-24 00:16:23 2021-11-24 00:47:10 0:30:47 0:18:41 0:12:06 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
pass 6521988 2021-11-23 11:55:28 2021-11-24 00:17:24 2021-11-24 02:54:46 2:37:22 2:27:32 0:09:50 smithi master centos 8.stream rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8.stream}} 1
pass 6521989 2021-11-23 11:55:29 2021-11-24 00:17:24 2021-11-24 01:06:57 0:49:33 0:36:49 0:12:44 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6521990 2021-11-23 11:55:30 2021-11-24 00:19:55 2021-11-24 01:01:01 0:41:06 0:35:02 0:06:04 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} 2
pass 6521991 2021-11-23 11:55:31 2021-11-24 00:20:05 2021-11-24 01:08:39 0:48:34 0:36:21 0:12:13 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6521992 2021-11-23 11:55:32 2021-11-24 00:21:26 2021-11-24 00:59:08 0:37:42 0:27:42 0:10:00 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} 2
pass 6521993 2021-11-23 11:55:33 2021-11-24 00:21:56 2021-11-24 00:43:42 0:21:46 0:10:16 0:11:30 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 6521994 2021-11-23 11:55:34 2021-11-24 00:21:57 2021-11-24 00:57:19 0:35:22 0:26:35 0:08:47 smithi master rhel 8.4 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6521995 2021-11-23 11:55:35 2021-11-24 00:24:07 2021-11-24 00:52:48 0:28:41 0:17:55 0:10:46 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6521996 2021-11-23 11:55:37 2021-11-24 00:27:38 2021-11-24 00:58:54 0:31:16 0:20:40 0:10:36 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6521997 2021-11-23 11:55:38 2021-11-24 00:27:38 2021-11-24 01:13:05 0:45:27 0:38:50 0:06:37 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} 2
pass 6521998 2021-11-23 11:55:39 2021-11-24 00:28:09 2021-11-24 00:50:50 0:22:41 0:10:34 0:12:07 smithi master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
pass 6521999 2021-11-23 11:55:40 2021-11-24 00:28:49 2021-11-24 01:10:36 0:41:47 0:30:42 0:11:05 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6522000 2021-11-23 11:55:41 2021-11-24 00:29:10 2021-11-24 01:08:33 0:39:23 0:30:30 0:08:53 smithi master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6522001 2021-11-23 11:55:42 2021-11-24 00:29:20 2021-11-24 04:08:22 3:39:02 3:26:45 0:12:17 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi157 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1ba840272b9f9cc9ad704c802bf7daf2491ad5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6522002 2021-11-23 11:55:43 2021-11-24 00:30:41 2021-11-24 00:58:05 0:27:24 0:21:14 0:06:10 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 6522003 2021-11-23 11:55:44 2021-11-24 00:30:51 2021-11-24 01:02:13 0:31:22 0:21:16 0:10:06 smithi master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 6522004 2021-11-23 11:55:45 2021-11-24 00:31:01 2021-11-24 01:04:13 0:33:12 0:22:51 0:10:21 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/classic task/test_nfs} 1
pass 6522005 2021-11-23 11:55:46 2021-11-24 00:31:02 2021-11-24 01:15:02 0:44:00 0:36:19 0:07:41 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 6522006 2021-11-23 11:55:48 2021-11-24 00:31:32 2021-11-24 00:58:36 0:27:04 0:15:00 0:12:04 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 6522007 2021-11-23 11:55:49 2021-11-24 00:33:23 2021-11-24 00:54:49 0:21:26 0:10:42 0:10:44 smithi master centos 8.3 rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6522008 2021-11-23 11:55:50 2021-11-24 00:33:23 2021-11-24 01:09:53 0:36:30 0:26:04 0:10:26 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} 2
pass 6522009 2021-11-23 11:55:51 2021-11-24 00:33:23 2021-11-24 01:01:10 0:27:47 0:20:35 0:07:12 smithi master rhel 8.4 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6522010 2021-11-23 11:55:52 2021-11-24 00:33:43 2021-11-24 01:18:32 0:44:49 0:32:27 0:12:22 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 6522011 2021-11-23 11:55:54 2021-11-24 00:34:34 2021-11-24 00:54:13 0:19:39 0:08:18 0:11:21 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Command failed on smithi012 with status 5: 'sudo systemctl stop ceph-eb464a06-4cc0-11ec-8c2d-001a4aab830c@mon.a'

dead 6522012 2021-11-23 11:55:55 2021-11-24 00:36:14 2021-11-24 12:46:19 12:10:05 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6522013 2021-11-23 11:55:56 2021-11-24 00:37:55 2021-11-24 01:08:41 0:30:46 0:22:00 0:08:46 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 6522014 2021-11-23 11:55:57 2021-11-24 00:39:16 2021-11-24 01:08:02 0:28:46 0:20:10 0:08:36 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6522015 2021-11-23 11:55:58 2021-11-24 00:40:36 2021-11-24 01:26:07 0:45:31 0:38:10 0:07:21 smithi master rhel 8.4 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6522016 2021-11-23 11:55:59 2021-11-24 00:41:17 2021-11-24 01:17:20 0:36:03 0:24:51 0:11:12 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} 2
pass 6522017 2021-11-23 11:56:00 2021-11-24 00:41:27 2021-11-24 01:43:52 1:02:25 0:49:18 0:13:07 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6522018 2021-11-23 11:56:02 2021-11-24 00:44:38 2021-11-24 01:27:01 0:42:23 0:28:39 0:13:44 smithi master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522019 2021-11-23 11:56:03 2021-11-24 00:47:18 2021-11-24 01:28:31 0:41:13 0:30:45 0:10:28 smithi master centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6522020 2021-11-23 11:56:04 2021-11-24 00:47:19 2021-11-24 01:56:09 1:08:50 0:57:30 0:11:20 smithi master centos 8.stream rados/standalone/{supported-random-distro$/{centos_8.stream} workloads/misc} 1
pass 6522021 2021-11-23 11:56:05 2021-11-24 00:48:39 2021-11-24 01:19:58 0:31:19 0:22:18 0:09:01 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mix} 2
pass 6522022 2021-11-23 11:56:06 2021-11-24 00:48:49 2021-11-24 01:32:26 0:43:37 0:35:47 0:07:50 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6522023 2021-11-23 11:56:07 2021-11-24 00:51:00 2021-11-24 01:10:39 0:19:39 0:09:21 0:10:18 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 6522024 2021-11-23 11:56:08 2021-11-24 00:51:00 2021-11-24 01:11:59 0:20:59 0:08:48 0:12:11 smithi master centos 8.3 rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} 1
pass 6522025 2021-11-23 11:56:09 2021-11-24 00:52:51 2021-11-24 01:18:21 0:25:30 0:12:51 0:12:39 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522026 2021-11-23 11:56:10 2021-11-24 00:54:22 2021-11-24 01:20:49 0:26:27 0:14:32 0:11:55 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6522027 2021-11-23 11:56:11 2021-11-24 00:54:52 2021-11-24 01:54:21 0:59:29 0:46:37 0:12:52 smithi master centos 8.3 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6522028 2021-11-23 11:56:12 2021-11-24 00:57:23 2021-11-24 01:29:24 0:32:01 0:25:00 0:07:01 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} 2
pass 6522029 2021-11-23 11:56:13 2021-11-24 00:58:13 2021-11-24 01:29:09 0:30:56 0:19:26 0:11:30 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 6522030 2021-11-23 11:56:14 2021-11-24 00:58:44 2021-11-24 01:19:49 0:21:05 0:12:19 0:08:46 smithi master centos 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6522031 2021-11-23 11:56:16 2021-11-24 00:58:44 2021-11-24 01:22:02 0:23:18 0:14:04 0:09:14 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} 1
pass 6522032 2021-11-23 11:56:17 2021-11-24 00:58:54 2021-11-24 03:00:23 2:01:29 1:52:26 0:09:03 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} 2
pass 6522033 2021-11-23 11:56:18 2021-11-24 00:59:05 2021-11-24 01:28:25 0:29:20 0:21:52 0:07:28 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6522034 2021-11-23 11:56:19 2021-11-24 00:59:15 2021-11-24 01:20:28 0:21:13 0:09:27 0:11:46 smithi master centos 8.3 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
pass 6522035 2021-11-23 11:56:20 2021-11-24 01:01:16 2021-11-24 01:37:40 0:36:24 0:26:16 0:10:08 smithi master centos 8.stream rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}} 1
pass 6522036 2021-11-23 11:56:21 2021-11-24 01:02:16 2021-11-24 01:25:27 0:23:11 0:11:50 0:11:21 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} 2
pass 6522037 2021-11-23 11:56:22 2021-11-24 01:04:17 2021-11-24 01:31:34 0:27:17 0:13:07 0:14:10 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6522038 2021-11-23 11:56:23 2021-11-24 01:08:07 2021-11-24 01:34:20 0:26:13 0:14:51 0:11:22 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6522039 2021-11-23 11:56:24 2021-11-24 01:08:38 2021-11-24 01:47:16 0:38:38 0:26:53 0:11:45 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6522040 2021-11-23 11:56:25 2021-11-24 01:08:48 2021-11-24 02:12:15 1:03:27 0:56:28 0:06:59 smithi master rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 6522041 2021-11-23 11:56:26 2021-11-24 01:08:49 2021-11-24 01:47:25 0:38:36 0:31:23 0:07:13 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} 2
pass 6522042 2021-11-23 11:56:27 2021-11-24 01:09:59 2021-11-24 01:38:54 0:28:55 0:16:58 0:11:57 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.0} 3
fail 6522043 2021-11-23 11:56:28 2021-11-24 01:10:40 2021-11-24 01:25:40 0:15:00 0:06:07 0:08:53 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi038 with status 5: 'sudo systemctl stop ceph-491b73be-4cc5-11ec-8c2d-001a4aab830c@mon.a'

fail 6522044 2021-11-23 11:56:30 2021-11-24 01:10:40 2021-11-24 01:46:08 0:35:28 0:24:03 0:11:25 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} 2
Failure Reason:

Test failure: test_ganesha (unittest.loader._FailedTest)

pass 6522045 2021-11-23 11:56:31 2021-11-24 01:13:11 2021-11-24 01:38:07 0:24:56 0:12:58 0:11:58 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/crash} 2
pass 6522046 2021-11-23 11:56:32 2021-11-24 01:15:11 2021-11-24 01:44:38 0:29:27 0:20:08 0:09:19 smithi master centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6522047 2021-11-23 11:56:33 2021-11-24 01:15:11 2021-11-24 02:46:25 1:31:14 1:19:43 0:11:31 smithi master centos 8.3 rados/upgrade/parallel/{0-distro$/{centos_8.3_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6522048 2021-11-23 11:56:34 2021-11-24 01:17:22 2021-11-24 01:41:34 0:24:12 0:12:45 0:11:27 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6522049 2021-11-23 11:56:35 2021-11-24 01:18:23 2021-11-24 01:44:50 0:26:27 0:15:52 0:10:35 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/off distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6522050 2021-11-23 11:56:36 2021-11-24 01:18:23 2021-11-24 01:49:49 0:31:26 0:24:34 0:06:52 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/dedup-io-snaps} 2
pass 6522051 2021-11-23 11:56:37 2021-11-24 01:18:33 2021-11-24 01:39:19 0:20:46 0:09:48 0:10:58 smithi master centos 8.3 rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
pass 6522052 2021-11-23 11:56:38 2021-11-24 01:19:54 2021-11-24 01:39:45 0:19:51 0:09:18 0:10:33 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 6522053 2021-11-23 11:56:39 2021-11-24 01:20:04 2021-11-24 01:41:11 0:21:07 0:10:46 0:10:21 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_adoption} 1
pass 6522054 2021-11-23 11:56:40 2021-11-24 01:20:04 2021-11-24 02:00:02 0:39:58 0:30:21 0:09:37 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream} tasks/rados_workunit_loadgen_mostlyread} 2
pass 6522055 2021-11-23 11:56:42 2021-11-24 01:20:35 2021-11-24 01:43:46 0:23:11 0:12:41 0:10:30 smithi master centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
dead 6522056 2021-11-23 11:56:43 2021-11-24 01:20:35 2021-11-24 13:29:30 12:08:55 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6522057 2021-11-23 11:56:44 2021-11-24 01:20:55 2021-11-24 02:07:04 0:46:09 0:29:41 0:16:28 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6522058 2021-11-23 11:56:45 2021-11-24 01:25:36 2021-11-24 02:07:21 0:41:45 0:30:47 0:10:58 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} 2
pass 6522059 2021-11-23 11:56:46 2021-11-24 01:25:47 2021-11-24 01:47:28 0:21:41 0:11:04 0:10:37 smithi master centos 8.3 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 2
pass 6522060 2021-11-23 11:56:47 2021-11-24 01:26:17 2021-11-24 01:58:19 0:32:02 0:25:28 0:06:34 smithi master rhel 8.4 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} 1
pass 6522061 2021-11-23 11:56:48 2021-11-24 01:27:08 2021-11-24 02:09:53 0:42:45 0:30:41 0:12:04 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6522062 2021-11-23 11:56:49 2021-11-24 01:28:28 2021-11-24 01:52:45 0:24:17 0:14:27 0:09:50 smithi master centos 8.2 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} 2
pass 6522063 2021-11-23 11:56:50 2021-11-24 01:29:19 2021-11-24 02:01:06 0:31:47 0:23:06 0:08:41 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522064 2021-11-23 11:56:51 2021-11-24 01:31:39 2021-11-24 01:53:10 0:21:31 0:11:46 0:09:45 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522065 2021-11-23 11:56:52 2021-11-24 01:31:40 2021-11-24 02:43:25 1:11:45 1:02:13 0:09:32 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} 1
fail 6522066 2021-11-23 11:56:53 2021-11-24 01:31:40 2021-11-24 01:51:42 0:20:02 0:09:16 0:10:46 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Command failed on smithi149 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5c1ba840272b9f9cc9ad704c802bf7daf2491ad5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b233f20-4cc8-11ec-8c2d-001a4aab830c -- ceph mon dump -f json'

pass 6522067 2021-11-23 11:56:54 2021-11-24 01:32:30 2021-11-24 01:55:09 0:22:39 0:12:43 0:09:56 smithi master centos 8.2 rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final} 1
fail 6522068 2021-11-23 11:56:55 2021-11-24 01:34:21 2021-11-24 01:57:38 0:23:17 0:08:22 0:14:55 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
Failure Reason:

Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-8689d5c0-4cc9-11ec-8c2d-001a4aab830c@mon.a'

pass 6522069 2021-11-23 11:56:57 2021-11-24 01:38:12 2021-11-24 02:24:13 0:46:01 0:38:17 0:07:44 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} 2
pass 6522070 2021-11-23 11:56:58 2021-11-24 01:39:02 2021-11-24 01:58:44 0:19:42 0:09:08 0:10:34 smithi master ubuntu 20.04 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 6522071 2021-11-23 11:56:59 2021-11-24 01:39:03 2021-11-24 02:01:49 0:22:46 0:11:31 0:11:15 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 6522072 2021-11-23 11:57:00 2021-11-24 01:39:53 2021-11-24 02:24:39 0:44:46 0:33:12 0:11:34 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6522073 2021-11-23 11:57:01 2021-11-24 01:41:44 2021-11-24 02:07:10 0:25:26 0:13:52 0:11:34 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} 2
pass 6522074 2021-11-23 11:57:03 2021-11-24 01:43:54 2021-11-24 02:39:06 0:55:12 0:49:38 0:05:34 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 6522075 2021-11-23 11:57:04 2021-11-24 01:43:55 2021-11-24 02:06:11 0:22:16 0:11:08 0:11:08 smithi master centos 8.stream rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6522076 2021-11-23 11:57:05 2021-11-24 01:44:45 2021-11-24 02:13:08 0:28:23 0:17:29 0:10:54 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6522077 2021-11-23 11:57:06 2021-11-24 01:44:56 2021-11-24 02:14:52 0:29:56 0:20:33 0:09:23 smithi master rhel 8.4 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 3
pass 6522078 2021-11-23 11:57:07 2021-11-24 01:47:26 2021-11-24 02:31:10 0:43:44 0:32:32 0:11:12 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6522079 2021-11-23 11:57:08 2021-11-24 01:47:27 2021-11-24 02:23:03 0:35:36 0:25:07 0:10:29 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6522080 2021-11-23 11:57:09 2021-11-24 01:47:37 2021-11-24 02:23:55 0:36:18 0:22:33 0:13:45 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 6522081 2021-11-23 11:57:10 2021-11-24 01:49:58 2021-11-24 02:32:35 0:42:37 0:30:52 0:11:45 smithi master centos 8.stream rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8.stream} thrashers/many workloads/rados_mon_workunits} 2
pass 6522082 2021-11-23 11:57:11 2021-11-24 01:51:18 2021-11-24 02:38:54 0:47:36 0:41:17 0:06:19 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} 2
pass 6522083 2021-11-23 11:57:12 2021-11-24 01:51:49 2021-11-24 02:11:18 0:19:29 0:06:41 0:12:48 smithi master ubuntu 20.04 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522084 2021-11-23 11:57:13 2021-11-24 01:52:49 2021-11-24 02:44:16 0:51:27 0:44:40 0:06:47 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 6522085 2021-11-23 11:57:14 2021-11-24 01:53:20 2021-11-24 02:23:03 0:29:43 0:19:55 0:09:48 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 6522086 2021-11-23 11:57:15 2021-11-24 01:55:11 2021-11-24 02:19:53 0:24:42 0:11:27 0:13:15 smithi master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} 2
pass 6522087 2021-11-23 11:57:16 2021-11-24 02:21:08 856 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6522088 2021-11-23 11:57:17 2021-11-24 01:57:42 2021-11-24 02:14:03 0:16:21 0:06:02 0:10:19 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522089 2021-11-23 11:57:18 2021-11-24 01:58:22 2021-11-24 02:26:05 0:27:43 0:17:18 0:10:25 smithi master centos 8.3 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6522090 2021-11-23 11:57:19 2021-11-24 01:58:53 2021-11-24 02:37:09 0:38:16 0:28:17 0:09:59 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} 2
pass 6522091 2021-11-23 11:57:20 2021-11-24 02:00:03 2021-11-24 02:26:29 0:26:26 0:16:06 0:10:20 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 6522092 2021-11-23 11:57:22 2021-11-24 02:01:14 2021-11-24 02:23:15 0:22:01 0:10:43 0:11:18 smithi master ubuntu 20.04 rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522093 2021-11-23 11:57:23 2021-11-24 02:01:14 2021-11-24 02:46:32 0:45:18 0:36:17 0:09:01 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6522094 2021-11-23 11:57:24 2021-11-24 02:01:15 2021-11-24 02:41:52 0:40:37 0:28:47 0:11:50 smithi master ubuntu 20.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 6522095 2021-11-23 11:57:25 2021-11-24 02:01:55 2021-11-24 02:42:49 0:40:54 0:27:09 0:13:45 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6522096 2021-11-23 11:57:26 2021-11-24 02:04:06 2021-11-24 02:25:08 0:21:02 0:11:10 0:09:52 smithi master centos 8.stream rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6522097 2021-11-23 11:57:27 2021-11-24 02:04:06 2021-11-24 02:31:47 0:27:41 0:15:55 0:11:46 smithi master centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8.stream} tasks/insights} 2
pass 6522098 2021-11-23 11:57:28 2021-11-24 02:06:17 2021-11-24 02:30:17 0:24:00 0:17:42 0:06:18 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 6522099 2021-11-23 11:57:29 2021-11-24 02:07:07 2021-11-24 02:31:41 0:24:34 0:13:49 0:10:45 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8.stream} thrashers/none thrashosds-health workloads/redirect} 2
pass 6522100 2021-11-23 11:57:30 2021-11-24 02:07:17 2021-11-24 02:42:21 0:35:04 0:24:37 0:10:27 smithi master centos 8.3 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 2
pass 6522101 2021-11-23 11:57:31 2021-11-24 02:07:28 2021-11-24 02:41:34 0:34:06 0:22:27 0:11:39 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522102 2021-11-23 11:57:32 2021-11-24 02:12:19 2021-11-24 02:55:55 0:43:36 0:32:13 0:11:23 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
dead 6522103 2021-11-23 11:57:33 2021-11-24 02:13:09 2021-11-24 14:22:49 12:09:40 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6522104 2021-11-23 11:57:35 2021-11-24 02:14:10 2021-11-24 02:39:01 0:24:51 0:12:39 0:12:12 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 6522105 2021-11-23 11:57:36 2021-11-24 02:15:00 2021-11-24 02:34:11 0:19:11 0:10:31 0:08:40 smithi master centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6522106 2021-11-23 11:57:37 2021-11-24 02:15:00 2021-11-24 06:46:16 4:31:16 4:22:42 0:08:34 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} 1
pass 6522107 2021-11-23 11:57:38 2021-11-24 02:15:01 2021-11-24 02:58:30 0:43:29 0:26:58 0:16:31 smithi master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 6522108 2021-11-23 11:57:39 2021-11-24 02:20:02 2021-11-24 02:45:09 0:25:07 0:14:15 0:10:52 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 6522109 2021-11-23 11:57:40 2021-11-24 02:21:12 2021-11-24 02:56:14 0:35:02 0:26:29 0:08:33 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 6522110 2021-11-23 11:57:41 2021-11-24 02:23:13 2021-11-24 02:46:55 0:23:42 0:12:33 0:11:09 smithi master ubuntu 20.04 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522111 2021-11-23 11:57:42 2021-11-24 02:23:13 2021-11-24 02:48:40 0:25:27 0:18:07 0:07:20 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 6522112 2021-11-23 11:57:43 2021-11-24 02:23:13 2021-11-24 02:51:31 0:28:18 0:17:44 0:10:34 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8.stream} tasks/repair_test} 2
pass 6522113 2021-11-23 11:57:44 2021-11-24 02:24:04 2021-11-24 03:25:29 1:01:25 0:52:13 0:09:12 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} 2
pass 6522114 2021-11-23 11:57:45 2021-11-24 02:24:14 2021-11-24 03:13:57 0:49:43 0:42:11 0:07:32 smithi master rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 6522115 2021-11-23 11:57:46 2021-11-24 02:24:45 2021-11-24 02:50:26 0:25:41 0:19:43 0:05:58 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/off distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 6522116 2021-11-23 11:57:47 2021-11-24 02:25:15 2021-11-24 03:03:18 0:38:03 0:28:22 0:09:41 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 6522117 2021-11-23 11:57:49 2021-11-24 02:26:06 2021-11-24 02:53:53 0:27:47 0:12:51 0:14:56 smithi master centos 8.stream rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} tasks/mon_recovery} 2
pass 6522118 2021-11-23 11:57:50 2021-11-24 02:30:27 2021-11-24 02:54:59 0:24:32 0:13:41 0:10:51 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6522119 2021-11-23 11:57:51 2021-11-24 02:31:17 2021-11-24 03:15:13 0:43:56 0:37:18 0:06:38 smithi master rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6522120 2021-11-23 11:57:52 2021-11-24 02:31:47 2021-11-24 03:16:54 0:45:07 0:35:13 0:09:54 smithi master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} 2
pass 6522121 2021-11-23 11:57:53 2021-11-24 02:31:48 2021-11-24 02:48:59 0:17:11 0:07:04 0:10:07 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 6522122 2021-11-23 11:57:54 2021-11-24 02:31:48 2021-11-24 02:50:19 0:18:31 0:06:48 0:11:43 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522123 2021-11-23 11:57:55 2021-11-24 02:32:38 2021-11-24 03:11:31 0:38:53 0:28:06 0:10:47 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 6522124 2021-11-23 11:57:57 2021-11-24 02:34:19 2021-11-24 03:06:50 0:32:31 0:19:32 0:12:59 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/redirect_set_object} 2
pass 6522125 2021-11-23 11:57:58 2021-11-24 02:37:20 2021-11-24 03:44:45 1:07:25 0:56:27 0:10:58 smithi master ubuntu 20.04 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522126 2021-11-23 11:57:59 2021-11-24 02:39:00 2021-11-24 03:18:23 0:39:23 0:29:36 0:09:47 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 6522127 2021-11-23 11:58:00 2021-11-24 02:39:11 2021-11-24 02:58:57 0:19:46 0:08:10 0:11:36 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
Failure Reason:

Command failed on smithi165 with status 5: 'sudo systemctl stop ceph-50f3e2c6-4cd2-11ec-8c2d-001a4aab830c@mon.a'

pass 6522128 2021-11-23 11:58:01 2021-11-24 02:41:42 2021-11-24 03:05:08 0:23:26 0:13:20 0:10:06 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 6522129 2021-11-23 11:58:02 2021-11-24 02:41:42 2021-11-24 03:09:29 0:27:47 0:16:42 0:11:05 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/module_selftest} 2
Failure Reason:

Test failure: test_module_commands (tasks.mgr.test_module_selftest.TestModuleSelftest)

pass 6522130 2021-11-23 11:58:03 2021-11-24 03:29:29 2251 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6522131 2021-11-23 11:58:04 2021-11-24 02:42:23 2021-11-24 03:01:03 0:18:40 0:08:10 0:10:30 smithi master ubuntu 20.04 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522132 2021-11-23 11:58:05 2021-11-24 02:42:53 2021-11-24 03:13:04 0:30:11 0:16:23 0:13:48 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunks-read} 2
pass 6522133 2021-11-23 11:58:06 2021-11-24 02:43:34 2021-11-24 03:29:22 0:45:48 0:36:28 0:09:20 smithi master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6522134 2021-11-23 11:58:07 2021-11-24 02:44:24 2021-11-24 03:04:40 0:20:16 0:10:13 0:10:03 smithi master centos 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 6522135 2021-11-23 11:58:08 2021-11-24 02:45:14 2021-11-24 05:26:42 2:41:28 2:16:44 0:24:44 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} 1
pass 6522136 2021-11-23 11:58:10 2021-11-24 02:46:35 2021-11-24 03:06:16 0:19:41 0:09:15 0:10:26 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} 1
pass 6522137 2021-11-23 11:58:11 2021-11-24 02:46:35 2021-11-24 03:09:32 0:22:57 0:14:16 0:08:41 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 6522138 2021-11-23 11:58:12 2021-11-24 02:46:36 2021-11-24 03:14:12 0:27:36 0:18:13 0:09:23 smithi master rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 6522139 2021-11-23 11:58:13 2021-11-24 02:48:46 2021-11-24 03:20:34 0:31:48 0:21:27 0:10:21 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} 2
pass 6522140 2021-11-23 11:58:14 2021-11-24 02:49:07 2021-11-24 03:20:04 0:30:57 0:23:30 0:07:27 smithi master rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522141 2021-11-23 11:58:15 2021-11-24 02:50:37 2021-11-24 03:30:20 0:39:43 0:29:22 0:10:21 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} 1
pass 6522142 2021-11-23 11:58:16 2021-11-24 02:50:38 2021-11-24 03:18:51 0:28:13 0:20:52 0:07:21 smithi master rhel 8.4 rados/cephadm/smoke/{0-nvme-loop agent/on distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
fail 6522143 2021-11-23 11:58:17 2021-11-24 02:51:38 2021-11-24 03:22:06 0:30:28 0:19:00 0:11:28 smithi master centos 8.2 rados/dashboard/{centos_8.2_container_tools_3.0 debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-lz4} tasks/e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1ba840272b9f9cc9ad704c802bf7daf2491ad5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 6522144 2021-11-23 11:58:19 2021-11-24 02:52:39 2021-11-24 03:21:26 0:28:47 0:20:39 0:08:08 smithi master rhel 8.4 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6522145 2021-11-23 11:58:20 2021-11-24 02:53:59 2021-11-24 03:21:26 0:27:27 0:21:47 0:05:40 smithi master rhel 8.4 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6522146 2021-11-23 11:58:21 2021-11-24 02:53:59 2021-11-24 03:16:27 0:22:28 0:11:58 0:10:30 smithi master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/scrub_test} 2
pass 6522147 2021-11-23 11:58:22 2021-11-24 02:55:00 2021-11-24 03:27:57 0:32:57 0:24:09 0:08:48 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
pass 6522148 2021-11-23 11:58:23 2021-11-24 02:55:00 2021-11-24 03:24:12 0:29:12 0:19:57 0:09:15 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 6522149 2021-11-23 11:58:24 2021-11-24 02:56:01 2021-11-24 03:40:20 0:44:19 0:32:33 0:11:46 smithi master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 6522150 2021-11-23 11:58:25 2021-11-24 02:56:21 2021-11-24 03:31:56 0:35:35 0:24:32 0:11:03 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} 2
pass 6522151 2021-11-23 11:58:26 2021-11-24 02:58:32 2021-11-24 03:20:16 0:21:44 0:11:38 0:10:06 smithi master centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6522152 2021-11-23 11:58:27 2021-11-24 02:59:02 2021-11-24 06:18:15 3:19:13 3:10:34 0:08:39 smithi master centos 8.3 rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} 1
pass 6522153 2021-11-23 11:58:28 2021-11-24 02:59:02 2021-11-24 03:37:45 0:38:43 0:26:26 0:12:17 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} 2
pass 6522154 2021-11-23 11:58:29 2021-11-24 03:00:33 2021-11-24 03:24:50 0:24:17 0:14:16 0:10:01 smithi master ubuntu 20.04 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
dead 6522155 2021-11-23 11:58:30 2021-11-24 03:00:33 2021-11-24 15:13:12 12:12:39 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6522156 2021-11-23 11:58:31 2021-11-24 03:03:24 2021-11-24 03:44:10 0:40:46 0:32:08 0:08:38 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/progress} 2
pass 6522157 2021-11-23 11:58:33 2021-11-24 03:04:45 2021-11-24 03:30:46 0:26:01 0:19:37 0:06:24 smithi master rhel 8.4 rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 6522158 2021-11-23 11:58:34 2021-11-24 03:05:15 2021-11-24 03:46:07 0:40:52 0:29:52 0:11:00 smithi master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6522159 2021-11-23 11:58:35 2021-11-24 03:06:56 2021-11-24 03:31:34 0:24:38 0:10:50 0:13:48 smithi master ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 6522160 2021-11-23 11:58:36 2021-11-24 03:09:36 2021-11-24 03:43:22 0:33:46 0:23:51 0:09:55 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6522161 2021-11-23 11:58:37 2021-11-24 03:09:37 2021-11-24 03:48:50 0:39:13 0:28:28 0:10:45 smithi master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects} 2
pass 6522162 2021-11-23 11:58:38 2021-11-24 03:11:37 2021-11-24 03:50:52 0:39:15 0:27:25 0:11:50 smithi master centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 6522163 2021-11-23 11:58:39 2021-11-24 03:13:08 2021-11-24 03:37:57 0:24:49 0:17:49 0:07:00 smithi master rhel 8.4 rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 6522164 2021-11-23 11:58:40 2021-11-24 03:13:08 2021-11-24 03:35:39 0:22:31 0:11:11 0:11:20 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
pass 6522165 2021-11-23 11:58:41 2021-11-24 03:13:59 2021-11-24 03:51:45 0:37:46 0:31:38 0:06:08 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} 2
pass 6522166 2021-11-23 11:58:42 2021-11-24 03:14:19 2021-11-24 03:47:26 0:33:07 0:25:38 0:07:29 smithi master rhel 8.4 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6522167 2021-11-23 11:58:44 2021-11-24 03:16:30 2021-11-24 04:43:13 1:26:43 1:14:46 0:11:57 smithi master ubuntu 20.04 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 2
pass 6522168 2021-11-23 11:58:45 2021-11-24 03:17:00 2021-11-24 04:20:00 1:03:00 0:50:22 0:12:38 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6522169 2021-11-23 11:58:46 2021-11-24 03:18:31 2021-11-24 03:54:28 0:35:57 0:24:54 0:11:03 smithi master centos 8.3 rados/cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6522170 2021-11-23 11:58:47 2021-11-24 03:19:01 2021-11-24 07:05:43 3:46:42 3:15:09 0:31:33 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
pass 6522171 2021-11-23 11:58:48 2021-11-24 03:19:01 2021-11-24 03:47:27 0:28:26 0:19:54 0:08:32 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 6522172 2021-11-23 11:58:49 2021-11-24 03:20:12 2021-11-24 03:59:40 0:39:28 0:28:42 0:10:46 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 6522173 2021-11-23 11:58:51 2021-11-24 03:20:12 2021-11-24 04:01:55 0:41:43 0:31:33 0:10:10 smithi master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 6522174 2021-11-23 11:58:52 2021-11-24 03:20:43 2021-11-24 03:45:29 0:24:46 0:13:24 0:11:22 smithi master ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 6522175 2021-11-23 11:58:53 2021-11-24 03:49:28 1067 smithi master centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8.stream} tasks/libcephsqlite} 2
pass 6522176 2021-11-23 11:58:54 2021-11-24 03:22:13 2021-11-24 04:10:20 0:48:07 0:40:40 0:07:27 smithi master rhel 8.4 rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 2
pass 6522177 2021-11-23 11:58:55 2021-11-24 03:22:54 2021-11-24 03:49:44 0:26:50 0:15:21 0:11:29 smithi master centos 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6522178 2021-11-23 11:58:56 2021-11-24 03:24:14 2021-11-24 03:55:37 0:31:23 0:18:56 0:12:27 smithi master ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop agent/off distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6522179 2021-11-23 11:58:57 2021-11-24 03:24:55 2021-11-24 03:49:01 0:24:06 0:13:43 0:10:23 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 6522180 2021-11-23 11:58:58 2021-11-24 03:25:35 2021-11-24 03:52:38 0:27:03 0:13:06 0:13:57 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522181 2021-11-23 11:58:59 2021-11-24 03:29:26 2021-11-24 04:05:19 0:35:53 0:26:01 0:09:52 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} 2
fail 6522182 2021-11-23 11:59:00 2021-11-24 03:29:37 2021-11-24 03:49:45 0:20:08 0:08:29 0:11:39 smithi master centos 8.3 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_latest} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Command failed on smithi133 with status 5: 'sudo systemctl stop ceph-2d21f25a-4cd9-11ec-8c2d-001a4aab830c@mon.a'

pass 6522183 2021-11-23 11:59:01 2021-11-24 03:30:27 2021-11-24 03:58:49 0:28:22 0:17:17 0:11:05 smithi master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 6522184 2021-11-23 11:59:02 2021-11-24 03:30:47 2021-11-24 04:02:40 0:31:53 0:25:12 0:06:41 smithi master rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 6522185 2021-11-23 11:59:04 2021-11-24 03:31:08 2021-11-24 04:00:48 0:29:40 0:20:27 0:09:13 smithi master centos 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} 2
pass 6522186 2021-11-23 11:59:05 2021-11-24 03:31:38 2021-11-24 04:05:27 0:33:49 0:22:50 0:10:59 smithi master centos 8.stream rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8.stream}} 2
pass 6522187 2021-11-23 11:59:06 2021-11-24 03:31:59 2021-11-24 04:21:03 0:49:04 0:32:22 0:16:42 smithi master centos 8.2 rados/cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 6522188 2021-11-23 11:59:07 2021-11-24 04:03:46 861 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 6522189 2021-11-23 11:59:08 2021-11-24 03:37:50 2021-11-24 04:07:36 0:29:46 0:17:59 0:11:47 smithi master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 6522190 2021-11-23 11:59:09 2021-11-24 03:40:21 2021-11-24 05:45:12 2:04:51 1:53:03 0:11:48 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} 2
pass 6522191 2021-11-23 11:59:10 2021-11-24 03:42:01 2021-11-24 04:19:29 0:37:28 0:26:06 0:11:22 smithi master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects} 2
pass 6522192 2021-11-23 11:59:11 2021-11-24 03:43:32 2021-11-24 04:27:25 0:43:53 0:33:46 0:10:07 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6522193 2021-11-23 11:59:12 2021-11-24 03:44:12 2021-11-24 04:24:19 0:40:07 0:33:45 0:06:22 smithi master rhel 8.4 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 6522194 2021-11-23 11:59:14 2021-11-24 03:44:53 2021-11-24 04:41:00 0:56:07 0:47:58 0:08:09 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6522195 2021-11-23 11:59:15 2021-11-24 03:45:33 2021-11-24 04:04:25 0:18:52 0:06:31 0:12:21 smithi master ubuntu 20.04 rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 6522196 2021-11-23 11:59:16 2021-11-24 03:46:14 2021-11-24 04:18:46 0:32:32 0:21:14 0:11:18 smithi master centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6522197 2021-11-23 11:59:17 2021-11-24 03:47:34 2021-11-24 06:57:29 3:09:55 3:00:02 0:09:53 smithi master ubuntu 20.04 rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 6522198 2021-11-23 11:59:18 2021-11-24 03:47:34 2021-11-24 04:14:07 0:26:33 0:15:13 0:11:20 smithi master centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 6522199 2021-11-23 11:59:19 2021-11-24 03:48:55 2021-11-24 04:27:29 0:38:34 0:27:31 0:11:03 smithi master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6522200 2021-11-23 11:59:20 2021-11-24 03:49:35 2021-11-24 04:18:26 0:28:51 0:16:13 0:12:38 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} 2
pass 6522201 2021-11-23 11:59:21 2021-11-24 03:49:46 2021-11-24 04:12:59 0:23:13 0:14:03 0:09:10 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 6522202 2021-11-23 11:59:23 2021-11-24 03:49:56 2021-11-24 04:52:38 1:02:42 0:54:32 0:08:10 smithi master rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} 2
fail 6522203 2021-11-23 11:59:24 2021-11-24 03:50:57 2021-11-24 04:08:55 0:17:58 0:06:41 0:11:17 smithi master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi067 with status 5: 'sudo systemctl stop ceph-ea19129c-4cdb-11ec-8c2d-001a4aab830c@mon.a'

pass 6522204 2021-11-23 11:59:25 2021-11-24 03:51:47 2021-11-24 04:27:58 0:36:11 0:28:36 0:07:35 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} 2
pass 6522205 2021-11-23 11:59:26 2021-11-24 03:52:48 2021-11-24 04:31:55 0:39:07 0:31:54 0:07:13 smithi master rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} 2
pass 6522206 2021-11-23 11:59:27 2021-11-24 03:52:48 2021-11-24 04:33:53 0:41:05 0:30:57 0:10:08 smithi master centos 8.stream rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8.stream}} 1
pass 6522207 2021-11-23 11:59:28 2021-11-24 03:52:48 2021-11-24 04:13:54 0:21:06 0:09:41 0:11:25 smithi master centos 8.3 rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 6522208 2021-11-23 11:59:29 2021-11-24 03:54:29 2021-11-24 04:19:51 0:25:22 0:13:42 0:11:40 smithi master centos 8.2 rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 6522209 2021-11-23 11:59:31 2021-11-24 03:55:39 2021-11-24 04:17:05 0:21:26 0:11:35 0:09:51 smithi master centos 8.stream rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6522210 2021-11-23 11:59:32 2021-11-24 03:55:40 2021-11-24 04:24:18 0:28:38 0:15:59 0:12:39 smithi master centos 8.2 rados/cephadm/smoke/{0-nvme-loop agent/on distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 6522211 2021-11-23 11:59:33 2021-11-24 03:58:51 2021-11-24 04:48:32 0:49:41 0:42:18 0:07:23 smithi master rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 6522212 2021-11-23 11:59:34 2021-11-24 03:59:41 2021-11-24 04:20:57 0:21:16 0:10:58 0:10:18 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 6522213 2021-11-23 11:59:35 2021-11-24 03:59:41 2021-11-24 04:22:19 0:22:38 0:10:50 0:11:48 smithi master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/workunits} 2
pass 6522214 2021-11-23 11:59:36 2021-11-24 04:00:52 2021-11-24 04:27:35 0:26:43 0:16:23 0:10:20 smithi master centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} 2
dead 6522215 2021-11-23 11:59:37 2021-11-24 04:02:03 2021-11-24 16:11:34 12:09:31 smithi master centos 8.3 rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6522216 2021-11-23 11:59:38 2021-11-24 04:02:43 2021-11-24 04:24:45 0:22:02 0:11:00 0:11:02 smithi master centos 8.stream rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8.stream}} 1
pass 6522217 2021-11-23 11:59:39 2021-11-24 04:03:53 2021-11-24 04:24:47 0:20:54 0:09:14 0:11:40 smithi master ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 6522218 2021-11-23 11:59:41 2021-11-24 04:04:34 2021-11-24 04:30:00 0:25:26 0:18:25 0:07:01 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 6522219 2021-11-23 11:59:42 2021-11-24 04:04:34 2021-11-24 04:29:07 0:24:33 0:12:50 0:11:43 smithi master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6522220 2021-11-23 11:59:43 2021-11-24 04:05:35 2021-11-24 04:49:13 0:43:38 0:31:17 0:12:21 smithi master centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8.stream}} 1
pass 6522221 2021-11-23 11:59:44 2021-11-24 04:07:46 2021-11-24 04:57:54 0:50:08 0:38:37 0:11:31 smithi master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 6522222 2021-11-23 11:59:45 2021-11-24 04:08:26 2021-11-24 04:39:57 0:31:31 0:20:33 0:10:58 smithi master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} 2
pass 6522223 2021-11-23 11:59:46 2021-11-24 04:08:57 2021-11-24 04:53:34 0:44:37 0:37:03 0:07:34 smithi master rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6522224 2021-11-23 11:59:48 2021-11-24 04:10:27 2021-11-24 04:37:54 0:27:27 0:17:25 0:10:02 smithi master ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 6522225 2021-11-23 11:59:49 2021-11-24 04:10:27 2021-11-24 04:40:21 0:29:54 0:22:00 0:07:54 smithi master rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 6522226 2021-11-23 11:59:50 2021-11-24 04:11:18 2021-11-24 04:55:36 0:44:18 0:36:10 0:08:08 smithi master rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 6522227 2021-11-23 11:59:51 2021-11-24 04:12:08 2021-11-24 04:41:12 0:29:04 0:23:19 0:05:45 smithi master rhel 8.4 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6522228 2021-11-23 11:59:52 2021-11-24 04:12:09 2021-11-24 04:36:22 0:24:13 0:13:46 0:10:27 smithi master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} 2
pass 6522229 2021-11-23 11:59:53 2021-11-24 04:13:09 2021-11-24 04:37:21 0:24:12 0:14:03 0:10:09 smithi master centos 8.3 rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2