Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7231753 2023-04-04 21:20:27 2023-04-05 06:42:05 2023-04-05 07:11:35 0:29:30 0:22:05 0:07:25 smithi main rhel 8.4 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7231754 2023-04-04 21:20:28 2023-04-05 06:42:06 2023-04-05 08:22:08 1:40:02 1:30:28 0:09:34 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 7231755 2023-04-04 21:20:29 2023-04-05 06:42:06 2023-04-05 07:07:41 0:25:35 0:18:11 0:07:24 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
dead 7231756 2023-04-04 21:20:29 2023-04-05 06:42:07 2023-04-05 18:54:27 12:12:20 smithi main ubuntu 20.04 rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

hit max job timeout

pass 7231757 2023-04-04 21:20:30 2023-04-05 06:42:07 2023-04-05 08:35:07 1:53:00 1:21:10 0:31:50 smithi main centos 8.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 7231758 2023-04-04 21:20:31 2023-04-05 06:43:28 2023-04-05 07:05:32 0:22:04 0:11:56 0:10:08 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7231759 2023-04-04 21:20:32 2023-04-05 06:43:28 2023-04-05 08:30:43 1:47:15 1:18:47 0:28:28 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_pids_limit} 1
pass 7231760 2023-04-04 21:20:33 2023-04-05 06:43:28 2023-04-05 07:17:36 0:34:08 0:24:33 0:09:35 smithi main ubuntu 20.04 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231761 2023-04-04 21:20:33 2023-04-05 06:43:39 2023-04-05 07:08:16 0:24:37 0:16:47 0:07:50 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7231762 2023-04-04 21:20:34 2023-04-05 06:44:59 2023-04-05 08:09:07 1:24:08 1:08:23 0:15:45 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} 2
pass 7231763 2023-04-04 21:20:35 2023-04-05 06:49:20 2023-04-05 08:54:08 2:04:48 1:32:57 0:31:51 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7231764 2023-04-04 21:20:36 2023-04-05 06:50:51 2023-04-05 07:33:26 0:42:35 0:31:12 0:11:23 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7231765 2023-04-04 21:20:37 2023-04-05 06:51:31 2023-04-05 07:10:39 0:19:08 0:12:21 0:06:47 smithi main rhel 8.4 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7231766 2023-04-04 21:20:37 2023-04-05 06:51:32 2023-04-05 07:43:43 0:52:11 0:40:35 0:11:36 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 7231767 2023-04-04 21:20:38 2023-04-05 06:51:32 2023-04-05 07:28:31 0:36:59 0:26:20 0:10:39 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 7231768 2023-04-04 21:20:39 2023-04-05 06:52:13 2023-04-05 08:37:58 1:45:45 1:16:10 0:29:35 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/prometheus} 2
pass 7231769 2023-04-04 21:20:40 2023-04-05 06:53:03 2023-04-05 09:02:11 2:09:08 1:39:31 0:29:37 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} 2
pass 7231770 2023-04-04 21:20:41 2023-04-05 06:53:04 2023-04-05 07:30:01 0:36:57 0:28:21 0:08:36 smithi main rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7231771 2023-04-04 21:20:42 2023-04-05 06:54:54 2023-04-05 07:24:03 0:29:09 0:17:41 0:11:28 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7231772 2023-04-04 21:20:42 2023-04-05 06:55:55 2023-04-05 07:15:29 0:19:34 0:09:33 0:10:01 smithi main ubuntu 20.04 rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231773 2023-04-04 21:20:43 2023-04-05 06:55:55 2023-04-05 07:42:14 0:46:19 0:35:33 0:10:46 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 7231774 2023-04-04 21:20:44 2023-04-05 06:56:46 2023-04-05 07:20:03 0:23:17 0:15:52 0:07:25 smithi main rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7231775 2023-04-04 21:20:45 2023-04-05 06:56:46 2023-04-05 08:55:52 1:59:06 1:28:21 0:30:45 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
pass 7231776 2023-04-04 21:20:46 2023-04-05 06:58:47 2023-04-05 09:05:11 2:06:24 1:34:56 0:31:28 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7231777 2023-04-04 21:20:46 2023-04-05 06:59:17 2023-04-05 07:26:55 0:27:38 0:21:26 0:06:12 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} 2
pass 7231778 2023-04-04 21:20:47 2023-04-05 06:59:37 2023-04-05 07:32:00 0:32:23 0:21:28 0:10:55 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
fail 7231779 2023-04-04 21:20:48 2023-04-05 07:00:38 2023-04-05 07:20:30 0:19:52 0:06:04 0:13:48 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi097 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7231780 2023-04-04 21:20:49 2023-04-05 07:04:29 2023-04-05 07:29:50 0:25:21 0:16:28 0:08:53 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7231781 2023-04-04 21:20:50 2023-04-05 07:06:09 2023-04-05 09:07:25 2:01:16 1:30:53 0:30:23 smithi main centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7231782 2023-04-04 21:20:50 2023-04-05 07:06:10 2023-04-05 08:59:09 1:52:59 1:21:17 0:31:42 smithi main centos 8.stream rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 2
pass 7231783 2023-04-04 21:20:51 2023-04-05 07:07:50 2023-04-05 09:23:52 2:16:02 1:45:39 0:30:23 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7231784 2023-04-04 21:20:52 2023-04-05 07:08:21 2023-04-05 07:46:00 0:37:39 0:28:05 0:09:34 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7231785 2023-04-04 21:20:53 2023-04-05 07:10:52 2023-04-05 07:54:05 0:43:13 0:36:58 0:06:15 smithi main rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7231786 2023-04-04 21:20:54 2023-04-05 07:10:52 2023-04-05 08:58:08 1:47:16 1:19:06 0:28:10 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} 1
pass 7231787 2023-04-04 21:20:55 2023-04-05 07:11:32 2023-04-05 07:35:47 0:24:15 0:13:43 0:10:32 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} 2
pass 7231788 2023-04-04 21:20:55 2023-04-05 07:11:43 2023-04-05 07:40:52 0:29:09 0:18:03 0:11:06 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7231789 2023-04-04 21:20:56 2023-04-05 07:13:14 2023-04-05 07:35:41 0:22:27 0:10:45 0:11:42 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
dead 7231790 2023-04-04 21:20:57 2023-04-05 07:13:34 2023-04-05 19:23:00 12:09:26 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 7231791 2023-04-04 21:20:58 2023-04-05 07:14:14 2023-04-05 07:37:34 0:23:20 0:16:00 0:07:20 smithi main rhel 8.4 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7231792 2023-04-04 21:20:59 2023-04-05 07:14:15 2023-04-05 07:40:21 0:26:06 0:19:38 0:06:28 smithi main rhel 8.4 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 7231793 2023-04-04 21:21:00 2023-04-05 07:15:05 2023-04-05 07:49:35 0:34:30 0:23:01 0:11:29 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7231794 2023-04-04 21:21:00 2023-04-05 07:15:36 2023-04-05 08:23:44 1:08:08 0:54:14 0:13:54 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 7231795 2023-04-04 21:21:01 2023-04-05 07:20:07 2023-04-05 08:03:11 0:43:04 0:31:52 0:11:12 smithi main ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231796 2023-04-04 21:21:02 2023-04-05 07:20:07 2023-04-05 07:54:05 0:33:58 0:23:29 0:10:29 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 7231797 2023-04-04 21:21:03 2023-04-05 07:20:07 2023-04-05 08:23:24 1:03:17 0:29:59 0:33:18 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7231798 2023-04-04 21:21:04 2023-04-05 07:24:08 2023-04-05 07:47:16 0:23:08 0:15:52 0:07:16 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} 2
pass 7231799 2023-04-04 21:21:05 2023-04-05 07:24:09 2023-04-05 08:49:12 1:25:03 0:55:40 0:29:23 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
fail 7231800 2023-04-04 21:21:05 2023-04-05 07:24:09 2023-04-05 07:52:24 0:28:15 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi006 with status 1: 'sudo yum install -y kernel'

pass 7231801 2023-04-04 21:21:06 2023-04-05 07:27:00 2023-04-05 09:32:30 2:05:30 1:32:43 0:32:47 smithi main centos 8.stream rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} 3
pass 7231802 2023-04-04 21:21:07 2023-04-05 07:28:40 2023-04-05 07:47:44 0:19:04 0:12:04 0:07:00 smithi main rhel 8.4 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
pass 7231803 2023-04-04 21:21:08 2023-04-05 07:28:51 2023-04-05 07:59:49 0:30:58 0:19:36 0:11:22 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7231804 2023-04-04 21:21:09 2023-04-05 07:29:51 2023-04-05 10:12:00 2:42:09 2:11:01 0:31:08 smithi main centos 8.stream rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard} 2
pass 7231805 2023-04-04 21:21:10 2023-04-05 07:30:12 2023-04-05 07:50:11 0:19:59 0:09:13 0:10:46 smithi main ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 7231806 2023-04-04 21:21:10 2023-04-05 07:30:12 2023-04-05 07:53:48 0:23:36 0:17:23 0:06:13 smithi main rhel 8.4 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
pass 7231807 2023-04-04 21:21:11 2023-04-05 07:30:23 2023-04-05 09:19:37 1:49:14 1:19:53 0:29:21 smithi main centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7231808 2023-04-04 21:21:12 2023-04-05 07:30:23 2023-04-05 09:13:42 1:43:19 1:14:45 0:28:34 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} 1
fail 7231809 2023-04-04 21:21:13 2023-04-05 07:30:33 2023-04-05 07:50:03 0:19:30 smithi main ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} 4
Failure Reason:

Cannot connect to remote host smithi087

pass 7231810 2023-04-04 21:21:14 2023-04-05 07:32:14 2023-04-05 09:22:40 1:50:26 1:20:44 0:29:42 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
fail 7231811 2023-04-04 21:21:14 2023-04-05 07:33:35 2023-04-05 09:49:16 2:15:41 1:45:08 0:30:33 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c985a09c75a9cc73e9774aadc248a51b2319e16 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7231812 2023-04-04 21:21:15 2023-04-05 07:33:55 2023-04-05 09:41:25 2:07:30 1:35:19 0:32:11 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7231813 2023-04-04 21:21:16 2023-04-05 07:35:26 2023-04-05 08:11:55 0:36:29 0:26:29 0:10:00 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 7231814 2023-04-04 21:21:17 2023-04-05 07:35:46 2023-04-05 07:55:13 0:19:27 0:13:09 0:06:18 smithi main rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 7231815 2023-04-04 21:21:18 2023-04-05 07:35:56 2023-04-05 09:38:25 2:02:29 1:29:44 0:32:45 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} 2
dead 7231816 2023-04-04 21:21:19 2023-04-05 07:37:37 2023-04-05 19:47:50 12:10:13 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 7231817 2023-04-04 21:21:19 2023-04-05 07:37:37 2023-04-05 08:06:35 0:28:58 0:15:50 0:13:08 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} 2
pass 7231818 2023-04-04 21:21:20 2023-04-05 07:40:18 2023-04-05 08:06:42 0:26:24 0:12:55 0:13:29 smithi main ubuntu 20.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} 2
pass 7231819 2023-04-04 21:21:21 2023-04-05 07:40:59 2023-04-05 08:03:18 0:22:19 0:11:28 0:10:51 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7231820 2023-04-04 21:21:22 2023-04-05 07:41:09 2023-04-05 09:37:39 1:56:30 1:25:30 0:31:00 smithi main centos 8.stream rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
pass 7231821 2023-04-04 21:21:23 2023-04-05 07:42:20 2023-04-05 08:10:54 0:28:34 0:20:10 0:08:24 smithi main rhel 8.4 rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} 3
pass 7231822 2023-04-04 21:21:23 2023-04-05 09:25:13 4346 smithi main centos 8.stream rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7231823 2023-04-04 21:21:24 2023-04-05 07:43:50 2023-04-05 08:08:29 0:24:39 0:15:24 0:09:15 smithi main rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7231824 2023-04-04 21:21:25 2023-04-05 07:47:21 2023-04-05 08:49:03 1:01:42 0:31:11 0:30:31 smithi main centos 8.stream rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} 2
pass 7231825 2023-04-04 21:21:26 2023-04-05 07:47:52 2023-04-05 08:08:41 0:20:49 0:09:00 0:11:49 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} 1
pass 7231826 2023-04-04 21:21:27 2023-04-05 07:48:42 2023-04-05 08:50:56 1:02:14 0:31:53 0:30:21 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7231827 2023-04-04 21:21:27 2023-04-05 07:49:43 2023-04-05 08:47:48 0:58:05 0:28:05 0:30:00 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7231828 2023-04-04 21:21:28 2023-04-05 07:50:13 2023-04-05 08:23:12 0:32:59 0:26:15 0:06:44 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} 2
pass 7231829 2023-04-04 21:21:29 2023-04-05 07:50:14 2023-04-05 09:48:00 1:57:46 1:28:31 0:29:15 smithi main centos 8.stream rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 7231830 2023-04-04 21:21:30 2023-04-05 07:50:14 2023-04-05 10:03:38 2:13:24 1:41:10 0:32:14 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7231831 2023-04-04 21:21:31 2023-04-05 07:52:35 2023-04-05 08:28:22 0:35:47 0:26:32 0:09:15 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7231832 2023-04-04 21:21:32 2023-04-05 07:52:35 2023-04-05 09:05:14 1:12:39 0:42:05 0:30:34 smithi main centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7231833 2023-04-04 21:21:32 2023-04-05 07:53:56 2023-04-05 08:30:10 0:36:14 0:25:27 0:10:47 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7231834 2023-04-04 21:21:33 2023-04-05 07:54:06 2023-04-05 09:37:11 1:43:05 1:14:02 0:29:03 smithi main centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7231835 2023-04-04 21:21:34 2023-04-05 07:54:06 2023-04-05 08:40:31 0:46:25 0:39:08 0:07:17 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7231836 2023-04-04 21:21:35 2023-04-05 07:55:17 2023-04-05 08:21:04 0:25:47 0:17:04 0:08:43 smithi main rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} 2
pass 7231837 2023-04-04 21:21:35 2023-04-05 07:57:07 2023-04-05 09:44:14 1:47:07 1:18:17 0:28:50 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} 1
pass 7231838 2023-04-04 21:21:36 2023-04-05 07:57:08 2023-04-05 08:31:56 0:34:48 0:24:23 0:10:25 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7231839 2023-04-04 21:21:37 2023-04-05 07:57:38 2023-04-05 08:42:47 0:45:09 0:33:53 0:11:16 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
pass 7231840 2023-04-04 21:21:38 2023-04-05 07:59:09 2023-04-05 10:00:16 2:01:07 1:29:11 0:31:56 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} 2
pass 7231841 2023-04-04 21:21:39 2023-04-05 07:59:49 2023-04-05 08:24:54 0:25:05 0:18:10 0:06:55 smithi main rhel 8.4 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7231842 2023-04-04 21:21:39 2023-04-05 07:59:50 2023-04-05 08:26:32 0:26:42 0:18:28 0:08:14 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7231843 2023-04-04 21:21:40 2023-04-05 08:01:30 2023-04-05 09:50:35 1:49:05 1:18:22 0:30:43 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
pass 7231844 2023-04-04 21:21:41 2023-04-05 08:03:21 2023-04-05 08:23:24 0:20:03 0:09:03 0:11:00 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231845 2023-04-04 21:21:42 2023-04-05 08:03:21 2023-04-05 08:24:29 0:21:08 0:15:41 0:05:27 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7231846 2023-04-04 21:21:43 2023-04-05 08:03:22 2023-04-05 08:22:48 0:19:26 0:12:10 0:07:16 smithi main rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
pass 7231847 2023-04-04 21:21:43 2023-04-05 08:03:32 2023-04-05 08:31:35 0:28:03 0:18:16 0:09:47 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 7231848 2023-04-04 21:21:44 2023-04-05 08:06:23 2023-04-05 09:05:42 0:59:19 0:53:33 0:05:46 smithi main rhel 8.4 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 7231849 2023-04-04 21:21:45 2023-04-05 08:06:23 2023-04-05 08:38:10 0:31:47 0:24:19 0:07:28 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
pass 7231850 2023-04-04 21:21:46 2023-04-05 08:06:44 2023-04-05 08:54:15 0:47:31 0:35:05 0:12:26 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 7231851 2023-04-04 21:21:46 2023-04-05 08:08:34 2023-04-05 08:30:19 0:21:45 0:09:12 0:12:33 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} 1
pass 7231852 2023-04-04 21:21:47 2023-04-05 08:08:35 2023-04-05 10:12:09 2:03:34 1:33:22 0:30:12 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7231854 2023-04-04 21:21:48 2023-04-05 08:09:01 2023-04-05 09:56:08 1:47:07 1:15:29 0:31:38 smithi main centos 8.stream rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/crash} 2
pass 7231856 2023-04-04 21:21:49 2023-04-05 08:11:02 2023-04-05 08:49:55 0:38:53 0:33:18 0:05:35 smithi main rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} 2
pass 7231858 2023-04-04 21:21:50 2023-04-05 08:11:12 2023-04-05 08:36:15 0:25:03 0:12:47 0:12:16 smithi main ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
fail 7231860 2023-04-04 21:21:51 2023-04-05 08:12:44 2023-04-05 08:37:52 0:25:08 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

Command failed on smithi193 with status 1: 'sudo yum install -y kernel'

pass 7231862 2023-04-04 21:21:51 2023-04-05 08:14:25 2023-04-05 08:44:29 0:30:04 0:16:05 0:13:59 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7231864 2023-04-04 21:21:52 2023-04-05 08:31:43 2023-04-05 09:25:18 0:53:35 0:24:24 0:29:11 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} 1
pass 7231866 2023-04-04 21:21:53 2023-04-05 08:33:14 2023-04-05 10:22:49 1:49:35 1:18:28 0:31:07 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7231868 2023-04-04 21:21:54 2023-04-05 08:35:15 2023-04-05 10:16:10 1:40:55 1:12:17 0:28:38 smithi main centos 8.stream rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7231870 2023-04-04 21:21:55 2023-04-05 08:36:16 2023-04-05 10:58:54 2:22:38 1:51:50 0:30:48 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7231872 2023-04-04 21:21:55 2023-04-05 08:37:57 2023-04-05 08:57:59 0:20:02 0:09:11 0:10:51 smithi main ubuntu 20.04 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 2
pass 7231874 2023-04-04 21:21:56 2023-04-05 08:38:18 2023-04-05 09:20:52 0:42:34 0:29:14 0:13:20 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7231876 2023-04-04 21:21:57 2023-04-05 08:40:59 2023-04-05 09:20:26 0:39:27 0:28:58 0:10:29 smithi main ubuntu 18.04 rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7231878 2023-04-04 21:21:58 2023-04-05 08:43:30 2023-04-05 09:26:53 0:43:23 0:31:06 0:12:17 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7231880 2023-04-04 21:21:59 2023-04-05 08:47:51 2023-04-05 09:14:20 0:26:29 0:17:50 0:08:39 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
fail 7231882 2023-04-04 21:21:59 2023-04-05 08:49:22 2023-04-05 09:07:38 0:18:16 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Cannot connect to remote host smithi077

pass 7231884 2023-04-04 21:22:00 2023-04-05 08:50:03 2023-04-05 10:16:32 1:26:29 0:55:57 0:30:32 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} 2
pass 7231886 2023-04-04 21:22:01 2023-04-05 08:51:44 2023-04-05 11:02:48 2:11:04 1:41:58 0:29:06 smithi main centos 8.stream rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 7231888 2023-04-04 21:22:02 2023-04-05 08:54:15 2023-04-05 10:37:19 1:43:04 1:14:33 0:28:31 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_pids_limit} 1
pass 7231890 2023-04-04 21:22:03 2023-04-05 08:54:16 2023-04-05 09:13:08 0:18:52 0:12:22 0:06:30 smithi main rhel 8.4 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7231892 2023-04-04 21:22:04 2023-04-05 08:55:57 2023-04-05 10:43:08 1:47:11 1:16:54 0:30:17 smithi main centos 8.stream rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 7231894 2023-04-04 21:22:04 2023-04-05 08:58:08 2023-04-05 09:39:07 0:40:59 0:34:56 0:06:03 smithi main rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
pass 7231896 2023-04-04 21:22:05 2023-04-05 08:59:19 2023-04-05 10:41:50 1:42:31 1:30:36 0:11:55 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 7231898 2023-04-04 21:22:06 2023-04-05 09:05:20 2023-04-05 09:42:00 0:36:40 0:24:25 0:12:15 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
fail 7231900 2023-04-04 21:22:07 2023-04-05 09:05:21 2023-04-05 09:22:37 0:17:16 0:10:37 0:06:39 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

Command failed on smithi195 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:5c985a09c75a9cc73e9774aadc248a51b2319e16 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c53d4b2a-d392-11ed-9aff-001a4aab830c -- ceph mon dump -f json'

fail 7231902 2023-04-04 21:22:08 2023-04-05 09:07:32 2023-04-05 09:34:46 0:27:14 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi078 with status 1: 'sudo yum install -y kernel'

pass 7231904 2023-04-04 21:22:08 2023-04-05 09:07:43 2023-04-05 10:11:44 1:04:01 0:52:43 0:11:18 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7231906 2023-04-04 21:22:09 2023-04-05 09:10:44 2023-04-05 09:30:28 0:19:44 0:08:56 0:10:48 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} 1
pass 7231908 2023-04-04 21:22:10 2023-04-05 09:11:25 2023-04-05 09:51:22 0:39:57 0:27:13 0:12:44 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7231910 2023-04-04 21:22:11 2023-04-05 09:13:46 2023-04-05 09:48:23 0:34:37 0:23:28 0:11:09 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7231912 2023-04-04 21:22:12 2023-04-05 09:14:47 2023-04-05 11:02:52 1:48:05 1:13:22 0:34:43 smithi main centos 8.stream rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
pass 7231914 2023-04-04 21:22:12 2023-04-05 09:19:38 2023-04-05 09:39:06 0:19:28 0:12:37 0:06:51 smithi main rhel 8.4 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7231916 2023-04-04 21:22:13 2023-04-05 09:20:29 2023-04-05 11:17:55 1:57:26 1:28:03 0:29:23 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
pass 7231918 2023-04-04 21:22:14 2023-04-05 09:21:00 2023-04-05 09:58:09 0:37:09 0:26:17 0:10:52 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
pass 7231920 2023-04-04 21:22:15 2023-04-05 09:22:31 2023-04-05 09:54:09 0:31:38 0:21:29 0:10:09 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 7231923 2023-04-04 21:22:16 2023-04-05 09:42:06 492 smithi main ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
pass 7231925 2023-04-04 21:22:17 2023-04-05 10:14:30 2282 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 7231926 2023-04-04 21:22:17 2023-04-05 09:58:21 1357 smithi main ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 7231929 2023-04-04 21:22:18 2023-04-05 09:27:45 2023-04-05 10:43:11 1:15:26 0:43:14 0:32:12 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7231931 2023-04-04 21:22:19 2023-04-05 09:29:46 2023-04-05 09:56:11 0:26:25 0:16:31 0:09:54 smithi main ubuntu 20.04 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231933 2023-04-04 21:22:20 2023-04-05 09:32:37 2023-04-05 10:34:20 1:01:43 0:31:38 0:30:05 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7231935 2023-04-04 21:22:21 2023-04-05 09:32:38 2023-04-05 09:54:16 0:21:38 0:14:00 0:07:38 smithi main rhel 8.4 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7231937 2023-04-04 21:22:22 2023-04-05 11:38:55 5733 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7231939 2023-04-04 21:22:22 2023-04-05 09:34:50 2023-04-05 11:32:49 1:57:59 1:24:43 0:33:16 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} 2
pass 7231940 2023-04-04 21:22:23 2023-04-05 09:37:40 2023-04-05 10:04:22 0:26:42 0:13:03 0:13:39 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 7231942 2023-04-04 21:22:24 2023-04-05 09:38:42 2023-04-05 11:50:28 2:11:46 1:41:44 0:30:02 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} 2
pass 7231943 2023-04-04 21:22:25 2023-04-05 09:39:12 2023-04-05 11:30:57 1:51:45 1:20:23 0:31:22 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7231944 2023-04-04 21:22:26 2023-04-05 09:41:33 2023-04-05 10:07:09 0:25:36 0:12:15 0:13:21 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7231945 2023-04-04 21:22:27 2023-04-05 09:42:13 2023-04-05 10:35:50 0:53:37 0:41:33 0:12:04 smithi main ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7231946 2023-04-04 21:22:27 2023-04-05 09:43:44 2023-04-05 10:02:22 0:18:38 0:10:39 0:07:59 smithi main rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
pass 7231947 2023-04-04 21:22:28 2023-04-05 09:44:24 2023-04-05 11:49:06 2:04:42 1:32:26 0:32:16 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 7231948 2023-04-04 21:22:29 2023-04-05 09:45:25 2023-04-05 11:31:49 1:46:24 1:16:47 0:29:37 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} 1
pass 7231949 2023-04-04 21:22:30 2023-04-05 09:46:35 2023-04-05 10:04:38 0:18:03 0:08:41 0:09:22 smithi main ubuntu 20.04 rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} 1
pass 7231950 2023-04-04 21:22:30 2023-04-05 09:46:46 2023-04-05 11:05:27 1:18:41 1:07:00 0:11:41 smithi main ubuntu 20.04 rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 2
pass 7231951 2023-04-04 21:22:31 2023-04-05 09:47:26 2023-04-05 11:47:37 2:00:11 1:29:56 0:30:15 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7231952 2023-04-04 21:22:32 2023-04-05 09:48:07 2023-04-05 10:11:29 0:23:22 0:11:17 0:12:05 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7231953 2023-04-04 21:22:33 2023-04-05 09:48:27 2023-04-05 10:10:26 0:21:59 0:14:49 0:07:10 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7231954 2023-04-04 21:22:34 2023-04-05 09:49:18 2023-04-05 10:08:26 0:19:08 0:13:07 0:06:01 smithi main rhel 8.4 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7231955 2023-04-04 21:22:35 2023-04-05 09:49:18 2023-04-05 10:23:16 0:33:58 0:23:18 0:10:40 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 7231956 2023-04-04 21:22:35 2023-04-05 09:49:19 2023-04-05 11:48:04 1:58:45 1:28:35 0:30:10 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 7231957 2023-04-04 21:22:36 2023-04-05 09:50:39 2023-04-05 10:11:23 0:20:44 0:08:56 0:11:48 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} 1
pass 7231958 2023-04-04 21:22:37 2023-04-05 09:51:30 2023-04-05 10:13:07 0:21:37 0:15:36 0:06:01 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7231959 2023-04-04 21:22:38 2023-04-05 09:52:00 2023-04-05 11:56:33 2:04:33 1:33:28 0:31:05 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} 5
fail 7231960 2023-04-04 21:22:39 2023-04-05 09:53:01 2023-04-05 10:11:58 0:18:57 smithi main ubuntu 18.04 rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} 1
Failure Reason:

Cannot connect to remote host smithi114

pass 7231961 2023-04-04 21:22:39 2023-04-05 09:54:11 2023-04-05 12:12:45 2:18:34 2:08:26 0:10:08 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
pass 7231962 2023-04-04 21:22:40 2023-04-05 09:54:22 2023-04-05 10:40:12 0:45:50 0:34:22 0:11:28 smithi main ubuntu 20.04 rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 2
pass 7231963 2023-04-04 21:22:41 2023-04-05 09:56:02 2023-04-05 10:59:08 1:03:06 0:51:07 0:11:59 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 7231964 2023-04-04 21:22:42 2023-04-05 09:56:13 2023-04-05 10:21:21 0:25:08 0:15:55 0:09:13 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7231965 2023-04-04 21:22:43 2023-04-05 09:58:13 2023-04-05 11:39:12 1:40:59 1:13:00 0:27:59 smithi main centos 8.stream rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
fail 7231966 2023-04-04 21:22:43 2023-04-05 09:58:14 2023-04-05 10:16:21 0:18:07 0:07:35 0:10:32 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5c985a09c75a9cc73e9774aadc248a51b2319e16

pass 7231967 2023-04-04 21:22:44 2023-04-05 09:58:24 2023-04-05 12:56:34 2:58:10 2:27:02 0:31:08 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
pass 7231968 2023-04-04 21:22:45 2023-04-05 09:59:05 2023-04-05 11:59:20 2:00:15 1:29:18 0:30:57 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 7231969 2023-04-04 21:22:46 2023-04-05 10:00:25 2023-04-05 10:26:13 0:25:48 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi129 with status 1: 'sudo yum install -y kernel'

pass 7231970 2023-04-04 21:22:47 2023-04-05 10:02:26 2023-04-05 10:34:55 0:32:29 0:24:06 0:08:23 smithi main rhel 8.4 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 2
pass 7231971 2023-04-04 21:22:47 2023-04-05 10:03:46 2023-04-05 11:07:23 1:03:37 0:31:43 0:31:54 smithi main centos 8.stream rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} 2
pass 7231972 2023-04-04 21:22:48 2023-04-05 10:04:27 2023-04-05 11:03:52 0:59:25 0:29:34 0:29:51 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
pass 7231973 2023-04-04 21:22:49 2023-04-05 10:04:47 2023-04-05 10:28:34 0:23:47 0:15:17 0:08:30 smithi main rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} 1
pass 7231974 2023-04-04 21:22:50 2023-04-05 10:07:18 2023-04-05 12:19:23 2:12:05 1:40:42 0:31:23 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7231975 2023-04-04 21:22:51 2023-04-05 10:07:18 2023-04-05 10:35:47 0:28:29 0:18:08 0:10:21 smithi main rhel 8.4 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
pass 7231976 2023-04-04 21:22:51 2023-04-05 10:10:29 2023-04-05 10:34:04 0:23:35 0:13:02 0:10:33 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7231977 2023-04-04 21:22:52 2023-04-05 10:10:29 2023-04-05 11:50:44 1:40:15 1:09:20 0:30:55 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
pass 7231978 2023-04-04 21:22:53 2023-04-05 10:11:30 2023-04-05 10:54:43 0:43:13 0:32:30 0:10:43 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7231979 2023-04-04 21:22:54 2023-04-05 10:11:30 2023-04-05 10:37:57 0:26:27 0:15:47 0:10:40 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
pass 7231980 2023-04-04 21:22:55 2023-04-05 10:11:51 2023-04-05 12:11:45 1:59:54 1:30:31 0:29:23 smithi main centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7231981 2023-04-04 21:22:55 2023-04-05 10:12:01 2023-04-05 12:14:00 2:01:59 1:31:05 0:30:54 smithi main centos 8.stream rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 7231982 2023-04-04 21:22:56 2023-04-05 10:12:11 2023-04-05 11:55:41 1:43:30 1:13:59 0:29:31 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} 1
pass 7231983 2023-04-04 21:22:57 2023-04-05 10:12:12 2023-04-05 12:14:28 2:02:16 1:31:25 0:30:51 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
pass 7231984 2023-04-04 21:22:58 2023-04-05 10:13:12 2023-04-05 10:34:31 0:21:19 0:08:49 0:12:30 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} 1
pass 7231985 2023-04-04 21:22:59 2023-04-05 10:14:33 2023-04-05 10:40:12 0:25:39 0:12:42 0:12:57 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} 2
pass 7231986 2023-04-04 21:23:00 2023-04-05 10:14:33 2023-04-05 10:44:15 0:29:42 0:17:01 0:12:41 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} 2
pass 7231987 2023-04-04 21:23:01 2023-04-05 10:16:24 2023-04-05 10:42:41 0:26:17 0:16:10 0:10:07 smithi main rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7231988 2023-04-04 21:23:01 2023-04-05 10:19:25 2023-04-05 10:44:59 0:25:34 0:16:34 0:09:00 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7231989 2023-04-04 21:23:02 2023-04-05 10:19:25 2023-04-05 10:40:41 0:21:16 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Cannot connect to remote host smithi141

pass 7231990 2023-04-04 21:23:03 2023-04-05 10:22:56 2023-04-05 10:48:04 0:25:08 0:17:56 0:07:12 smithi main rhel 8.4 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7231991 2023-04-04 21:23:04 2023-04-05 10:22:56 2023-04-05 10:52:24 0:29:28 0:23:21 0:06:07 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
fail 7231992 2023-04-04 21:23:05 2023-04-05 10:22:57 2023-04-05 10:41:07 0:18:10 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Cannot connect to remote host smithi045

pass 7231993 2023-04-04 21:23:05 2023-04-05 10:23:17 2023-04-05 12:04:28 1:41:11 1:12:51 0:28:20 smithi main centos 8.stream rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 1
fail 7231994 2023-04-04 21:23:06 2023-04-05 10:23:27 2023-04-05 12:20:08 1:56:41 1:22:31 0:34:10 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi157.front.sepia.ceph.com: ['type=AVC msg=audit(1680696989.203:19183): avc: denied { ioctl } for pid=156875 comm="iptables" path="/var/lib/containers/storage/overlay/8f2b428fa42adcf0bcddfb47c2f33c49aa40eb8c0c4f51916180e2ed7f48c3b3/merged" dev="overlay" ino=3412088 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7231995 2023-04-04 21:23:07 2023-04-05 10:26:18 2023-04-05 11:12:27 0:46:09 0:33:41 0:12:28 smithi main rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7231996 2023-04-04 21:23:08 2023-04-05 10:32:29 2023-04-05 12:57:35 2:25:06 2:19:10 0:05:56 smithi main rhel 8.4 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
pass 7231997 2023-04-04 21:23:09 2023-04-05 10:32:30 2023-04-05 12:28:52 1:56:22 1:25:49 0:30:33 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
pass 7231998 2023-04-04 21:23:09 2023-04-05 10:34:10 2023-04-05 11:00:18 0:26:08 0:18:17 0:07:51 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 7231999 2023-04-04 21:23:10 2023-04-05 10:34:31 2023-04-05 11:16:10 0:41:39 0:35:14 0:06:25 smithi main rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 7232000 2023-04-04 21:23:11 2023-04-05 10:35:01 2023-04-05 11:03:56 0:28:55 0:18:28 0:10:27 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7232001 2023-04-04 21:23:12 2023-04-05 10:35:52 2023-04-05 12:23:10 1:47:18 1:17:30 0:29:48 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi191 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e8ef3268-d3ab-11ed-9aff-001a4aab830c -- ceph orch daemon add osd smithi191:vg_nvme/lv_4'

pass 7232002 2023-04-04 21:23:13 2023-04-05 10:35:52 2023-04-05 11:07:56 0:32:04 0:21:18 0:10:46 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} 2
pass 7232003 2023-04-04 21:23:14 2023-04-05 10:35:52 2023-04-05 11:09:27 0:33:35 0:24:54 0:08:41 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 7232004 2023-04-04 21:23:14 2023-04-05 10:38:03 2023-04-05 11:31:08 0:53:05 0:24:17 0:28:48 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} 1
pass 7232005 2023-04-04 21:23:15 2023-04-05 10:38:03 2023-04-05 11:14:19 0:36:16 0:24:16 0:12:00 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 2
pass 7232006 2023-04-04 21:23:16 2023-04-05 10:40:14 2023-04-05 10:59:48 0:19:34 0:12:34 0:07:00 smithi main rhel 8.4 rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 7232007 2023-04-04 21:23:17 2023-04-05 10:40:15 2023-04-05 11:27:09 0:46:54 0:35:13 0:11:41 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 7232008 2023-04-04 21:23:18 2023-04-05 10:40:35 2023-04-05 11:56:11 1:15:36 0:46:37 0:28:59 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7232009 2023-04-04 21:23:18 2023-04-05 10:40:45 2023-04-05 11:42:34 1:01:49 0:30:50 0:30:59 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7232010 2023-04-04 21:23:19 2023-04-05 10:41:16 2023-04-05 11:05:08 0:23:52 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Command failed on smithi196 with status 1: 'sudo yum install -y kernel'

pass 7232011 2023-04-04 21:23:20 2023-04-05 10:41:56 2023-04-05 11:11:00 0:29:04 0:22:42 0:06:22 smithi main rhel 8.4 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 2
pass 7232012 2023-04-04 21:23:21 2023-04-05 10:41:57 2023-04-05 12:53:54 2:11:57 1:42:19 0:29:38 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7232013 2023-04-04 21:23:22 2023-04-05 10:42:47 2023-04-05 11:16:56 0:34:09 0:23:19 0:10:50 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} 1
pass 7232014 2023-04-04 21:23:23 2023-04-05 10:42:48 2023-04-05 11:17:01 0:34:13 0:23:55 0:10:18 smithi main ubuntu 20.04 rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232015 2023-04-04 21:23:23 2023-04-05 10:42:48 2023-04-05 11:20:48 0:38:00 0:30:56 0:07:04 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
pass 7232016 2023-04-04 21:23:24 2023-04-05 10:43:18 2023-04-05 11:29:33 0:46:15 0:38:40 0:07:35 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7232017 2023-04-04 21:23:25 2023-04-05 10:43:59 2023-04-05 12:37:23 1:53:24 1:23:00 0:30:24 smithi main centos 8.stream rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
fail 7232018 2023-04-04 21:23:26 2023-04-05 10:43:59 2023-04-05 11:01:26 0:17:27 0:10:05 0:07:22 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi202 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:5c985a09c75a9cc73e9774aadc248a51b2319e16 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9581eda6-d3a0-11ed-9aff-001a4aab830c -- ceph mon dump -f json'

pass 7232019 2023-04-04 21:23:27 2023-04-05 10:44:20 2023-04-05 11:08:28 0:24:08 0:08:40 0:15:28 smithi main ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
pass 7232020 2023-04-04 21:23:27 2023-04-05 10:48:11 2023-04-05 12:35:56 1:47:45 1:14:30 0:33:15 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_pids_limit} 1
pass 7232021 2023-04-04 21:23:28 2023-04-05 10:52:32 2023-04-05 11:22:45 0:30:13 0:17:28 0:12:45 smithi main ubuntu 20.04 rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7232022 2023-04-04 21:23:29 2023-04-05 10:54:42 2023-04-05 11:18:29 0:23:47 0:17:28 0:06:19 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7232023 2023-04-04 21:23:30 2023-04-05 10:54:53 2023-04-05 12:38:55 1:44:02 1:13:37 0:30:25 smithi main centos 8.stream rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
fail 7232024 2023-04-04 21:23:31 2023-04-05 10:54:53 2023-04-05 11:24:12 0:29:19 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed on smithi193 with status 1: 'sudo yum install -y kernel'

pass 7232025 2023-04-04 21:23:32 2023-04-05 11:00:09 2023-04-05 11:34:14 0:34:05 0:20:49 0:13:16 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps} 2
pass 7232026 2023-04-04 21:23:32 2023-04-05 11:00:19 2023-04-05 11:37:26 0:37:07 0:25:33 0:11:34 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
pass 7232027 2023-04-04 21:23:33 2023-04-05 11:01:30 2023-04-05 12:51:07 1:49:37 1:18:39 0:30:58 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7232028 2023-04-04 21:23:34 2023-04-05 11:05:36 2023-04-05 12:34:21 1:28:45 0:55:24 0:33:21 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi027 with status 1: 'sudo yum -y install cephfs-java'

pass 7232029 2023-04-04 21:23:35 2023-04-05 11:07:26 2023-04-05 11:30:14 0:22:48 0:11:12 0:11:36 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} 2
pass 7232030 2023-04-04 21:23:36 2023-04-05 11:08:07 2023-04-05 11:28:06 0:19:59 0:09:01 0:10:58 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 7232031 2023-04-04 21:23:37 2023-04-05 11:08:07 2023-04-05 12:01:57 0:53:50 0:24:14 0:29:36 smithi main centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
Failure Reason:

No module named 'tasks.cephadm'

pass 7232032 2023-04-04 21:23:38 2023-04-05 11:08:38 2023-04-05 12:59:09 1:50:31 1:40:35 0:09:56 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
fail 7232033 2023-04-04 21:23:38 2023-04-05 11:09:28 2023-04-05 12:36:52 1:27:24 0:57:22 0:30:02 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
Failure Reason:

Command failed on smithi174 with status 1: 'sudo yum -y install cephfs-java'

pass 7232034 2023-04-04 21:23:39 2023-04-05 11:09:59 2023-04-05 11:51:05 0:41:06 0:34:26 0:06:40 smithi main rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} 1
pass 7232035 2023-04-04 21:23:40 2023-04-05 11:09:59 2023-04-05 11:33:08 0:23:09 0:11:08 0:12:01 smithi main ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7232036 2023-04-04 21:23:41 2023-04-05 11:11:09 2023-04-05 11:31:42 0:20:33 0:13:20 0:07:13 smithi main rhel 8.4 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 7232037 2023-04-04 21:23:42 2023-04-05 11:12:30 2023-04-05 11:45:00 0:32:30 0:21:23 0:11:07 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 7232038 2023-04-04 21:23:42 2023-04-05 11:12:30 2023-04-05 11:36:18 0:23:48 0:12:44 0:11:04 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} 2
pass 7232039 2023-04-04 21:23:43 2023-04-05 11:14:21 2023-04-05 11:43:33 0:29:12 0:19:54 0:09:18 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7232040 2023-04-04 21:23:44 2023-04-05 11:16:12 2023-04-05 13:32:28 2:16:16 1:47:00 0:29:16 smithi main centos 8.stream rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7232041 2023-04-04 21:23:45 2023-04-05 11:17:02 2023-04-05 13:39:29 2:22:27 1:51:53 0:30:34 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7232042 2023-04-04 21:23:45 2023-04-05 11:18:03 2023-04-05 14:00:43 2:42:40 2:32:30 0:10:10 smithi main ubuntu 20.04 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} 1
pass 7232043 2023-04-04 21:23:46 2023-04-05 11:18:33 2023-04-05 12:03:17 0:44:44 0:33:14 0:11:30 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} 2
pass 7232044 2023-04-04 21:23:47 2023-04-05 11:18:43 2023-04-05 11:38:38 0:19:55 0:10:32 0:09:23 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} 1
pass 7232045 2023-04-04 21:23:48 2023-04-05 11:18:44 2023-04-05 11:56:26 0:37:42 0:27:48 0:09:54 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7232046 2023-04-04 21:23:49 2023-04-05 11:20:54 2023-04-05 11:55:02 0:34:08 0:22:23 0:11:45 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} 2
pass 7232047 2023-04-04 21:23:49 2023-04-05 11:22:55 2023-04-05 11:43:46 0:20:51 0:09:49 0:11:02 smithi main ubuntu 20.04 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232048 2023-04-04 21:23:50 2023-04-05 11:24:16 2023-04-05 13:07:22 1:43:06 1:14:14 0:28:52 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} 1
pass 7232049 2023-04-04 21:23:51 2023-04-05 11:24:16 2023-04-05 12:07:15 0:42:59 0:35:41 0:07:18 smithi main rhel 8.4 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 7232050 2023-04-04 21:23:52 2023-04-05 11:26:07 2023-04-05 11:58:55 0:32:48 0:21:20 0:11:28 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7232051 2023-04-04 21:23:53 2023-04-05 11:27:17 2023-04-05 12:04:19 0:37:02 0:31:10 0:05:52 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} 2
pass 7232052 2023-04-04 21:23:53 2023-04-05 11:27:18 2023-04-05 13:35:13 2:07:55 1:35:49 0:32:06 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7232053 2023-04-04 21:23:54 2023-04-05 11:29:38 2023-04-05 12:05:37 0:35:59 0:28:57 0:07:02 smithi main rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7232054 2023-04-04 21:23:55 2023-04-05 11:30:19 2023-04-05 13:15:33 1:45:14 1:16:34 0:28:40 smithi main centos 8.stream rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7232055 2023-04-04 21:23:56 2023-04-05 11:30:19 2023-04-05 12:30:05 0:59:46 0:29:47 0:29:59 smithi main centos 8.stream rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7232056 2023-04-04 21:23:57 2023-04-05 11:31:00 2023-04-05 12:05:08 0:34:08 0:27:09 0:06:59 smithi main rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
pass 7232057 2023-04-04 21:23:57 2023-04-05 11:31:50 2023-04-05 12:16:29 0:44:39 0:34:54 0:09:45 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} 3
pass 7232058 2023-04-04 21:23:58 2023-04-05 11:32:51 2023-04-05 11:53:27 0:20:36 0:10:39 0:09:57 smithi main ubuntu 20.04 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232059 2023-04-04 21:23:59 2023-04-05 11:33:11 2023-04-05 12:07:11 0:34:00 0:22:56 0:11:04 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 7232060 2023-04-04 21:24:00 2023-04-05 11:33:11 2023-04-05 11:52:09 0:18:58 0:11:36 0:07:22 smithi main rhel 8.4 rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 2
pass 7232061 2023-04-04 21:24:01 2023-04-05 11:34:22 2023-04-05 13:40:00 2:05:38 1:30:55 0:34:43 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
pass 7232062 2023-04-04 21:24:01 2023-04-05 11:38:43 2023-04-05 12:19:56 0:41:13 0:35:30 0:05:43 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
pass 7232063 2023-04-04 21:24:02 2023-04-05 11:39:04 2023-04-05 12:09:45 0:30:41 0:17:44 0:12:57 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7232064 2023-04-04 21:24:03 2023-04-05 11:41:24 2023-04-05 14:20:08 2:38:44 2:08:00 0:30:44 smithi main centos 8.stream rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} tasks/dashboard} 2
pass 7232065 2023-04-04 21:24:04 2023-04-05 11:42:35 2023-04-05 13:31:40 1:49:05 1:20:56 0:28:09 smithi main centos 8.stream rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
fail 7232066 2023-04-04 21:24:05 2023-04-05 11:42:35 2023-04-05 12:03:06 0:20:31 smithi main ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} 4
Failure Reason:

Cannot connect to remote host smithi137

fail 7232067 2023-04-04 21:24:05 2023-04-05 11:45:06 2023-04-05 12:06:30 0:21:24 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} 3
Failure Reason:

Cannot connect to remote host smithi049

pass 7232068 2023-04-04 21:24:06 2023-04-05 11:47:47 2023-04-05 12:53:18 1:05:31 0:59:32 0:05:59 smithi main rhel 8.4 rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
pass 7232069 2023-04-04 21:24:07 2023-04-05 11:48:07 2023-04-05 15:41:15 3:53:08 3:22:50 0:30:18 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} 2
pass 7232070 2023-04-04 21:24:08 2023-04-05 11:49:18 2023-04-05 12:13:57 0:24:39 0:16:12 0:08:27 smithi main rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 7232071 2023-04-04 21:24:09 2023-04-05 11:50:38 2023-04-05 14:04:06 2:13:28 1:44:37 0:28:51 smithi main centos 8.stream rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c985a09c75a9cc73e9774aadc248a51b2319e16 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7232072 2023-04-04 21:24:10 2023-04-05 11:50:49 2023-04-05 12:17:06 0:26:17 0:16:12 0:10:05 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/progress} 2
pass 7232073 2023-04-04 21:24:10 2023-04-05 11:51:09 2023-04-05 12:32:03 0:40:54 0:26:50 0:14:04 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} 2
fail 7232074 2023-04-04 21:24:11 2023-04-05 11:52:10 2023-04-05 13:36:34 1:44:24 1:11:44 0:32:40 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

No module named 'tasks'

fail 7232075 2023-04-04 21:24:12 2023-04-05 11:55:10 2023-04-05 12:13:09 0:17:59 0:07:25 0:10:34 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} 1
Failure Reason:

No module named 'tasks'

fail 7232076 2023-04-04 21:24:13 2023-04-05 11:55:11 2023-04-05 12:49:22 0:54:11 0:23:11 0:31:00 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

No module named 'tasks'

fail 7232077 2023-04-04 21:24:14 2023-04-05 11:56:12 2023-04-05 13:37:55 1:41:43 1:11:50 0:29:53 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} 2
Failure Reason:

No module named 'tasks'

fail 7232078 2023-04-04 21:24:14 2023-04-05 11:56:32 2023-04-05 13:13:54 1:17:22 0:46:47 0:30:35 smithi main centos 8.stream rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/readwrite} 2
Failure Reason:

No module named 'tasks'

pass 7232079 2023-04-04 21:24:15 2023-04-05 11:56:42 2023-04-05 12:20:08 0:23:26 0:16:05 0:07:21 smithi main rhel 8.4 rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} 2
pass 7232080 2023-04-04 21:24:16 2023-04-05 11:56:43 2023-04-05 14:06:38 2:09:55 1:36:58 0:32:57 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7232081 2023-04-04 21:24:17 2023-04-05 11:59:03 2023-04-05 12:17:56 0:18:53 0:13:40 0:05:13 smithi main rhel 8.4 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7232082 2023-04-04 21:24:18 2023-04-05 11:59:04 2023-04-05 12:27:02 0:27:58 0:19:31 0:08:27 smithi main rhel 8.4 rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} 3
pass 7232083 2023-04-04 21:24:18 2023-04-05 12:02:05 2023-04-05 13:14:40 1:12:35 1:05:52 0:06:43 smithi main rhel 8.4 rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 7232084 2023-04-04 21:24:19 2023-04-05 12:02:05 2023-04-05 13:04:25 1:02:20 0:31:46 0:30:34 smithi main centos 8.stream rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} 2
fail 7232085 2023-04-04 21:24:20 2023-04-05 12:03:16 2023-04-05 12:28:16 0:25:00 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Command failed on smithi130 with status 1: 'sudo yum install -y kernel'

pass 7232086 2023-04-04 21:24:21 2023-04-05 12:03:16 2023-04-05 12:29:25 0:26:09 0:16:19 0:09:50 smithi main ubuntu 20.04 rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7232087 2023-04-04 21:24:21 2023-04-05 12:03:26 2023-04-05 13:17:07 1:13:41 1:01:09 0:12:32 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} 2
pass 7232088 2023-04-04 21:24:22 2023-04-05 12:04:27 2023-04-05 12:38:37 0:34:10 0:23:38 0:10:32 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} 2
pass 7232089 2023-04-04 21:24:23 2023-04-05 12:04:37 2023-04-05 14:12:49 2:08:12 1:37:52 0:30:20 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7232090 2023-04-04 21:24:24 2023-04-05 12:05:18 2023-04-05 12:22:49 0:17:31 0:11:33 0:05:58 smithi main rhel 8.4 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
pass 7232091 2023-04-04 21:24:25 2023-04-05 12:05:38 2023-04-05 12:23:55 0:18:17 0:08:12 0:10:05 smithi main ubuntu 20.04 rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232092 2023-04-04 21:24:25 2023-04-05 12:05:38 2023-04-05 12:49:34 0:43:56 0:32:08 0:11:48 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7232093 2023-04-04 21:24:26 2023-04-05 12:06:39 2023-04-05 12:29:33 0:22:54 0:17:19 0:05:35 smithi main rhel 8.4 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 7232094 2023-04-04 21:24:27 2023-04-05 12:06:39 2023-04-05 12:23:18 0:16:39 0:06:21 0:10:18 smithi main ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi110 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

fail 7232095 2023-04-04 21:24:28 2023-04-05 12:07:20 2023-04-05 12:27:53 0:20:33 smithi main ubuntu 18.04 rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

Cannot connect to remote host smithi146

pass 7232096 2023-04-04 21:24:29 2023-04-05 12:09:50 2023-04-05 12:47:04 0:37:14 0:28:42 0:08:32 smithi main rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7232097 2023-04-04 21:24:29 2023-04-05 12:11:51 2023-04-05 13:55:47 1:43:56 1:14:08 0:29:48 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} 1
pass 7232098 2023-04-04 21:24:30 2023-04-05 12:12:52 2023-04-05 13:13:43 1:00:51 0:52:49 0:08:02 smithi main rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} 1
pass 7232099 2023-04-04 21:24:31 2023-04-05 12:12:52 2023-04-05 12:38:24 0:25:32 0:18:56 0:06:36 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} 2
pass 7232100 2023-04-04 21:24:32 2023-04-05 12:12:52 2023-04-05 12:37:05 0:24:13 0:16:50 0:07:23 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7232101 2023-04-04 21:24:33 2023-04-05 12:14:03 2023-04-05 12:41:45 0:27:42 0:19:57 0:07:45 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7232102 2023-04-04 21:24:33 2023-04-05 12:14:03 2023-04-05 15:01:23 2:47:20 2:18:59 0:28:21 smithi main centos 8.stream rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 7232103 2023-04-04 21:24:34 2023-04-05 12:14:04 2023-04-05 12:35:50 0:21:46 0:11:52 0:09:54 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} 1
fail 7232104 2023-04-04 21:24:35 2023-04-05 12:14:04 2023-04-05 14:03:34 1:49:30 1:20:09 0:29:21 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi203.front.sepia.ceph.com: ['type=AVC msg=audit(1680703256.429:19184): avc: denied { ioctl } for pid=157324 comm="iptables" path="/var/lib/containers/storage/overlay/9c99af55ac11785bbb1822d13d254929707cf4e48b58ae00399b54f92090ffe3/merged" dev="overlay" ino=3412094 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1680703256.792:19188): avc: denied { ioctl } for pid=157359 comm="iptables" path="/var/lib/containers/storage/overlay/9c99af55ac11785bbb1822d13d254929707cf4e48b58ae00399b54f92090ffe3/merged" dev="overlay" ino=3412094 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7232105 2023-04-04 21:24:36 2023-04-05 12:14:04 2023-04-05 12:33:42 0:19:38 0:12:39 0:06:59 smithi main rhel 8.4 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7232106 2023-04-04 21:24:37 2023-04-05 12:14:35 2023-04-05 14:01:00 1:46:25 1:17:02 0:29:23 smithi main centos 8.stream rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} 2
pass 7232107 2023-04-04 21:24:37 2023-04-05 12:15:45 2023-04-05 12:41:44 0:25:59 0:17:51 0:08:08 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 7232108 2023-04-04 21:24:38 2023-04-05 12:16:36 2023-04-05 13:00:56 0:44:20 0:33:20 0:11:00 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} 3
pass 7232109 2023-04-04 21:24:39 2023-04-05 12:17:16 2023-04-05 12:45:25 0:28:09 0:16:50 0:11:19 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} 2
pass 7232110 2023-04-04 21:24:40 2023-04-05 12:17:47 2023-04-05 14:11:03 1:53:16 1:24:44 0:28:32 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} 2
fail 7232111 2023-04-04 21:24:41 2023-04-05 12:17:57 2023-04-05 12:45:43 0:27:46 smithi main centos 8.stream rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Command failed on smithi138 with status 1: 'sudo yum install -y kernel'

pass 7232112 2023-04-04 21:24:41 2023-04-05 12:19:58 2023-04-05 14:19:43 1:59:45 1:29:43 0:30:02 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7232113 2023-04-04 21:24:42 2023-04-05 12:20:18 2023-04-05 14:08:52 1:48:34 1:15:30 0:33:04 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 7232114 2023-04-04 21:24:43 2023-04-05 12:22:59 2023-04-05 12:44:24 0:21:25 0:15:05 0:06:20 smithi main rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/prometheus} 2
pass 7232115 2023-04-04 21:24:44 2023-04-05 12:23:20 2023-04-05 14:58:30 2:35:10 2:07:24 0:27:46 smithi main centos 8.stream rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 7232116 2023-04-04 21:24:45 2023-04-05 12:23:20 2023-04-05 13:26:19 1:02:59 0:56:29 0:06:30 smithi main rhel 8.4 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 7232117 2023-04-04 21:24:45 2023-04-05 12:23:20 2023-04-05 12:46:52 0:23:32 0:17:18 0:06:14 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7232118 2023-04-04 21:24:46 2023-04-05 12:23:41 2023-04-05 13:17:20 0:53:39 0:24:25 0:29:14 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} 1
pass 7232119 2023-04-04 21:24:47 2023-04-05 12:24:01 2023-04-05 13:06:04 0:42:03 0:31:47 0:10:16 smithi main rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} 2
pass 7232120 2023-04-04 21:24:48 2023-04-05 12:27:12 2023-04-05 12:44:19 0:17:07 0:11:38 0:05:29 smithi main rhel 8.4 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 7232121 2023-04-04 21:24:49 2023-04-05 12:27:12 2023-04-05 14:39:20 2:12:08 1:41:59 0:30:09 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7232122 2023-04-04 21:24:50 2023-04-05 12:28:03 2023-04-05 13:08:25 0:40:22 0:30:36 0:09:46 smithi main ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7232123 2023-04-04 21:24:50 2023-04-05 12:28:23 2023-04-05 12:50:35 0:22:12 0:15:24 0:06:48 smithi main rhel 8.4 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
pass 7232124 2023-04-04 21:24:51 2023-04-05 12:29:34 2023-04-05 12:52:08 0:22:34 0:12:53 0:09:41 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} 2
pass 7232125 2023-04-04 21:24:52 2023-04-05 12:30:14 2023-04-05 12:53:52 0:23:38 0:15:28 0:08:10 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7232126 2023-04-04 21:24:53 2023-04-05 12:32:05 2023-04-05 12:52:53 0:20:48 0:12:21 0:08:27 smithi main rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 7232127 2023-04-04 21:24:54 2023-04-05 12:33:46 2023-04-05 13:01:05 0:27:19 0:18:13 0:09:06 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 7232128 2023-04-04 21:24:55 2023-04-05 12:34:26 2023-04-05 13:01:43 0:27:17 0:15:51 0:11:26 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7232129 2023-04-04 21:24:55 2023-04-05 12:36:07 2023-04-05 14:15:48 1:39:41 1:10:40 0:29:01 smithi main centos 8.stream rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7232130 2023-04-04 21:24:56 2023-04-05 12:36:57 2023-04-05 14:36:14 1:59:17 1:29:28 0:29:49 smithi main centos 8.stream rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} 2
pass 7232131 2023-04-04 21:24:57 2023-04-05 12:37:08 2023-04-05 13:32:18 0:55:10 0:44:02 0:11:08 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} 3
pass 7232132 2023-04-04 21:24:58 2023-04-05 12:44:26 2023-04-05 13:04:33 0:20:07 0:10:35 0:09:32 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} 1
pass 7232133 2023-04-04 21:24:59 2023-04-05 12:44:26 2023-04-05 14:33:35 1:49:09 1:19:08 0:30:01 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_pids_limit} 1
pass 7232134 2023-04-04 21:24:59 2023-04-05 12:44:27 2023-04-05 13:09:06 0:24:39 0:16:41 0:07:58 smithi main rhel 8.4 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 7232135 2023-04-04 21:25:00 2023-04-05 12:45:27 2023-04-05 13:08:38 0:23:11 0:17:35 0:05:36 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunks-read} 2
pass 7232136 2023-04-04 21:25:01 2023-04-05 12:45:48 2023-04-05 14:45:29 1:59:41 1:29:18 0:30:23 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7232137 2023-04-04 21:25:02 2023-04-05 12:45:48 2023-04-05 14:30:39 1:44:51 1:15:45 0:29:06 smithi main centos 8.stream rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} 1
pass 7232138 2023-04-04 21:25:03 2023-04-05 12:45:49 2023-04-05 14:36:08 1:50:19 1:20:53 0:29:26 smithi main centos 8.stream rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
pass 7232139 2023-04-04 21:25:04 2023-04-05 12:46:59 2023-04-05 13:49:14 1:02:15 0:52:28 0:09:47 smithi main ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7232140 2023-04-04 21:25:04 2023-04-05 12:47:10 2023-04-05 14:46:31 1:59:21 1:27:38 0:31:43 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7232141 2023-04-04 21:25:05 2023-04-05 12:49:30 2023-04-05 13:18:37 0:29:07 0:17:42 0:11:25 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7232142 2023-04-04 21:25:06 2023-04-05 12:49:41 2023-04-05 13:12:28 0:22:47 0:12:05 0:10:42 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
pass 7232143 2023-04-04 21:25:07 2023-04-05 12:50:41 2023-04-05 13:10:58 0:20:17 0:09:00 0:11:17 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232144 2023-04-04 21:25:08 2023-04-05 12:50:42 2023-04-05 14:47:43 1:57:01 1:28:08 0:28:53 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
pass 7232145 2023-04-04 21:25:09 2023-04-05 12:50:42 2023-04-05 13:22:32 0:31:50 0:21:22 0:10:28 smithi main ubuntu 18.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 7232146 2023-04-04 21:25:09 2023-04-05 12:51:13 2023-04-05 14:38:12 1:46:59 1:17:14 0:29:45 smithi main centos 8.stream rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 7232147 2023-04-04 21:25:10 2023-04-05 12:51:13 2023-04-05 14:45:29 1:54:16 1:23:52 0:30:24 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} 2
pass 7232148 2023-04-04 21:25:11 2023-04-05 12:52:13 2023-04-05 14:34:39 1:42:26 1:12:29 0:29:57 smithi main centos 8.stream rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
fail 7232149 2023-04-04 21:25:12 2023-04-05 12:53:24 2023-04-05 13:12:32 0:19:08 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} 3
Failure Reason:

Cannot connect to remote host smithi158

dead 7232150 2023-04-04 21:25:13 2023-04-05 12:54:05 2023-04-06 01:05:24 12:11:19 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 7232151 2023-04-04 21:25:14 2023-04-05 12:56:35 2023-04-05 13:19:53 0:23:18 0:15:35 0:07:43 smithi main rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7232152 2023-04-04 21:25:14 2023-04-05 12:58:36 2023-04-05 15:00:13 2:01:37 1:31:44 0:29:53 smithi main centos 8.stream rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 7232153 2023-04-04 21:25:15 2023-04-05 12:59:06 2023-04-05 13:58:43 0:59:37 0:30:19 0:29:18 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7232154 2023-04-04 21:25:16 2023-04-05 12:59:17 2023-04-05 15:30:10 2:30:53 2:00:50 0:30:03 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} 2
pass 7232155 2023-04-04 21:25:17 2023-04-05 13:00:57 2023-04-05 14:41:39 1:40:42 1:12:34 0:28:08 smithi main centos 8.stream rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 7232156 2023-04-04 21:25:18 2023-04-05 13:00:58 2023-04-05 13:19:56 0:18:58 0:13:17 0:05:41 smithi main rhel 8.4 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/workunits} 2
pass 7232157 2023-04-04 21:25:18 2023-04-05 13:00:58 2023-04-05 15:12:04 2:11:06 1:39:36 0:31:30 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7232158 2023-04-04 21:25:19 2023-04-05 13:01:09 2023-04-05 13:41:07 0:39:58 0:33:41 0:06:17 smithi main rhel 8.4 rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} 2
pass 7232159 2023-04-04 21:25:20 2023-04-05 13:01:49 2023-04-05 13:23:14 0:21:25 0:14:53 0:06:32 smithi main rhel 8.4 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 1
pass 7232160 2023-04-04 21:25:21 2023-04-05 13:01:49 2023-04-05 15:13:52 2:12:03 1:39:43 0:32:20 smithi main centos 8.stream rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7232161 2023-04-04 21:25:22 2023-04-05 13:04:30 2023-04-05 16:28:07 3:23:37 3:17:48 0:05:49 smithi main rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} 1
pass 7232162 2023-04-04 21:25:22 2023-04-05 13:04:40 2023-04-05 13:38:11 0:33:31 0:21:35 0:11:56 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} 2
pass 7232163 2023-04-04 21:25:23 2023-04-05 13:06:11 2023-04-05 14:50:45 1:44:34 1:14:38 0:29:56 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} 1
pass 7232164 2023-04-04 21:25:24 2023-04-05 13:07:32 2023-04-05 13:31:44 0:24:12 0:16:03 0:08:09 smithi main rhel 8.4 rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7232165 2023-04-04 21:25:25 2023-04-05 13:08:32 2023-04-05 13:28:35 0:20:03 0:10:16 0:09:47 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} 1
pass 7232166 2023-04-04 21:25:26 2023-04-05 13:08:42 2023-04-05 15:18:50 2:10:08 1:37:13 0:32:55 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 7232167 2023-04-04 21:25:26 2023-04-05 13:11:03 2023-04-05 15:11:33 2:00:30 1:29:01 0:31:29 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7232168 2023-04-04 21:25:27 2023-04-05 13:17:17 2023-04-05 13:37:49 0:20:32 0:09:13 0:11:19 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232169 2023-04-04 21:25:28 2023-04-05 13:17:18 2023-04-05 13:37:44 0:20:26 0:10:30 0:09:56 smithi main ubuntu 20.04 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232170 2023-04-04 21:25:29 2023-04-05 13:17:28 2023-04-05 13:53:40 0:36:12 0:23:34 0:12:38 smithi main ubuntu 20.04 rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 7232171 2023-04-04 21:25:30 2023-04-05 13:18:39 2023-04-05 13:43:15 0:24:36 0:16:36 0:08:00 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7232172 2023-04-04 21:25:30 2023-04-05 13:19:59 2023-04-05 13:54:52 0:34:53 0:28:05 0:06:48 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} 2
fail 7232173 2023-04-04 21:25:31 2023-04-05 13:20:00 2023-04-05 13:48:44 0:28:44 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

Command failed on smithi173 with status 1: 'sudo yum install -y kernel'

pass 7232174 2023-04-04 21:25:32 2023-04-05 13:23:20 2023-04-05 14:05:19 0:41:59 0:33:28 0:08:31 smithi main rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 7232175 2023-04-04 21:25:33 2023-04-05 13:28:44 2023-04-05 13:57:52 0:29:08 0:16:51 0:12:17 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} 2
pass 7232176 2023-04-04 21:25:34 2023-04-05 13:31:45 2023-04-05 14:16:15 0:44:30 0:34:58 0:09:32 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} 3
pass 7232177 2023-04-04 21:25:35 2023-04-05 13:32:26 2023-04-05 14:07:54 0:35:28 0:28:49 0:06:39 smithi main rhel 8.4 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
pass 7232178 2023-04-04 21:25:35 2023-04-05 13:32:36 2023-04-05 13:58:49 0:26:13 0:17:15 0:08:58 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7232179 2023-04-04 21:25:36 2023-04-05 13:35:17 2023-04-05 14:01:37 0:26:20 0:17:58 0:08:22 smithi main rhel 8.4 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
fail 7232180 2023-04-04 21:25:37 2023-04-05 13:36:37 2023-04-05 13:55:41 0:19:04 0:07:33 0:11:31 smithi main rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5c985a09c75a9cc73e9774aadc248a51b2319e16

pass 7232181 2023-04-04 21:25:38 2023-04-05 13:37:48 2023-04-05 13:57:51 0:20:03 0:10:11 0:09:52 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232182 2023-04-04 21:25:39 2023-04-05 13:37:58 2023-04-05 14:20:02 0:42:04 0:35:43 0:06:21 smithi main rhel 8.4 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7232183 2023-04-04 21:25:39 2023-04-05 13:37:59 2023-04-05 15:45:50 2:07:51 1:38:33 0:29:18 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7232184 2023-04-04 21:25:40 2023-04-05 13:38:19 2023-04-05 14:14:47 0:36:28 0:29:13 0:07:15 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} 2
pass 7232185 2023-04-04 21:25:41 2023-04-05 13:39:30 2023-04-05 14:41:18 1:01:48 0:31:39 0:30:09 smithi main centos 8.stream rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} 2
pass 7232186 2023-04-04 21:25:42 2023-04-05 13:40:10 2023-04-05 14:20:10 0:40:00 0:30:18 0:09:42 smithi main ubuntu 20.04 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} 1
pass 7232187 2023-04-04 21:25:43 2023-04-05 13:40:10 2023-04-05 14:39:21 0:59:11 0:29:22 0:29:49 smithi main centos 8.stream rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
pass 7232188 2023-04-04 21:25:43 2023-04-05 13:40:11 2023-04-05 14:00:00 0:19:49 0:09:38 0:10:11 smithi main ubuntu 20.04 rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 7232189 2023-04-04 21:25:44 2023-04-05 13:40:11 2023-04-05 14:01:39 0:21:28 0:08:15 0:13:13 smithi main ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 3
pass 7232190 2023-04-04 21:25:45 2023-04-05 13:43:22 2023-04-05 16:05:57 2:22:35 1:48:12 0:34:23 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7232191 2023-04-04 21:25:46 2023-04-05 13:48:53 2023-04-05 15:18:07 1:29:14 1:00:50 0:28:24 smithi main centos 8.stream rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7232192 2023-04-04 21:25:47 2023-04-05 13:48:53 2023-04-05 14:10:53 0:22:00 0:10:30 0:11:30 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} 1
pass 7232193 2023-04-04 21:25:47 2023-04-05 13:48:54 2023-04-05 15:39:46 1:50:52 1:21:21 0:29:31 smithi main centos 8.stream rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 7232194 2023-04-04 21:25:48 2023-04-05 13:48:54 2023-04-05 14:13:03 0:24:09 0:15:43 0:08:26 smithi main rhel 8.4 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
dead 7232195 2023-04-04 21:25:49 2023-04-05 13:51:55 2023-04-05 14:03:27 0:11:32 0:05:29 0:06:03 smithi main rhel 8.4 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

{'smithi142.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:00.854185', 'end': '2023-04-05 14:03:05.904790', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-04-05 14:03:05.050605', 'stderr': "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nCurl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Network is unreachable]", 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', "Curl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Network is unreachable]"], 'stdout': 'Updating Subscription Management repositories.', 'stdout_lines': ['Updating Subscription Management repositories.']}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi178.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:00.882348', 'end': '2023-04-05 14:03:07.437822', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2023-04-05 14:03:06.555474', 'stderr': "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nCurl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Network is unreachable]", 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', "Curl error (7): Couldn't connect to server for https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64 [Failed to connect to copr.fedorainfracloud.org port 443: Network is unreachable]"], 'stdout': 'Updating Subscription Management repositories.', 'stdout_lines': ['Updating Subscription Management repositories.']}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}}

pass 7232196 2023-04-04 21:25:50 2023-04-05 13:51:55 2023-04-05 14:29:56 0:38:01 0:27:49 0:10:12 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7232197 2023-04-04 21:25:51 2023-04-05 13:54:38 2023-04-05 15:44:04 1:49:26 1:20:56 0:28:30 smithi main centos 8.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} 2
pass 7232198 2023-04-04 21:25:51 2023-04-05 13:54:59 2023-04-05 15:38:48 1:43:49 1:14:04 0:29:45 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} 1
pass 7232199 2023-04-04 21:25:52 2023-04-05 13:55:49 2023-04-05 14:17:45 0:21:56 0:11:08 0:10:48 smithi main ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/crash} 2
pass 7232200 2023-04-04 21:25:53 2023-04-05 13:55:49 2023-04-05 15:59:05 2:03:16 1:31:48 0:31:28 smithi main centos 8.stream rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects} 2
fail 7232201 2023-04-04 21:25:54 2023-04-05 13:58:00 2023-04-05 14:17:02 0:19:02 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Cannot connect to remote host smithi151

pass 7232202 2023-04-04 21:25:55 2023-04-05 13:58:51 2023-04-05 14:51:01 0:52:10 0:41:28 0:10:42 smithi main ubuntu 20.04 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
fail 7232203 2023-04-04 21:25:56 2023-04-05 13:58:51 2023-04-05 14:17:03 0:18:12 smithi main ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Cannot connect to remote host smithi061

pass 7232204 2023-04-04 21:25:57 2023-04-05 13:58:51 2023-04-05 15:00:30 1:01:39 0:49:15 0:12:24 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} 3
pass 7232205 2023-04-04 21:25:57 2023-04-05 14:01:53 2023-04-05 14:26:52 0:24:59 0:18:12 0:06:47 smithi main rhel 8.4 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 7232206 2023-04-04 21:25:58 2023-04-05 14:01:54 2023-04-05 14:39:55 0:38:01 0:25:17 0:12:44 smithi main ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} 2
pass 7232207 2023-04-04 21:25:59 2023-04-05 14:03:34 2023-04-05 15:51:31 1:47:57 1:17:02 0:30:55 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 7232208 2023-04-04 21:26:00 2023-04-05 14:04:15 2023-04-05 15:50:30 1:46:15 1:15:44 0:30:31 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi110.front.sepia.ceph.com: ['type=AVC msg=audit(1680709650.116:19188): avc: denied { ioctl } for pid=156779 comm="iptables" path="/var/lib/containers/storage/overlay/1bc80028b38677a8d33d939727480d8bb3f6bc603f62903d651bc430c40e51df/merged" dev="overlay" ino=3412088 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7232209 2023-04-04 21:26:01 2023-04-05 14:05:25 2023-04-05 14:45:07 0:39:42 0:26:51 0:12:51 smithi main ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} 2
pass 7232210 2023-04-04 21:26:01 2023-04-05 14:06:46 2023-04-05 14:32:17 0:25:31 0:17:46 0:07:45 smithi main rhel 8.4 rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 7232211 2023-04-04 21:26:02 2023-04-05 14:06:46 2023-04-05 16:17:22 2:10:36 1:41:05 0:29:31 smithi main centos 8.stream rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 7232212 2023-04-04 21:26:03 2023-04-05 14:07:57 2023-04-05 14:41:43 0:33:46 0:21:06 0:12:40 smithi main ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
fail 7232213 2023-04-04 21:26:04 2023-04-05 14:08:57 2023-04-05 15:58:22 1:49:25 1:17:49 0:31:36 smithi main centos 8.stream rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi107 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0592efea-d3ca-11ed-9aff-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_4'

pass 7232214 2023-04-04 21:26:05 2023-04-05 14:10:58 2023-04-05 14:48:02 0:37:04 0:30:36 0:06:28 smithi main rhel 8.4 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
pass 7232215 2023-04-04 21:26:05 2023-04-05 14:11:08 2023-04-05 15:06:19 0:55:11 0:24:47 0:30:24 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} 1
pass 7232216 2023-04-04 21:26:06 2023-04-05 14:45:27 1331 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 2
pass 7232217 2023-04-04 21:26:07 2023-04-05 14:13:09 2023-04-05 15:58:25 1:45:16 1:16:10 0:29:06 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} 2
pass 7232218 2023-04-04 21:26:08 2023-04-05 14:13:10 2023-04-05 14:58:18 0:45:08 0:33:23 0:11:45 smithi main ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} 3
pass 7232219 2023-04-04 21:26:09 2023-04-05 14:14:50 2023-04-05 16:06:59 1:52:09 1:44:36 0:07:33 smithi main rhel 8.4 rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} 1
dead 7232220 2023-04-04 21:26:10 2023-04-05 14:15:51 2023-04-06 02:25:21 12:09:30 smithi main centos 8.stream rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 7232221 2023-04-04 21:26:10 2023-04-05 14:16:21 2023-04-05 14:47:43 0:31:22 0:24:06 0:07:16 smithi main rhel 8.4 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 7232222 2023-04-04 21:26:11 2023-04-05 14:16:22 2023-04-05 14:37:19 0:20:57 0:10:25 0:10:32 smithi main ubuntu 20.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} 1
pass 7232223 2023-04-04 21:26:12 2023-04-05 14:17:12 2023-04-05 16:16:34 1:59:22 1:29:49 0:29:33 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 7232224 2023-04-04 21:26:13 2023-04-05 14:17:13 2023-04-05 15:19:05 1:01:52 0:32:01 0:29:51 smithi main centos 8.stream rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7232225 2023-04-04 21:26:14 2023-04-05 14:17:53 2023-04-05 16:27:30 2:09:37 1:36:03 0:33:34 smithi main centos 8.stream rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
fail 7232226 2023-04-04 21:26:15 2023-04-05 14:19:34 2023-04-05 14:35:48 0:16:14 0:06:01 0:10:13 smithi main ubuntu 18.04 rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} 3
Failure Reason:

Command failed on smithi046 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7232227 2023-04-04 21:26:15 2023-04-05 14:23:14 2023-04-05 15:08:34 0:45:20 0:38:45 0:06:35 smithi main rhel 8.4 rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2