Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7349646 2023-07-24 12:24:53 2023-07-24 13:19:44 2604 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7349647 2023-07-24 12:24:54 2023-07-24 12:25:47 2023-07-24 12:59:28 0:33:41 0:21:22 0:12:19 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7349648 2023-07-24 12:24:55 2023-07-24 12:25:47 2023-07-24 13:08:17 0:42:30 0:33:55 0:08:35 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7349649 2023-07-24 12:24:56 2023-07-24 12:25:48 2023-07-24 13:12:30 0:46:42 0:31:07 0:15:35 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349650 2023-07-24 12:24:57 2023-07-24 12:25:48 2023-07-24 13:18:31 0:52:43 0:38:51 0:13:52 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7349651 2023-07-24 12:24:58 2023-07-24 12:25:49 2023-07-24 12:57:27 0:31:38 0:17:11 0:14:27 smithi main ubuntu 20.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7349652 2023-07-24 12:24:59 2023-07-24 12:25:49 2023-07-24 13:26:39 1:00:50 0:45:56 0:14:54 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7349653 2023-07-24 12:25:00 2023-07-24 12:25:50 2023-07-24 12:52:35 0:26:45 0:13:45 0:13:00 smithi main centos 8.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} 1
pass 7349654 2023-07-24 12:25:01 2023-07-24 12:25:50 2023-07-24 12:54:23 0:28:33 0:13:47 0:14:46 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7349655 2023-07-24 12:25:02 2023-07-24 12:25:50 2023-07-24 13:26:04 1:00:14 0:45:44 0:14:30 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7349656 2023-07-24 12:25:03 2023-07-24 12:25:51 2023-07-24 12:55:46 0:29:55 0:21:32 0:08:23 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

fail 7349657 2023-07-24 12:25:04 2023-07-24 12:25:51 2023-07-24 12:48:24 0:22:33 0:13:14 0:09:19 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c587198892eb424b60fc0d9b57f91d1231d804f0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f77b46f8-2a1f-11ee-9b35-001a4aab830c -- ceph orch host add smithi151'

pass 7349658 2023-07-24 12:25:05 2023-07-24 12:25:52 2023-07-24 13:11:49 0:45:57 0:36:04 0:09:53 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7349659 2023-07-24 12:25:06 2023-07-24 12:25:52 2023-07-24 12:55:47 0:29:55 0:19:46 0:10:09 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} 1
pass 7349660 2023-07-24 12:25:07 2023-07-24 12:25:52 2023-07-24 12:52:27 0:26:35 0:18:44 0:07:51 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7349661 2023-07-24 12:25:08 2023-07-24 12:25:53 2023-07-24 13:00:26 0:34:33 0:21:11 0:13:22 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7349662 2023-07-24 12:25:09 2023-07-24 12:25:53 2023-07-24 13:16:04 0:50:11 0:43:08 0:07:03 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7349663 2023-07-24 12:25:10 2023-07-24 12:25:54 2023-07-24 13:26:39 1:00:45 0:47:21 0:13:24 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7349664 2023-07-24 12:25:11 2023-07-24 12:25:54 2023-07-24 13:20:46 0:54:52 0:39:02 0:15:50 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7349665 2023-07-24 12:25:12 2023-07-24 12:25:55 2023-07-24 13:06:51 0:40:56 0:26:31 0:14:25 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7349666 2023-07-24 12:25:13 2023-07-24 12:25:55 2023-07-24 13:01:02 0:35:07 0:15:40 0:19:27 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7349667 2023-07-24 12:25:14 2023-07-24 12:28:56 2023-07-24 13:04:15 0:35:19 0:16:40 0:18:39 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7349668 2023-07-24 12:25:15 2023-07-24 12:36:58 2023-07-24 13:22:37 0:45:39 0:21:33 0:24:06 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7349669 2023-07-24 12:25:16 2023-07-24 12:41:09 2023-07-24 13:36:15 0:55:06 0:36:03 0:19:03 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349670 2023-07-24 12:25:17 2023-07-24 12:47:00 2023-07-24 13:35:54 0:48:54 0:32:35 0:16:19 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7349671 2023-07-24 12:25:18 2023-07-24 12:48:31 2023-07-24 13:22:00 0:33:29 0:27:35 0:05:54 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7349672 2023-07-24 12:25:19 2023-07-24 12:48:41 2023-07-24 13:19:49 0:31:08 0:16:09 0:14:59 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7349673 2023-07-24 12:25:20 2023-07-24 12:52:32 2023-07-24 13:30:48 0:38:16 0:25:46 0:12:30 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7349674 2023-07-24 12:25:21 2023-07-24 12:54:33 2023-07-24 14:18:48 1:24:15 1:12:23 0:11:52 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7349675 2023-07-24 12:25:22 2023-07-24 12:54:33 2023-07-24 13:57:51 1:03:18 0:54:05 0:09:13 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7349676 2023-07-24 12:25:23 2023-07-24 12:55:54 2023-07-24 13:22:41 0:26:47 0:19:01 0:07:46 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption} 1
pass 7349677 2023-07-24 12:25:24 2023-07-24 12:57:34 2023-07-24 13:33:25 0:35:51 0:27:48 0:08:03 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
fail 7349678 2023-07-24 12:25:25 2023-07-24 12:58:05 2023-07-24 13:28:15 0:30:10 0:24:36 0:05:34 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi032.front.sepia.ceph.com: ['type=AVC msg=audit(1690205141.842:20742): avc: denied { ioctl } for pid=112572 comm="iptables" path="/var/lib/containers/storage/overlay/ab277bf0baa96ad79d2f43796b3aa1701fa9df9a238b940b39b0fcc16c1e3fb2/merged/etc" dev="overlay" ino=2754443 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1690205141.695:20740): avc: denied { ioctl } for pid=112556 comm="iptables" path="/var/lib/containers/storage/overlay/ab277bf0baa96ad79d2f43796b3aa1701fa9df9a238b940b39b0fcc16c1e3fb2/merged/etc" dev="overlay" ino=2754443 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7349679 2023-07-24 12:25:26 2023-07-24 12:58:05 2023-07-24 13:33:29 0:35:24 0:27:26 0:07:58 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7349680 2023-07-24 12:25:27 2023-07-24 13:00:26 2023-07-24 13:52:13 0:51:47 0:39:45 0:12:02 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349681 2023-07-24 12:25:28 2023-07-24 13:00:36 2023-07-24 13:26:04 0:25:28 0:13:18 0:12:10 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7349682 2023-07-24 12:25:30 2023-07-24 13:00:47 2023-07-24 13:48:08 0:47:21 0:35:02 0:12:19 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7349683 2023-07-24 12:25:31 2023-07-24 13:01:07 2023-07-24 13:29:36 0:28:29 0:18:55 0:09:34 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7349684 2023-07-24 12:25:32 2023-07-24 13:04:18 2023-07-24 13:33:29 0:29:11 0:19:49 0:09:22 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7349685 2023-07-24 12:25:33 2023-07-24 13:05:39 2023-07-24 13:24:42 0:19:03 0:07:29 0:11:34 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7349686 2023-07-24 12:25:34 2023-07-24 13:22:02 2023-07-24 14:17:47 0:55:45 0:43:46 0:11:59 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7349687 2023-07-24 12:25:35 2023-07-24 13:22:42 2023-07-24 14:06:55 0:44:13 0:29:14 0:14:59 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7349688 2023-07-24 12:25:36 2023-07-24 13:22:43 2023-07-24 14:20:21 0:57:38 0:40:32 0:17:06 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7349689 2023-07-24 12:25:37 2023-07-24 13:26:14 2023-07-24 14:00:22 0:34:08 0:17:15 0:16:53 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7349690 2023-07-24 12:25:38 2023-07-24 13:26:14 2023-07-24 13:56:58 0:30:44 0:20:50 0:09:54 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7349691 2023-07-24 12:25:39 2023-07-24 13:26:14 2023-07-24 14:18:19 0:52:05 0:34:31 0:17:34 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7349692 2023-07-24 12:25:40 2023-07-24 13:26:45 2023-07-24 14:21:27 0:54:42 0:38:42 0:16:00 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7349693 2023-07-24 12:25:41 2023-07-24 13:26:45 2023-07-24 14:00:22 0:33:37 0:20:50 0:12:47 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7349694 2023-07-24 12:25:42 2023-07-24 13:26:46 2023-07-24 14:18:48 0:52:02 0:33:34 0:18:28 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349695 2023-07-24 12:25:43 2023-07-24 13:27:26 2023-07-24 14:14:19 0:46:53 0:25:56 0:20:57 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7349696 2023-07-24 12:25:44 2023-07-24 13:29:27 2023-07-24 14:01:41 0:32:14 0:17:02 0:15:12 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7349697 2023-07-24 12:25:45 2023-07-24 13:29:37 2023-07-24 14:00:49 0:31:12 0:25:36 0:05:36 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7349698 2023-07-24 12:25:46 2023-07-24 13:29:38 2023-07-24 14:10:57 0:41:19 0:32:59 0:08:20 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7349699 2023-07-24 12:25:47 2023-07-24 13:30:58 2023-07-24 13:56:48 0:25:50 0:17:42 0:08:08 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7349700 2023-07-24 12:25:48 2023-07-24 13:33:19 2023-07-24 14:05:33 0:32:14 0:15:46 0:16:28 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7349701 2023-07-24 12:25:49 2023-07-24 13:33:29 2023-07-24 14:01:04 0:27:35 0:20:52 0:06:43 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} 1
pass 7349702 2023-07-24 12:25:50 2023-07-24 13:33:30 2023-07-24 14:05:33 0:32:03 0:16:11 0:15:52 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7349703 2023-07-24 12:25:51 2023-07-24 13:33:30 2023-07-24 14:42:21 1:08:51 0:42:51 0:26:00 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7349704 2023-07-24 12:25:52 2023-07-24 13:33:30 2023-07-24 14:24:44 0:51:14 0:42:01 0:09:13 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7349705 2023-07-24 12:25:53 2023-07-24 13:36:01 2023-07-24 14:46:49 1:10:48 0:42:52 0:27:56 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7349706 2023-07-24 12:25:54 2023-07-24 13:49:18 2023-07-24 14:25:27 0:36:09 0:25:27 0:10:42 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7349707 2023-07-24 12:25:55 2023-07-24 13:52:18 2023-07-24 14:47:52 0:55:34 0:33:32 0:22:02 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349708 2023-07-24 12:25:56 2023-07-24 13:57:04 2023-07-24 14:26:21 0:29:17 0:16:54 0:12:23 smithi main ubuntu 20.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7349709 2023-07-24 12:25:57 2023-07-24 13:57:04 2023-07-24 14:26:48 0:29:44 0:15:07 0:14:37 smithi main centos 8.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} 1
pass 7349710 2023-07-24 12:25:58 2023-07-24 13:57:05 2023-07-24 14:27:51 0:30:46 0:13:24 0:17:22 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
dead 7349711 2023-07-24 12:25:59 2023-07-24 14:00:28 2023-07-24 14:02:25 0:01:57 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi178

pass 7349712 2023-07-24 12:26:00 2023-07-24 14:00:29 2023-07-24 14:52:02 0:51:33 0:38:38 0:12:55 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7349713 2023-07-24 12:26:01 2023-07-24 14:00:29 2023-07-24 14:42:52 0:42:23 0:21:17 0:21:06 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7349714 2023-07-24 12:26:02 2023-07-24 14:02:10 2023-07-24 14:31:17 0:29:07 0:19:40 0:09:27 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7349715 2023-07-24 12:26:03 2023-07-24 14:03:25 2023-07-24 14:54:57 0:51:32 0:30:23 0:21:09 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7349716 2023-07-24 12:26:04 2023-07-24 14:06:12 2023-07-24 14:42:15 0:36:03 0:23:02 0:13:01 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7349717 2023-07-24 12:26:05 2023-07-24 14:06:13 2023-07-24 14:32:32 0:26:19 0:16:43 0:09:36 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7349718 2023-07-24 12:26:06 2023-07-24 14:07:21 2023-07-24 14:37:10 0:29:49 0:19:23 0:10:26 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7349719 2023-07-24 12:26:07 2023-07-24 14:11:03 2023-07-24 14:38:23 0:27:20 0:17:07 0:10:13 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7349720 2023-07-24 12:26:08 2023-07-24 14:14:26 2023-07-24 15:07:37 0:53:11 0:46:34 0:06:37 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7349721 2023-07-24 12:26:09 2023-07-24 14:14:27 2023-07-24 15:11:58 0:57:31 0:43:42 0:13:49 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7349722 2023-07-24 12:26:10 2023-07-24 14:16:47 2023-07-24 14:44:56 0:28:09 0:15:52 0:12:17 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7349723 2023-07-24 12:26:12 2023-07-24 14:17:48 2023-07-24 15:07:38 0:49:50 0:33:59 0:15:51 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349724 2023-07-24 12:26:13 2023-07-24 14:18:18 2023-07-24 14:49:12 0:30:54 0:24:46 0:06:08 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7349725 2023-07-24 12:26:14 2023-07-24 14:18:19 2023-07-24 14:59:33 0:41:14 0:34:25 0:06:49 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7349726 2023-07-24 12:26:15 2023-07-24 14:18:29 2023-07-24 14:49:56 0:31:27 0:19:31 0:11:56 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7349727 2023-07-24 12:26:16 2023-07-24 14:18:50 2023-07-24 15:09:02 0:50:12 0:39:03 0:11:09 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7349728 2023-07-24 12:26:17 2023-07-24 14:18:50 2023-07-24 14:37:19 0:18:29 0:11:16 0:07:13 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7349729 2023-07-24 12:26:18 2023-07-24 14:20:21 2023-07-24 14:57:41 0:37:20 0:31:12 0:06:08 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7349730 2023-07-24 12:26:19 2023-07-24 14:20:31 2023-07-24 14:48:36 0:28:05 0:14:47 0:13:18 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7349731 2023-07-24 12:26:20 2023-07-24 14:21:32 2023-07-24 14:52:28 0:30:56 0:20:06 0:10:50 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7349732 2023-07-24 12:26:21 2023-07-24 14:22:22 2023-07-24 14:54:23 0:32:01 0:22:30 0:09:31 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7349733 2023-07-24 12:26:22 2023-07-24 14:24:53 2023-07-24 15:24:54 1:00:01 0:52:56 0:07:05 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7349734 2023-07-24 12:26:23 2023-07-24 14:25:33 2023-07-24 15:22:31 0:56:58 0:46:10 0:10:48 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7349735 2023-07-24 12:26:24 2023-07-24 14:26:24 2023-07-24 15:10:24 0:44:00 0:32:08 0:11:52 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349736 2023-07-24 12:26:25 2023-07-24 14:26:55 2023-07-24 14:58:59 0:32:04 0:13:35 0:18:29 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7349737 2023-07-24 12:26:26 2023-07-24 14:27:55 2023-07-24 15:14:06 0:46:11 0:34:48 0:11:23 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7349738 2023-07-24 12:26:27 2023-07-24 14:29:56 2023-07-24 15:01:56 0:32:00 0:18:57 0:13:03 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7349739 2023-07-24 12:26:28 2023-07-24 14:31:26 2023-07-24 15:12:01 0:40:35 0:28:57 0:11:38 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7349740 2023-07-24 12:26:29 2023-07-24 14:32:37 2023-07-24 15:06:20 0:33:43 0:22:36 0:11:07 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7349741 2023-07-24 12:26:30 2023-07-24 14:33:08 2023-07-24 15:10:31 0:37:23 0:25:54 0:11:29 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7349742 2023-07-24 12:26:31 2023-07-24 14:33:08 2023-07-24 15:07:38 0:34:30 0:19:06 0:15:24 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7349743 2023-07-24 12:26:32 2023-07-24 14:34:29 2023-07-24 15:00:57 0:26:28 0:18:31 0:07:57 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7349744 2023-07-24 12:26:33 2023-07-24 14:35:49 2023-07-24 15:15:38 0:39:49 0:28:58 0:10:51 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7349745 2023-07-24 12:26:34 2023-07-24 14:36:30 2023-07-24 15:09:28 0:32:58 0:26:04 0:06:54 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7349746 2023-07-24 12:26:35 2023-07-24 14:36:30 2023-07-24 15:13:20 0:36:50 0:25:39 0:11:11 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7349747 2023-07-24 12:26:36 2023-07-24 14:37:10 2023-07-24 15:02:38 0:25:28 0:18:57 0:06:31 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7349748 2023-07-24 12:26:37 2023-07-24 14:37:21 2023-07-24 15:36:44 0:59:23 0:46:15 0:13:08 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7349749 2023-07-24 12:26:38 2023-07-24 14:37:31 2023-07-24 15:30:31 0:53:00 0:44:21 0:08:39 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7349750 2023-07-24 12:26:39 2023-07-24 14:38:32 2023-07-24 15:33:24 0:54:52 0:41:10 0:13:42 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7349751 2023-07-24 12:26:40 2023-07-24 14:42:23 2023-07-24 15:26:38 0:44:15 0:37:27 0:06:48 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7349752 2023-07-24 12:26:41 2023-07-24 14:42:54 2023-07-24 15:16:12 0:33:18 0:27:14 0:06:04 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7349753 2023-07-24 12:26:42 2023-07-24 14:42:54 2023-07-24 15:09:36 0:26:42 0:15:29 0:11:13 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7349754 2023-07-24 12:26:43 2023-07-24 14:43:55 2023-07-24 15:16:10 0:32:15 0:21:30 0:10:45 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7349755 2023-07-24 12:26:44 2023-07-24 14:44:15 2023-07-24 15:19:15 0:35:00 0:21:39 0:13:21 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} 3
dead 7349756 2023-07-24 12:26:45 2023-07-24 14:46:56 2023-07-24 15:03:04 0:16:08 0:05:46 0:10:22 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

{'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 15124 (apt-get)'}

dead 2023-07-24 12:24:53 2023-07-24 12:24:53