Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7354569 2023-07-27 15:33:22 2023-07-27 16:26:52 2525 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7354570 2023-07-27 15:33:28 2023-07-27 15:35:27 2023-07-27 16:13:30 0:38:03 0:22:10 0:15:53 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7354571 2023-07-27 15:33:33 2023-07-27 15:38:02 2023-07-27 16:24:05 0:46:03 0:36:37 0:09:26 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7354572 2023-07-27 15:33:38 2023-07-27 15:38:19 2023-07-27 16:26:08 0:47:49 0:33:39 0:14:10 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7354573 2023-07-27 15:33:39 2023-07-27 15:38:25 2023-07-27 16:31:08 0:52:43 0:39:18 0:13:25 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7354574 2023-07-27 15:33:45 2023-07-27 15:38:25 2023-07-27 16:05:14 0:26:49 0:14:12 0:12:37 smithi main ubuntu 20.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
pass 7354575 2023-07-27 15:33:50 2023-07-27 15:39:46 2023-07-27 16:39:14 0:59:28 0:44:30 0:14:58 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7354576 2023-07-27 15:34:06 2023-07-27 15:41:36 2023-07-27 16:08:16 0:26:40 0:13:56 0:12:44 smithi main centos 8.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} 1
dead 7354577 2023-07-27 15:34:12 2023-07-27 15:42:27 2023-07-27 15:43:48 0:01:21 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/264/task

pass 7354578 2023-07-27 15:34:21 2023-07-27 15:42:57 2023-07-27 16:42:03 0:59:06 0:46:45 0:12:21 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7354579 2023-07-27 15:34:22 2023-07-27 15:43:01 2023-07-27 16:04:05 0:21:04 0:09:32 0:11:32 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

{"dd: failed to open '/home/ubuntu/.ansible/tmp/ansible-tmp-1690473234.0123048-10153-229378452977024/AnsiballZ_user.py': No such file or directory", 'failed to transfer file to /home/teuthworker/.ansible/tmp/ansible-local-26232qyx3zaaa/tmplj90c2vk /home/ubuntu/.ansible/tmp/ansible-tmp-1690473234.0123048-10153-229378452977024/AnsiballZ_user.py:'}

pass 7354580 2023-07-27 15:34:23 2023-07-27 15:43:02 2023-07-27 16:09:33 0:26:31 0:17:58 0:08:33 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7354581 2023-07-27 15:34:24 2023-07-27 15:44:14 2023-07-27 15:54:59 0:10:45 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

Stale jobs detected, aborting.

pass 7354582 2023-07-27 15:34:30 2023-07-27 15:45:14 2023-07-27 16:17:15 0:32:01 0:20:12 0:11:49 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} 1
pass 7354583 2023-07-27 15:34:36 2023-07-27 15:45:25 2023-07-27 16:11:39 0:26:14 0:18:58 0:07:16 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7354584 2023-07-27 15:34:45 2023-07-27 15:45:25 2023-07-27 16:20:21 0:34:56 0:21:59 0:12:57 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7354585 2023-07-27 15:34:51 2023-07-27 15:46:50 2023-07-27 16:43:28 0:56:38 0:42:53 0:13:45 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7354586 2023-07-27 15:35:07 2023-07-27 15:52:20 2023-07-27 16:54:43 1:02:23 0:49:16 0:13:07 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7354587 2023-07-27 15:35:18 2023-07-27 15:52:26 2023-07-27 16:45:17 0:52:51 0:36:43 0:16:08 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7354588 2023-07-27 15:35:26 2023-07-27 15:54:27 2023-07-27 16:39:24 0:44:57 0:29:23 0:15:34 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7354589 2023-07-27 15:35:27 2023-07-27 15:55:32 2023-07-27 16:23:48 0:28:16 0:16:54 0:11:22 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
dead 7354590 2023-07-27 15:35:28 2023-07-27 15:55:32 2023-07-27 16:06:28 0:10:56 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Error reimaging machines: 'ssh_keyscan smithi159.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds

pass 7354591 2023-07-27 15:35:29 2023-07-27 15:55:53 2023-07-27 16:42:42 0:46:49 0:27:29 0:19:20 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7354592 2023-07-27 15:35:35 2023-07-27 15:57:56 2023-07-27 16:46:02 0:48:06 0:35:58 0:12:08 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7354593 2023-07-27 15:35:46 2023-07-27 15:57:57 2023-07-27 16:52:50 0:54:53 0:34:48 0:20:05 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7354594 2023-07-27 15:35:52 2023-07-27 15:59:02 2023-07-27 16:37:23 0:38:21 0:28:37 0:09:44 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
dead 7354595 2023-07-27 15:36:03 2023-07-27 16:00:10 2023-07-27 16:03:38 0:03:28 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi046

pass 7354596 2023-07-27 15:36:19 2023-07-27 16:01:14 2023-07-27 16:39:27 0:38:13 0:26:13 0:12:00 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7354597 2023-07-27 15:36:35 2023-07-27 16:01:14 2023-07-27 17:23:03 1:21:49 1:10:16 0:11:33 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
dead 7354598 2023-07-27 15:36:36 2023-07-27 16:01:49 2023-07-27 16:05:11 0:03:22 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi157

dead 7354599 2023-07-27 15:36:42 2023-07-27 16:03:08 2023-07-27 16:05:01 0:01:53 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi161

pass 7354600 2023-07-27 15:36:48 2023-07-27 16:03:18 2023-07-27 16:40:49 0:37:31 0:28:03 0:09:28 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
fail 7354601 2023-07-27 15:36:59 2023-07-27 16:03:19 2023-07-27 16:39:52 0:36:33 0:26:28 0:10:05 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi120.front.sepia.ceph.com: ['type=AVC msg=audit(1690475817.885:20755): avc: denied { ioctl } for pid=112491 comm="iptables" path="/var/lib/containers/storage/overlay/28fd6fa4e60cb361f2aab12c2f7faa1e7bfac6f449769713c26b9aa8e7a47ac7/merged" dev="overlay" ino=2754149 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1690475817.825:20754): avc: denied { ioctl } for pid=112486 comm="iptables" path="/var/lib/containers/storage/overlay/28fd6fa4e60cb361f2aab12c2f7faa1e7bfac6f449769713c26b9aa8e7a47ac7/merged" dev="overlay" ino=2754149 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7354602 2023-07-27 15:37:04 2023-07-27 16:04:39 2023-07-27 16:46:09 0:41:30 0:31:47 0:09:43 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7354603 2023-07-27 15:37:15 2023-07-27 16:04:40 2023-07-27 16:57:57 0:53:17 0:37:48 0:15:29 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7354604 2023-07-27 15:37:31 2023-07-27 16:05:26 2023-07-27 16:07:35 0:02:09 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi046

dead 7354605 2023-07-27 15:37:32 2023-07-27 16:05:27 2023-07-27 16:11:30 0:06:03 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Error reimaging machines: Expected smithi157's OS to be ubuntu 20.04 but found rhel 8.6

fail 7354606 2023-07-27 15:37:33 2023-07-27 16:05:54 2023-07-27 16:15:52 0:09:58 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Cannot connect to remote host smithi157

pass 7354607 2023-07-27 15:37:34 2023-07-27 16:05:54 2023-07-27 16:35:47 0:29:53 0:20:49 0:09:04 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7354608 2023-07-27 15:37:45 2023-07-27 16:06:57 2023-07-27 16:27:27 0:20:30 0:07:38 0:12:52 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7354609 2023-07-27 15:37:56 2023-07-27 16:07:21 2023-07-27 17:05:39 0:58:18 0:43:55 0:14:23 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
dead 7354610 2023-07-27 15:38:12 2023-07-27 16:08:16 2023-07-27 16:10:00 0:01:44 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi046

pass 7354611 2023-07-27 15:38:14 2023-07-27 16:08:16 2023-07-27 17:04:12 0:55:56 0:41:01 0:14:55 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7354612 2023-07-27 15:38:20 2023-07-27 16:09:02 2023-07-27 16:43:12 0:34:10 0:16:10 0:18:00 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7354613 2023-07-27 15:38:25 2023-07-27 16:10:15 2023-07-27 16:44:08 0:33:53 0:21:16 0:12:37 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7354614 2023-07-27 15:38:26 2023-07-27 16:11:36 2023-07-27 17:23:43 1:12:07 0:52:44 0:19:23 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7354615 2023-07-27 15:38:27 2023-07-27 16:12:11 2023-07-27 17:34:52 1:22:41 1:07:25 0:15:16 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7354616 2023-07-27 15:38:27 2023-07-27 16:12:32 2023-07-27 16:45:22 0:32:50 0:21:26 0:11:24 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
dead 7354617 2023-07-27 15:38:28 2023-07-27 16:12:32 2023-07-27 16:24:32 0:12:00 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Expected smithi157's OS to be centos 8 but found rhel 8.6

dead 7354618 2023-07-27 15:38:34 2023-07-27 16:13:23 2023-07-27 16:17:40 0:04:17 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi077

pass 7354619 2023-07-27 15:38:40 2023-07-27 16:15:08 2023-07-27 16:48:31 0:33:23 0:16:40 0:16:43 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7354620 2023-07-27 15:38:51 2023-07-27 16:15:09 2023-07-27 16:45:42 0:30:33 0:21:30 0:09:03 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

dead 7354621 2023-07-27 15:39:06 2023-07-27 16:15:09 2023-07-27 16:26:48 0:11:39 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7354622 2023-07-27 15:39:22 2023-07-27 16:16:47 2023-07-27 16:49:23 0:32:36 0:22:12 0:10:24 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7354623 2023-07-27 15:39:23 2023-07-27 16:18:20 2023-07-27 17:18:03 0:59:43 0:39:58 0:19:45 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7354624 2023-07-27 15:39:34 2023-07-27 16:19:03 2023-07-27 16:48:30 0:29:27 0:21:28 0:07:59 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} 1
pass 7354625 2023-07-27 15:39:40 2023-07-27 16:19:13 2023-07-27 17:18:03 0:58:50 0:39:54 0:18:56 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7354626 2023-07-27 15:39:46 2023-07-27 16:20:14 2023-07-27 18:39:19 2:19:05 2:02:24 0:16:41 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7354627 2023-07-27 15:39:46 2023-07-27 16:21:03 2023-07-27 17:14:16 0:53:13 0:41:57 0:11:16 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7354628 2023-07-27 15:39:47 2023-07-27 16:23:39 2023-07-27 17:18:03 0:54:24 0:39:00 0:15:24 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7354629 2023-07-27 15:39:48 2023-07-27 16:25:10 2023-07-27 17:02:10 0:37:00 0:25:44 0:11:16 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7354630 2023-07-27 15:40:04 2023-07-27 16:25:58 2023-07-27 18:26:44 2:00:46 1:45:16 0:15:30 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7354631 2023-07-27 15:40:10 2023-07-27 16:26:52 2023-07-27 16:30:13 0:03:21 smithi main centos 8.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi190

pass 7354632 2023-07-27 15:40:10 2023-07-27 16:27:10 2023-07-27 17:07:33 0:40:23 0:28:17 0:12:06 smithi main centos 8.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} 1
pass 7354633 2023-07-27 15:40:11 2023-07-27 16:27:10 2023-07-27 17:26:04 0:58:54 0:36:30 0:22:24 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7354634 2023-07-27 15:40:12 2023-07-27 16:29:08 2023-07-27 17:51:42 1:22:34 1:08:44 0:13:50 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7354635 2023-07-27 15:40:13 2023-07-27 16:31:13 2023-07-27 17:16:06 0:44:53 0:32:16 0:12:37 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7354636 2023-07-27 15:40:14 2023-07-27 16:40:09 2023-07-27 18:44:31 2:04:22 1:34:58 0:29:24 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7354637 2023-07-27 15:40:20 2023-07-27 16:41:22 2023-07-27 17:10:41 0:29:19 0:19:04 0:10:15 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7354638 2023-07-27 15:40:25 2023-07-27 16:41:48 2023-07-27 19:00:33 2:18:45 1:52:58 0:25:47 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7354639 2023-07-27 15:40:41 2023-07-27 16:41:53 2023-07-27 18:46:19 2:04:26 1:37:14 0:27:12 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7354640 2023-07-27 15:40:52 2023-07-27 16:42:42 2023-07-27 17:08:36 0:25:54 0:17:22 0:08:32 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7354641 2023-07-27 15:41:08 2023-07-27 16:42:43 2023-07-27 17:12:28 0:29:45 0:19:59 0:09:46 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7354642 2023-07-27 15:41:24 2023-07-27 16:42:43 2023-07-27 17:10:05 0:27:22 0:17:10 0:10:12 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7354643 2023-07-27 15:41:30 2023-07-27 16:43:46 2023-07-27 17:44:13 1:00:27 0:49:43 0:10:44 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
dead 7354644 2023-07-27 15:41:35 2023-07-27 16:44:12 2023-07-27 16:47:36 0:03:24 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi084

pass 7354645 2023-07-27 15:41:36 2023-07-27 16:44:38 2023-07-27 18:32:44 1:48:06 1:27:44 0:20:22 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7354646 2023-07-27 15:41:37 2023-07-27 16:44:39 2023-07-27 19:02:22 2:17:43 1:55:34 0:22:09 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7354647 2023-07-27 15:41:38 2023-07-27 16:45:48 2023-07-27 17:20:08 0:34:20 0:25:45 0:08:35 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7354648 2023-07-27 15:41:39 2023-07-27 16:55:54 2023-07-27 17:40:26 0:44:32 0:33:29 0:11:03 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
dead 7354649 2023-07-27 15:41:39 2023-07-27 16:58:07 2023-07-27 17:03:57 0:05:50 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi064

pass 7354650 2023-07-27 15:41:40 2023-07-27 17:02:11 2023-07-27 18:33:45 1:31:34 1:01:17 0:30:17 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7354651 2023-07-27 15:41:41 2023-07-27 17:02:21 2023-07-27 17:25:31 0:23:10 0:12:01 0:11:09 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
dead 7354652 2023-07-27 15:41:42 2023-07-27 17:04:38 2023-07-27 17:07:25 0:02:47 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi008

dead 7354653 2023-07-27 15:41:43 2023-07-27 17:04:58 2023-07-27 17:08:43 0:03:45 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi079's OS to be centos 8 but found ubuntu 20.04

pass 7354654 2023-07-27 15:41:44 2023-07-27 17:06:19 2023-07-27 17:43:56 0:37:37 0:24:25 0:13:12 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features} 2
fail 7354655 2023-07-27 15:41:50 2023-07-27 17:07:50 2023-07-27 17:37:41 0:29:51 0:19:18 0:10:33 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi172 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:82c085f827575f079a030cf33416b5e78568774f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3ed2080-2ca2-11ee-9b35-001a4aab830c -- ceph orch apply prometheus '1;smithi172=a'"

pass 7354656 2023-07-27 15:41:56 2023-07-27 17:08:59 2023-07-27 18:12:13 1:03:14 0:54:52 0:08:22 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
dead 7354657 2023-07-27 15:41:57 2023-07-27 17:09:00 2023-07-28 05:20:28 12:11:28 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

hit max job timeout

pass 7354658 2023-07-27 15:41:58 2023-07-27 17:10:06 2023-07-27 19:25:01 2:14:55 1:53:24 0:21:31 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7354659 2023-07-27 15:41:59 2023-07-27 17:10:16 2023-07-27 17:16:20 0:06:04 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

Error reimaging machines: Expected smithi123's OS to be centos 8 but found ubuntu 20.04

dead 7354660 2023-07-27 15:42:00 2023-07-27 17:12:01 2023-07-27 17:15:45 0:03:44 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi148

dead 7354661 2023-07-27 15:42:06 2023-07-27 17:12:01 2023-07-27 17:16:20 0:04:19 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Error reimaging machines: Expected smithi116's OS to be ubuntu 20.04 but found rhel 8.6

dead 7354662 2023-07-27 15:42:12 2023-07-27 17:13:12 2023-07-27 17:16:52 0:03:40 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi098's OS to be centos 8 but found rhel 8.6

pass 7354663 2023-07-27 15:42:28 2023-07-27 17:14:29 2023-07-27 19:14:48 2:00:19 1:34:11 0:26:08 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7354664 2023-07-27 15:42:32 2023-07-27 17:16:59 2023-07-27 18:45:26 1:28:27 1:06:45 0:21:42 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7354665 2023-07-27 15:42:42 2023-07-27 17:16:59 2023-07-27 19:05:22 1:48:23 1:26:55 0:21:28 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS)

pass 7354666 2023-07-27 15:42:57 2023-07-27 17:16:59 2023-07-27 17:47:21 0:30:22 0:21:43 0:08:39 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7354667 2023-07-27 15:43:01 2023-07-27 17:17:00 2023-07-27 19:28:19 2:11:19 1:44:27 0:26:52 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7354668 2023-07-27 15:43:12 2023-07-27 17:17:15 2023-07-27 17:53:16 0:36:01 0:26:17 0:09:44 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7354669 2023-07-27 15:43:23 2023-07-27 17:17:15 2023-07-27 17:55:42 0:38:27 0:26:15 0:12:12 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7354670 2023-07-27 15:43:39 2023-07-27 17:18:07 2023-07-27 17:50:41 0:32:34 0:20:42 0:11:52 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7354671 2023-07-27 15:43:43 2023-07-27 17:18:11 2023-07-27 18:14:07 0:55:56 0:44:00 0:11:56 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7354672 2023-07-27 15:43:48 2023-07-27 17:18:17 2023-07-27 18:16:58 0:58:41 0:49:14 0:09:27 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7354673 2023-07-27 15:44:04 2023-07-27 17:18:37 2023-07-27 19:30:49 2:12:12 1:45:37 0:26:35 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7354674 2023-07-27 15:44:10 2023-07-27 17:18:38 2023-07-27 18:04:12 0:45:34 0:33:58 0:11:36 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7354675 2023-07-27 15:44:13 2023-07-27 17:21:50 2023-07-27 18:01:02 0:39:12 0:31:11 0:08:01 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7354676 2023-07-27 15:44:24 2023-07-27 18:22:34 1932 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7354677 2023-07-27 15:44:34 2023-07-27 17:24:20 2023-07-27 18:00:25 0:36:05 0:21:26 0:14:39 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7354678 2023-07-27 15:44:45 2023-07-27 17:26:26 2023-07-27 18:06:06 0:39:40 0:18:27 0:21:13 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7354679 2023-07-27 15:45:01 2023-07-27 17:35:00 2023-07-27 18:25:56 0:50:56 0:38:03 0:12:53 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2