Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7366511 2023-08-10 21:15:39 2023-08-10 21:21:12 2023-08-10 21:48:13 0:27:01 0:14:32 0:12:29 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7366512 2023-08-10 21:15:40 2023-08-10 21:22:03 2023-08-10 22:07:32 0:45:29 0:38:08 0:07:21 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7366513 2023-08-10 21:15:41 2023-08-10 21:22:13 2023-08-10 22:01:31 0:39:18 0:31:49 0:07:29 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 7366514 2023-08-10 21:15:43 2023-08-10 21:22:24 2023-08-10 22:09:26 0:47:02 0:40:03 0:06:59 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)

pass 7366515 2023-08-10 21:15:44 2023-08-10 21:22:24 2023-08-10 22:08:15 0:45:51 0:35:02 0:10:49 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7366516 2023-08-10 21:15:45 2023-08-10 21:23:05 2023-08-10 22:22:36 0:59:31 0:50:18 0:09:13 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7366517 2023-08-10 21:15:46 2023-08-10 21:23:25 2023-08-10 22:01:05 0:37:40 0:23:56 0:13:44 smithi main centos 8.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} 2
pass 7366518 2023-08-10 21:15:47 2023-08-10 21:24:46 2023-08-10 22:18:58 0:54:12 0:39:55 0:14:17 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7366519 2023-08-10 21:15:48 2023-08-10 21:25:36 2023-08-10 21:54:07 0:28:31 0:17:51 0:10:40 smithi main ubuntu 20.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7366520 2023-08-10 21:15:49 2023-08-10 21:26:17 2023-08-10 21:54:11 0:27:54 0:13:18 0:14:36 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7366521 2023-08-10 21:15:50 2023-08-10 21:26:27 2023-08-10 22:21:29 0:55:02 0:45:40 0:09:22 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi042 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f39d2e48-37c6-11ee-9b37-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7366522 2023-08-10 21:15:51 2023-08-10 21:26:28 2023-08-10 22:03:37 0:37:09 0:29:52 0:07:17 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7366523 2023-08-10 21:15:52 2023-08-10 21:26:28 2023-08-10 21:59:46 0:33:18 0:25:34 0:07:44 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7366524 2023-08-10 21:15:53 2023-08-10 21:26:28 2023-08-10 21:53:16 0:26:48 0:17:49 0:08:59 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7366525 2023-08-10 21:15:54 2023-08-10 21:27:59 2023-08-10 21:53:08 0:25:09 0:18:41 0:06:28 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7366526 2023-08-10 21:15:56 2023-08-10 21:27:59 2023-08-10 22:19:39 0:51:40 0:45:31 0:06:09 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7366527 2023-08-10 21:15:57 2023-08-10 21:28:20 2023-08-10 22:22:46 0:54:26 0:44:29 0:09:57 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7366528 2023-08-10 21:15:58 2023-08-10 21:28:40 2023-08-10 22:19:06 0:50:26 0:36:31 0:13:55 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7366529 2023-08-10 21:15:59 2023-08-10 21:30:21 2023-08-10 22:02:31 0:32:10 0:21:18 0:10:52 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7366530 2023-08-10 21:16:00 2023-08-10 21:30:41 2023-08-10 21:55:28 0:24:47 0:12:30 0:12:17 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Command failed on smithi160 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ae40faca3a68d505639eab77ab843df1969e7593 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a33c96c-37c8-11ee-9b37-001a4aab830c -- ceph mon dump -f json'

pass 7366531 2023-08-10 21:16:01 2023-08-10 21:31:52 2023-08-10 22:07:13 0:35:21 0:22:04 0:13:17 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7366532 2023-08-10 21:16:02 2023-08-10 21:33:52 2023-08-10 22:00:02 0:26:10 0:14:56 0:11:14 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7366533 2023-08-10 21:16:03 2023-08-10 21:34:33 2023-08-10 22:16:33 0:42:00 0:31:05 0:10:55 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366534 2023-08-10 21:16:04 2023-08-10 21:35:23 2023-08-10 22:04:44 0:29:21 0:15:46 0:13:35 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7366535 2023-08-10 21:16:05 2023-08-10 21:35:34 2023-08-10 22:17:03 0:41:29 0:30:35 0:10:54 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7366536 2023-08-10 21:16:06 2023-08-10 21:35:34 2023-08-10 22:17:06 0:41:32 0:26:12 0:15:20 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7366537 2023-08-10 21:16:08 2023-08-10 21:36:04 2023-08-10 22:12:55 0:36:51 0:25:52 0:10:59 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7366538 2023-08-10 21:16:09 2023-08-10 21:36:45 2023-08-10 22:07:41 0:30:56 0:18:46 0:12:10 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Command failed on smithi027 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.27:/fake /mnt/foo'"

pass 7366539 2023-08-10 21:16:10 2023-08-10 21:37:35 2023-08-10 22:51:58 1:14:23 1:02:57 0:11:26 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7366540 2023-08-10 21:16:11 2023-08-10 21:37:46 2023-08-10 22:27:25 0:49:39 0:42:07 0:07:32 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7366541 2023-08-10 21:16:12 2023-08-10 21:38:16 2023-08-10 22:01:15 0:22:59 0:16:39 0:06:20 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 7366542 2023-08-10 21:16:13 2023-08-10 21:38:17 2023-08-10 22:15:41 0:37:24 0:31:09 0:06:15 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 7366543 2023-08-10 21:16:14 2023-08-10 21:38:17 2023-08-10 22:14:33 0:36:16 0:28:32 0:07:44 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi033.front.sepia.ceph.com: ['type=AVC msg=audit(1691705506.400:21163): avc: denied { ioctl } for pid=145431 comm="iptables" path="/var/lib/containers/storage/overlay/2ff223a469fc655ef91f2308795201b411ac0f059780d92aabae3e55646d1052/merged" dev="overlay" ino=3408925 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1691705506.282:21160): avc: denied { ioctl } for pid=145414 comm="iptables" path="/var/lib/containers/storage/overlay/2ff223a469fc655ef91f2308795201b411ac0f059780d92aabae3e55646d1052/merged" dev="overlay" ino=3408925 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7366544 2023-08-10 21:16:15 2023-08-10 21:39:48 2023-08-10 22:28:47 0:48:59 0:40:01 0:08:58 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366545 2023-08-10 21:16:16 2023-08-10 21:39:48 2023-08-10 22:03:49 0:24:01 0:13:42 0:10:19 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7366546 2023-08-10 21:16:17 2023-08-10 21:40:28 2023-08-10 22:26:31 0:46:03 0:34:45 0:11:18 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi156 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e44c1b50-37c8-11ee-9b37-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

fail 7366547 2023-08-10 21:16:18 2023-08-10 21:42:29 2023-08-10 22:16:02 0:33:33 0:26:37 0:06:56 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi078 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.78:/fake /mnt/foo -o port=2999'"

pass 7366548 2023-08-10 21:16:19 2023-08-10 21:42:39 2023-08-10 22:07:49 0:25:10 0:18:44 0:06:26 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7366549 2023-08-10 21:16:20 2023-08-10 21:42:50 2023-08-10 22:33:47 0:50:57 0:38:06 0:12:51 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7366550 2023-08-10 21:16:21 2023-08-10 21:45:31 2023-08-10 22:03:43 0:18:12 0:07:38 0:10:34 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
fail 7366551 2023-08-10 21:16:22 2023-08-10 21:45:32 2023-08-10 22:13:21 0:27:49 0:19:51 0:07:58 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

Command failed on smithi040 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.40:/fake /mnt/foo'"

fail 7366552 2023-08-10 21:16:23 2023-08-10 21:46:12 2023-08-10 22:48:31 1:02:19 0:51:21 0:10:58 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7366553 2023-08-10 21:16:24 2023-08-10 21:46:13 2023-08-10 22:11:30 0:25:17 0:15:29 0:09:48 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7366554 2023-08-10 21:16:25 2023-08-10 21:46:13 2023-08-10 22:29:42 0:43:29 0:33:26 0:10:03 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7366555 2023-08-10 21:16:27 2023-08-10 21:46:23 2023-08-10 22:40:31 0:54:08 0:41:21 0:12:47 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7366556 2023-08-10 21:16:28 2023-08-10 21:48:14 2023-08-10 22:14:47 0:26:33 0:16:11 0:10:22 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7366557 2023-08-10 21:16:29 2023-08-10 21:49:55 2023-08-10 22:21:27 0:31:32 0:20:10 0:11:22 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7366558 2023-08-10 21:16:30 2023-08-10 21:50:45 2023-08-10 22:38:00 0:47:15 0:30:32 0:16:43 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366559 2023-08-10 21:16:31 2023-08-10 21:51:26 2023-08-10 22:28:25 0:36:59 0:23:23 0:13:36 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 7366560 2023-08-10 21:16:32 2023-08-10 21:53:16 2023-08-10 22:28:26 0:35:10 0:26:36 0:08:34 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)

pass 7366561 2023-08-10 21:16:33 2023-08-10 21:53:17 2023-08-10 22:35:21 0:42:04 0:35:04 0:07:00 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7366562 2023-08-10 21:16:34 2023-08-10 21:53:17 2023-08-10 22:24:08 0:30:51 0:22:01 0:08:50 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7366563 2023-08-10 21:16:35 2023-08-10 21:54:17 2023-08-10 22:17:26 0:23:09 0:14:08 0:09:01 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7366564 2023-08-10 21:16:36 2023-08-10 21:54:18 2023-08-10 22:19:50 0:25:32 0:18:02 0:07:30 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7366565 2023-08-10 21:16:37 2023-08-10 21:54:38 2023-08-10 22:20:58 0:26:20 0:15:01 0:11:19 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7366566 2023-08-10 21:16:38 2023-08-10 21:55:39 2023-08-10 22:50:50 0:55:11 0:41:27 0:13:44 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7366567 2023-08-10 21:16:39 2023-08-10 21:59:49 2023-08-10 22:55:10 0:55:21 0:48:58 0:06:23 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7366568 2023-08-10 21:16:41 2023-08-10 21:59:50 2023-08-10 22:46:04 0:46:14 0:39:03 0:07:11 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7366569 2023-08-10 21:16:42 2023-08-10 22:00:50 2023-08-10 22:28:41 0:27:51 0:17:28 0:10:23 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7366570 2023-08-10 21:16:43 2023-08-10 22:01:11 2023-08-10 22:57:48 0:56:37 0:40:46 0:15:51 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366571 2023-08-10 21:16:44 2023-08-10 22:01:21 2023-08-10 22:25:46 0:24:25 0:13:21 0:11:04 smithi main ubuntu 20.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7366572 2023-08-10 21:16:45 2023-08-10 22:01:42 2023-08-10 22:27:29 0:25:47 0:18:15 0:07:32 smithi main rhel 8.6 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 7366573 2023-08-10 21:16:46 2023-08-10 22:02:32 2023-08-10 22:30:08 0:27:36 0:13:11 0:14:25 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
fail 7366574 2023-08-10 21:16:47 2023-08-10 22:03:03 2023-08-10 22:58:55 0:55:52 0:45:10 0:10:42 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi018 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 36a5dc4e-37cc-11ee-9b37-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7366575 2023-08-10 21:16:48 2023-08-10 22:03:13 2023-08-10 22:45:34 0:42:21 0:31:56 0:10:25 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7366576 2023-08-10 21:16:49 2023-08-10 22:03:44 2023-08-10 22:34:12 0:30:28 0:18:47 0:11:41 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7366577 2023-08-10 21:16:50 2023-08-10 22:03:54 2023-08-10 22:31:41 0:27:47 0:19:53 0:07:54 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7366578 2023-08-10 21:16:51 2023-08-10 22:03:54 2023-08-10 22:46:52 0:42:58 0:30:14 0:12:44 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7366579 2023-08-10 21:16:52 2023-08-10 22:04:45 2023-08-10 22:43:24 0:38:39 0:20:49 0:17:50 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7366580 2023-08-10 21:16:54 2023-08-10 22:05:45 2023-08-10 22:36:43 0:30:58 0:23:39 0:07:19 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7366581 2023-08-10 21:16:55 2023-08-10 22:07:16 2023-08-10 22:34:16 0:27:00 0:20:05 0:06:55 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7366582 2023-08-10 21:16:56 2023-08-10 22:07:16 2023-08-10 22:31:27 0:24:11 0:17:37 0:06:34 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7366583 2023-08-10 21:16:57 2023-08-10 22:07:37 2023-08-10 23:03:40 0:56:03 0:48:28 0:07:35 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7366584 2023-08-10 21:16:58 2023-08-10 22:07:47 2023-08-10 22:56:53 0:49:06 0:39:41 0:09:25 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7366585 2023-08-10 21:16:59 2023-08-10 22:07:57 2023-08-10 22:34:59 0:27:02 0:17:56 0:09:06 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7366586 2023-08-10 21:17:00 2023-08-10 22:08:18 2023-08-10 23:02:39 0:54:21 0:40:18 0:14:03 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366587 2023-08-10 21:17:01 2023-08-10 22:09:28 2023-08-10 22:56:58 0:47:30 0:39:32 0:07:58 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7366588 2023-08-10 21:17:02 2023-08-10 22:11:39 2023-08-10 22:44:07 0:32:28 0:24:28 0:08:00 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7366589 2023-08-10 21:17:03 2023-08-10 22:13:00 2023-08-10 22:43:15 0:30:15 0:19:14 0:11:01 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
fail 7366590 2023-08-10 21:17:04 2023-08-10 22:13:30 2023-08-10 23:13:54 1:00:24 0:50:16 0:10:08 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7366591 2023-08-10 21:17:05 2023-08-10 22:14:41 2023-08-10 22:55:13 0:40:32 0:32:02 0:08:30 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7366592 2023-08-10 21:17:06 2023-08-10 22:15:51 2023-08-10 22:37:08 0:21:17 0:14:06 0:07:11 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7366593 2023-08-10 21:17:08 2023-08-10 22:15:51 2023-08-10 22:47:21 0:31:30 0:14:22 0:17:08 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7366594 2023-08-10 21:17:09 2023-08-10 22:16:12 2023-08-10 22:43:51 0:27:39 0:21:40 0:05:59 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7366595 2023-08-10 21:17:10 2023-08-10 22:16:42 2023-08-10 23:25:49 1:09:07 1:00:16 0:08:51 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7366596 2023-08-10 21:17:11 2023-08-10 22:17:03 2023-08-10 23:11:40 0:54:37 0:44:07 0:10:30 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7366597 2023-08-10 21:17:12 2023-08-10 22:17:13 2023-08-10 22:54:15 0:37:02 0:28:21 0:08:41 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7366598 2023-08-10 21:17:13 2023-08-10 22:17:14 2023-08-10 22:58:21 0:41:07 0:32:18 0:08:49 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366599 2023-08-10 21:17:14 2023-08-10 22:17:14 2023-08-10 22:42:38 0:25:24 0:13:04 0:12:20 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7366600 2023-08-10 21:17:15 2023-08-10 22:19:05 2023-08-10 23:05:11 0:46:06 0:35:57 0:10:09 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi110 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0a7eb8a0-37ce-11ee-9b37-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7366601 2023-08-10 21:17:16 2023-08-10 22:19:05 2023-08-10 22:49:30 0:30:25 0:19:01 0:11:24 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7366602 2023-08-10 21:17:17 2023-08-10 22:19:16 2023-08-10 22:56:50 0:37:34 0:28:06 0:09:28 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7366603 2023-08-10 21:17:18 2023-08-10 22:19:16 2023-08-10 22:57:12 0:37:56 0:28:09 0:09:47 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7366604 2023-08-10 21:17:20 2023-08-10 22:19:47 2023-08-10 22:59:13 0:39:26 0:25:45 0:13:41 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)

pass 7366605 2023-08-10 21:17:21 2023-08-10 22:19:47 2023-08-10 22:55:21 0:35:34 0:25:30 0:10:04 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7366606 2023-08-10 21:17:22 2023-08-10 22:19:57 2023-08-10 22:54:06 0:34:09 0:19:32 0:14:37 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7366607 2023-08-10 21:17:23 2023-08-10 22:20:58 2023-08-10 22:54:17 0:33:19 0:26:44 0:06:35 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7366608 2023-08-10 21:17:24 2023-08-10 22:21:08 2023-08-10 22:58:02 0:36:54 0:25:53 0:11:01 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7366609 2023-08-10 21:17:25 2023-08-10 22:21:29 2023-08-10 23:17:40 0:56:11 0:44:39 0:11:32 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7366610 2023-08-10 21:17:26 2023-08-10 22:21:39 2023-08-10 23:21:45 1:00:06 0:52:25 0:07:41 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7366611 2023-08-10 21:17:27 2023-08-10 22:22:40 2023-08-10 23:06:32 0:43:52 0:36:32 0:07:20 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7366612 2023-08-10 21:17:28 2023-08-10 22:22:50 2023-08-10 23:13:46 0:50:56 0:38:12 0:12:44 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7366613 2023-08-10 21:17:29 2023-08-10 22:25:51 2023-08-10 22:53:46 0:27:55 0:20:02 0:07:53 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7366614 2023-08-10 21:17:30 2023-08-10 22:26:41 2023-08-10 23:02:50 0:36:09 0:28:04 0:08:05 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7366615 2023-08-10 21:17:31 2023-08-10 22:27:32 2023-08-10 23:03:34 0:36:02 0:28:34 0:07:28 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7366616 2023-08-10 21:17:32 2023-08-10 22:28:32 2023-08-10 22:51:34 0:23:02 0:14:10 0:08:52 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7366617 2023-08-10 21:17:33 2023-08-10 22:28:33 2023-08-10 23:04:29 0:35:56 0:23:43 0:12:13 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2