Pulpito

adking-2023-03-06_16:09:09-orch:cephadm-wip-adk-testing-2023-03-04-1231-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
adking 2023-03-06 16:09:09 2023-03-06 16:10:06 2023-03-06 18:58:15 2:48:09 orch:cephadm wip-adk-testing-2023-03-04-1231 smithi 710f1aa 80 12 3

Average wait time: 0:11:00

See other runs of suite 'orch:cephadm' on branch 'wip-adk-testing-2023-03-04-1231'?

See other runs on branch 'wip-adk-testing-2023-03-04-1231'?

See other runs scheduled on 2023-03-06?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7195233 2023-03-06 16:09:14 2023-03-06 16:10:03 2023-03-06 16:41:58 0:31:55 0:17:27 0:14:28 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi016 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 087c1a7e-bc3c-11ed-9aea-001a4aab830c -- bash -c 'ceph nfs cluster create foo --ingress --virtual-ip 10.0.31.16/16'"

pass 7195234 2023-03-06 16:09:15 2023-03-06 16:10:03 2023-03-06 17:24:01 1:13:58 1:02:51 0:11:07 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7195235 2023-03-06 16:09:16 2023-03-06 16:10:03 2023-03-06 16:44:47 0:34:44 0:24:05 0:10:39 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7195236 2023-03-06 16:09:17 2023-03-06 16:10:04 2023-03-06 16:32:41 0:22:37 0:09:47 0:12:50 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi158 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3167fa52-bc3c-11ed-9aea-001a4aab830c -- ceph mon dump -f json'

pass 7195237 2023-03-06 16:09:18 2023-03-06 16:10:04 2023-03-06 16:38:15 0:28:11 0:17:41 0:10:30 smithi main rhel 8.6 orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 7195238 2023-03-06 16:09:19 2023-03-06 16:10:04 2023-03-06 16:55:57 0:45:53 0:34:37 0:11:16 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7195239 2023-03-06 16:09:20 2023-03-06 16:10:05 2023-03-06 16:42:08 0:32:03 0:17:04 0:14:59 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7195240 2023-03-06 16:09:21 2023-03-06 16:10:05 2023-03-06 16:43:47 0:33:42 0:17:16 0:16:26 smithi main ubuntu 20.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7195241 2023-03-06 16:09:22 2023-03-06 16:10:06 2023-03-06 16:33:55 0:23:49 0:13:30 0:10:19 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7195242 2023-03-06 16:09:23 2023-03-06 16:10:06 2023-03-06 17:05:41 0:55:35 0:38:14 0:17:21 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7195243 2023-03-06 16:09:24 2023-03-06 16:10:06 2023-03-06 16:57:55 0:47:49 0:34:29 0:13:20 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
fail 7195244 2023-03-06 16:09:25 2023-03-06 16:10:06 2023-03-06 16:20:53 0:10:47 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

Stale jobs detected, aborting.

dead 7195245 2023-03-06 16:09:26 2023-03-06 16:10:07 2023-03-06 16:28:39 0:18:32 0:08:54 0:09:38 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
Failure Reason:

{'smithi156.front.sepia.ceph.com': {'changed': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi156.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}}

fail 7195246 2023-03-06 16:09:27 2023-03-06 16:10:07 2023-03-06 16:35:02 0:24:55 0:14:27 0:10:28 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi153 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cfeb30a0-bc3b-11ed-9aea-001a4aab830c -- bash -c 'ceph nfs cluster create foo --ingress --virtual-ip 10.0.31.153/16 --port 2999'"

pass 7195247 2023-03-06 16:09:28 2023-03-06 16:10:08 2023-03-06 16:52:05 0:41:57 0:30:58 0:10:59 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} 1
pass 7195248 2023-03-06 16:09:29 2023-03-06 16:10:08 2023-03-06 16:58:56 0:48:48 0:33:20 0:15:28 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195249 2023-03-06 16:09:31 2023-03-06 16:10:08 2023-03-06 16:55:59 0:45:51 0:33:18 0:12:33 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7195250 2023-03-06 16:09:32 2023-03-06 16:10:09 2023-03-06 17:03:19 0:53:10 0:38:36 0:14:34 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7195251 2023-03-06 16:09:33 2023-03-06 16:10:09 2023-03-06 16:38:58 0:28:49 0:16:48 0:12:01 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7195252 2023-03-06 16:09:34 2023-03-06 16:10:09 2023-03-06 16:39:52 0:29:43 0:18:53 0:10:50 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} 1
pass 7195253 2023-03-06 16:09:35 2023-03-06 16:10:09 2023-03-06 16:35:45 0:25:36 0:15:13 0:10:23 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7195254 2023-03-06 16:09:36 2023-03-06 16:10:10 2023-03-06 16:47:37 0:37:27 0:24:53 0:12:34 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7195255 2023-03-06 16:09:37 2023-03-06 16:10:10 2023-03-06 16:37:29 0:27:19 0:15:55 0:11:24 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7195256 2023-03-06 16:09:38 2023-03-06 16:10:10 2023-03-06 16:50:05 0:39:55 0:24:36 0:15:19 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7195257 2023-03-06 16:09:39 2023-03-06 16:10:11 2023-03-06 17:00:10 0:49:59 0:37:17 0:12:42 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7195258 2023-03-06 16:09:40 2023-03-06 16:10:11 2023-03-06 16:50:32 0:40:21 0:23:54 0:16:27 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7195259 2023-03-06 16:09:41 2023-03-06 16:10:12 2023-03-06 16:53:42 0:43:30 0:31:41 0:11:49 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7195260 2023-03-06 16:09:42 2023-03-06 16:10:12 2023-03-06 17:18:13 1:08:01 0:55:18 0:12:43 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi057 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4b569de2-bc3c-11ed-9aea-001a4aab830c -e sha1=710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

pass 7195261 2023-03-06 16:09:43 2023-03-06 16:10:12 2023-03-06 16:53:29 0:43:17 0:24:57 0:18:20 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} 5
fail 7195262 2023-03-06 16:09:44 2023-03-06 16:18:24 2023-03-06 16:34:03 0:15:39 0:07:17 0:08:22 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

{'smithi156.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi156.front.sepia.ceph.com port 22: No route to host'}}

dead 7195263 2023-03-06 16:09:45 2023-03-06 16:20:55 2023-03-06 16:33:37 0:12:42 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Error reimaging machines: SSH connection to smithi156 was lost: "while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done"

dead 7195264 2023-03-06 16:09:46 2023-03-06 16:28:47 2023-03-06 16:41:29 0:12:42 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

SSH connection to smithi156 was lost: 'sudo grub2-mkconfig -o /boot/grub2/grub.cfg'

pass 7195265 2023-03-06 16:09:47 2023-03-06 16:33:48 2023-03-06 16:54:51 0:21:03 0:14:32 0:06:31 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7195266 2023-03-06 16:09:48 2023-03-06 16:33:58 2023-03-06 16:58:51 0:24:53 0:15:32 0:09:21 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7195267 2023-03-06 16:09:49 2023-03-06 16:33:59 2023-03-06 16:41:26 0:07:27 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

Command failed on smithi156 with status 1: 'sudo yum install -y kernel'

pass 7195268 2023-03-06 16:09:50 2023-03-06 16:34:19 2023-03-06 17:22:27 0:48:08 0:40:10 0:07:58 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7195269 2023-03-06 16:09:51 2023-03-06 16:35:10 2023-03-06 17:20:56 0:45:46 0:38:49 0:06:57 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7195270 2023-03-06 16:09:52 2023-03-06 16:35:50 2023-03-06 16:59:02 0:23:12 0:12:24 0:10:48 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7195271 2023-03-06 16:09:53 2023-03-06 16:37:31 2023-03-06 17:30:28 0:52:57 0:40:46 0:12:11 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7195272 2023-03-06 16:09:54 2023-03-06 16:38:21 2023-03-06 17:02:22 0:24:01 0:16:34 0:07:27 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7195273 2023-03-06 16:09:55 2023-03-06 16:39:01 2023-03-06 17:19:11 0:40:10 0:30:41 0:09:29 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195274 2023-03-06 16:09:56 2023-03-06 16:40:02 2023-03-06 17:23:42 0:43:40 0:31:10 0:12:30 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7195275 2023-03-06 16:09:57 2023-03-06 16:41:32 2023-03-06 17:08:42 0:27:10 0:20:46 0:06:24 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
fail 7195276 2023-03-06 16:09:58 2023-03-06 16:44:56 2023-03-06 17:06:58 0:22:02 0:12:37 0:09:25 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Command failed on smithi099 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6dc5b3fa-bc40-11ed-9aea-001a4aab830c -- ceph osd stat -f json'

pass 7195277 2023-03-06 16:09:59 2023-03-06 16:47:46 2023-03-06 17:49:20 1:01:34 0:52:31 0:09:03 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7195278 2023-03-06 16:10:00 2023-03-06 16:50:07 2023-03-06 17:34:57 0:44:50 0:34:01 0:10:49 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7195279 2023-03-06 16:10:01 2023-03-06 16:50:38 2023-03-06 17:21:44 0:31:06 0:17:53 0:13:13 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7195280 2023-03-06 16:10:03 2023-03-06 16:52:08 2023-03-06 17:18:47 0:26:39 0:15:50 0:10:49 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7195281 2023-03-06 16:10:04 2023-03-06 17:28:36 1551 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7195282 2023-03-06 16:10:05 2023-03-06 16:53:39 2023-03-06 17:23:39 0:30:00 0:20:13 0:09:47 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7195283 2023-03-06 16:10:06 2023-03-06 17:08:42 576 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7195284 2023-03-06 16:10:07 2023-03-06 16:53:50 2023-03-06 17:36:03 0:42:13 0:31:08 0:11:05 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195285 2023-03-06 16:10:08 2023-03-06 16:55:00 2023-03-06 17:21:09 0:26:09 0:15:42 0:10:27 smithi main centos 8.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} 2
pass 7195286 2023-03-06 16:10:09 2023-03-06 16:56:01 2023-03-06 17:21:18 0:25:17 0:15:06 0:10:11 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7195287 2023-03-06 16:10:10 2023-03-06 17:24:14 1096 smithi main ubuntu 20.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 7195288 2023-03-06 16:10:11 2023-03-06 16:56:01 2023-03-06 17:22:41 0:26:40 0:13:26 0:13:14 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7195289 2023-03-06 16:10:12 2023-03-06 16:58:52 2023-03-06 17:53:13 0:54:21 0:44:43 0:09:38 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7195290 2023-03-06 16:10:13 2023-03-06 16:59:03 2023-03-06 17:46:30 0:47:27 0:37:24 0:10:03 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7195291 2023-03-06 16:10:14 2023-03-06 16:59:03 2023-03-06 17:25:30 0:26:27 0:15:38 0:10:49 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
fail 7195292 2023-03-06 16:10:15 2023-03-06 17:00:13 2023-03-06 17:25:41 0:25:28 0:14:15 0:11:13 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Command failed on smithi061 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e0d8bc00-bc42-11ed-9aea-001a4aab830c -- bash -c 'ceph nfs cluster create foo --ingress --virtual-ip 10.0.31.61/16'"

pass 7195293 2023-03-06 16:10:16 2023-03-06 17:02:24 2023-03-06 17:29:03 0:26:39 0:15:27 0:11:12 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7195294 2023-03-06 16:10:17 2023-03-06 17:03:24 2023-03-06 17:31:54 0:28:30 0:18:49 0:09:41 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7195295 2023-03-06 16:10:18 2023-03-06 17:05:45 2023-03-06 17:39:40 0:33:55 0:27:34 0:06:21 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 7195296 2023-03-06 16:10:19 2023-03-06 17:05:56 2023-03-06 17:30:10 0:24:14 0:16:05 0:08:09 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi099 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 29d83d04-bc43-11ed-9aea-001a4aab830c -- bash -c 'ceph nfs cluster create foo --ingress --virtual-ip 10.0.31.99/16'"

pass 7195297 2023-03-06 16:10:20 2023-03-06 17:07:06 2023-03-06 17:47:58 0:40:52 0:30:29 0:10:23 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195298 2023-03-06 16:10:21 2023-03-06 17:08:47 2023-03-06 17:58:35 0:49:48 0:37:51 0:11:57 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7195299 2023-03-06 16:10:22 2023-03-06 17:11:58 2023-03-06 17:59:28 0:47:30 0:31:26 0:16:04 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7195300 2023-03-06 16:10:23 2023-03-06 17:18:19 2023-03-06 17:52:38 0:34:19 0:24:37 0:09:42 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_monitoring_stack_basic} 3
pass 7195301 2023-03-06 16:10:24 2023-03-06 17:18:49 2023-03-06 17:42:18 0:23:29 0:16:58 0:06:31 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7195302 2023-03-06 16:10:25 2023-03-06 17:19:20 2023-03-06 17:54:09 0:34:49 0:27:09 0:07:40 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7195303 2023-03-06 16:10:26 2023-03-06 17:21:00 2023-03-06 18:12:21 0:51:21 0:41:21 0:10:00 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7195304 2023-03-06 16:10:27 2023-03-06 17:21:11 2023-03-06 17:46:38 0:25:27 0:16:00 0:09:27 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7195305 2023-03-06 16:10:28 2023-03-06 17:21:21 2023-03-06 17:46:39 0:25:18 0:16:36 0:08:42 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7195306 2023-03-06 16:10:29 2023-03-06 17:21:52 2023-03-06 17:50:46 0:28:54 0:17:22 0:11:32 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi153 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 951c6bce-bc45-11ed-9aea-001a4aab830c -- bash -c 'ceph nfs cluster create foo --ingress --virtual-ip 10.0.31.153/16 --port 2999'"

pass 7195307 2023-03-06 16:10:30 2023-03-06 17:22:32 2023-03-06 18:03:47 0:41:15 0:32:27 0:08:48 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
pass 7195308 2023-03-06 16:10:31 2023-03-06 17:22:42 2023-03-06 18:10:26 0:47:44 0:37:40 0:10:04 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7195309 2023-03-06 16:10:32 2023-03-06 17:22:43 2023-03-06 18:18:04 0:55:21 0:43:23 0:11:58 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7195310 2023-03-06 16:10:33 2023-03-06 17:23:43 2023-03-06 17:48:59 0:25:16 0:15:12 0:10:04 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7195311 2023-03-06 16:10:34 2023-03-06 17:23:43 2023-03-06 17:47:32 0:23:49 0:13:35 0:10:14 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7195312 2023-03-06 16:10:35 2023-03-06 17:24:24 2023-03-06 18:06:55 0:42:31 0:32:46 0:09:45 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195313 2023-03-06 16:10:36 2023-03-06 17:25:44 2023-03-06 17:51:01 0:25:17 0:18:14 0:07:03 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7195314 2023-03-06 16:10:37 2023-03-06 17:25:45 2023-03-06 17:55:49 0:30:04 0:15:00 0:15:04 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7195315 2023-03-06 16:10:38 2023-03-06 17:28:46 2023-03-06 18:08:45 0:39:59 0:26:49 0:13:10 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7195316 2023-03-06 16:10:39 2023-03-06 17:29:06 2023-03-06 17:53:16 0:24:10 0:16:27 0:07:43 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7195317 2023-03-06 16:10:40 2023-03-06 17:30:16 2023-03-06 18:07:43 0:37:27 0:24:47 0:12:40 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7195318 2023-03-06 16:10:41 2023-03-06 17:30:37 2023-03-06 18:45:44 1:15:07 1:00:16 0:14:51 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 31d022fc-bc47-11ed-9aea-001a4aab830c -e sha1=710f1aa0030e04b9f34e7ffa8424e7dfaaa2752d -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

pass 7195319 2023-03-06 16:10:42 2023-03-06 17:31:57 2023-03-06 18:40:33 1:08:36 0:59:18 0:09:18 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7195320 2023-03-06 16:10:43 2023-03-06 17:34:58 2023-03-06 18:03:00 0:28:02 0:19:58 0:08:04 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7195321 2023-03-06 16:10:44 2023-03-06 17:36:09 2023-03-06 18:13:43 0:37:34 0:27:09 0:10:25 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7195322 2023-03-06 16:10:45 2023-03-06 17:40:10 2023-03-06 18:17:29 0:37:19 0:25:25 0:11:54 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7195323 2023-03-06 16:10:46 2023-03-06 17:42:20 2023-03-06 18:27:56 0:45:36 0:31:17 0:14:19 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7195324 2023-03-06 16:10:47 2023-03-06 17:46:31 2023-03-06 18:09:50 0:23:19 0:16:48 0:06:31 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7195325 2023-03-06 16:10:48 2023-03-06 17:46:42 2023-03-06 18:11:35 0:24:53 0:15:55 0:08:58 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7195326 2023-03-06 16:10:49 2023-03-06 17:46:42 2023-03-06 18:12:36 0:25:54 0:16:17 0:09:37 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7195327 2023-03-06 16:10:50 2023-03-06 18:28:53 2023-03-06 18:58:15 0:29:22 0:17:24 0:11:58 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2