Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7346439 2023-07-21 07:00:07 2023-07-21 07:23:04 2023-07-21 07:51:47 0:28:43 0:15:51 0:12:52 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7346440 2023-07-21 07:00:23 2023-07-21 07:23:18 2023-07-21 08:12:35 0:49:17 0:40:28 0:08:49 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7346441 2023-07-21 07:00:29 2023-07-21 07:23:19 2023-07-21 08:06:53 0:43:34 0:34:35 0:08:59 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7346442 2023-07-21 07:00:34 2023-07-21 07:23:19 2023-07-21 08:06:43 0:43:24 0:34:47 0:08:37 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} 1
pass 7346443 2023-07-21 07:00:35 2023-07-21 07:24:24 2023-07-21 08:13:36 0:49:12 0:35:24 0:13:48 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346444 2023-07-21 07:00:36 2023-07-21 07:25:21 2023-07-21 08:25:01 0:59:40 0:39:56 0:19:44 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7346445 2023-07-21 07:00:37 2023-07-21 07:26:57 2023-07-21 08:12:35 0:45:38 0:23:43 0:21:55 smithi main centos 8.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} 2
dead 7346446 2023-07-21 07:00:38 2023-07-21 07:28:20 2023-07-21 07:31:26 0:03:06 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi032

pass 7346447 2023-07-21 07:00:43 2023-07-21 07:29:07 2023-07-21 07:55:02 0:25:55 0:13:50 0:12:05 smithi main centos 8.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7346448 2023-07-21 07:00:44 2023-07-21 07:29:12 2023-07-21 07:59:53 0:30:41 0:13:54 0:16:47 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
fail 7346449 2023-07-21 07:00:45 2023-07-21 07:30:35 2023-07-21 08:31:16 1:00:41 0:46:50 0:13:51 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi100 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5e6a794c-279b-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7346450 2023-07-21 07:01:01 2023-07-21 07:31:31 2023-07-21 08:28:46 0:57:15 0:47:36 0:09:39 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7346451 2023-07-21 07:01:12 2023-07-21 07:32:36 2023-07-21 08:05:35 0:32:59 0:24:17 0:08:42 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7346452 2023-07-21 07:01:16 2023-07-21 07:32:37 2023-07-21 08:04:00 0:31:23 0:23:02 0:08:21 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7346453 2023-07-21 07:01:26 2023-07-21 07:32:37 2023-07-21 08:09:04 0:36:27 0:23:52 0:12:35 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7346454 2023-07-21 07:01:42 2023-07-21 07:37:35 2023-07-21 08:35:49 0:58:14 0:50:22 0:07:52 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7346455 2023-07-21 07:01:58 2023-07-21 07:37:36 2023-07-21 08:42:35 1:04:59 0:49:49 0:15:10 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7346456 2023-07-21 07:02:09 2023-07-21 07:42:12 2023-07-21 08:42:35 1:00:23 0:41:10 0:19:13 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7346457 2023-07-21 07:02:10 2023-07-21 07:48:39 2023-07-21 08:23:13 0:34:34 0:22:20 0:12:14 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7346458 2023-07-21 07:02:11 2023-07-21 07:49:14 2023-07-21 08:32:57 0:43:43 0:29:10 0:14:33 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7346459 2023-07-21 07:02:12 2023-07-21 07:52:25 2023-07-21 08:35:02 0:42:37 0:27:40 0:14:57 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7346460 2023-07-21 07:02:18 2023-07-21 07:52:36 2023-07-21 08:20:07 0:27:31 0:14:31 0:13:00 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
dead 7346461 2023-07-21 07:02:24 2023-07-21 07:52:36 2023-07-21 07:59:14 0:06:38 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Error reimaging machines: Expected smithi062's OS to be centos 8 but found rhel 8.6

dead 7346462 2023-07-21 07:02:30 2023-07-21 07:55:17 2023-07-21 07:59:00 0:03:43 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi160's OS to be centos 8 but found rhel 8.6

dead 7346463 2023-07-21 07:02:36 2023-07-21 07:55:27 2023-07-21 07:57:44 0:02:17 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi057

pass 7346464 2023-07-21 07:02:42 2023-07-21 08:41:37 1522 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} 3
dead 7346465 2023-07-21 07:02:52 2023-07-21 07:58:30 2023-07-21 08:03:03 0:04:33 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi057

dead 7346466 2023-07-21 07:03:08 2023-07-21 07:59:59 2023-07-21 08:14:06 0:14:07 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi062

dead 7346467 2023-07-21 07:03:18 2023-07-21 08:00:35 2023-07-21 08:05:08 0:04:33 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

Error reimaging machines: Expected smithi023's OS to be ubuntu 20.04 but found centos 8

dead 7346468 2023-07-21 07:03:24 2023-07-21 08:00:50 2023-07-21 08:03:25 0:02:35 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi184

dead 7346469 2023-07-21 07:03:33 2023-07-21 08:00:51 2023-07-21 08:03:55 0:03:04 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
Failure Reason:

Error reimaging machines: Expected smithi151's OS to be rhel 8.6 but found centos 8

dead 7346470 2023-07-21 07:03:34 2023-07-21 08:00:51 2023-07-21 08:03:45 0:02:54 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi170

dead 7346471 2023-07-21 07:03:35 2023-07-21 08:00:51 2023-07-21 08:03:36 0:02:45 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi088

pass 7346472 2023-07-21 07:03:35 2023-07-21 08:00:52 2023-07-21 08:50:52 0:50:00 0:34:52 0:15:08 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346473 2023-07-21 07:03:41 2023-07-21 08:04:16 2023-07-21 08:31:28 0:27:12 0:14:02 0:13:10 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
fail 7346474 2023-07-21 07:03:52 2023-07-21 08:04:16 2023-07-21 08:55:21 0:51:05 0:36:54 0:14:11 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi103 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afdd2d5c-279f-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7346475 2023-07-21 07:04:03 2023-07-21 08:04:17 2023-07-21 08:35:34 0:31:17 0:22:25 0:08:52 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7346476 2023-07-21 07:04:09 2023-07-21 08:04:17 2023-07-21 08:33:29 0:29:12 0:19:36 0:09:36 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7346477 2023-07-21 07:04:15 2023-07-21 08:04:53 2023-07-21 09:00:28 0:55:35 0:42:20 0:13:15 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7346478 2023-07-21 07:04:30 2023-07-21 08:05:35 2023-07-21 08:24:21 0:18:46 0:08:06 0:10:40 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
pass 7346479 2023-07-21 07:04:31 2023-07-21 08:05:48 2023-07-21 08:32:57 0:27:09 0:18:32 0:08:37 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7346480 2023-07-21 07:04:37 2023-07-21 08:05:48 2023-07-21 08:58:30 0:52:42 0:38:57 0:13:45 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7346481 2023-07-21 07:04:42 2023-07-21 08:06:31 2023-07-21 08:35:49 0:29:18 0:15:22 0:13:56 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7346482 2023-07-21 07:04:53 2023-07-21 08:07:01 2023-07-21 08:55:02 0:48:01 0:33:32 0:14:29 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
dead 7346483 2023-07-21 07:04:56 2023-07-21 08:09:21 2023-07-21 08:14:57 0:05:36 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi192

dead 7346484 2023-07-21 07:04:57 2023-07-21 08:11:51 2023-07-21 08:25:57 0:14:06 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi181

dead 7346485 2023-07-21 07:05:02 2023-07-21 08:11:56 2023-07-21 08:16:13 0:04:17 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi161's OS to be ubuntu 20.04 but found rhel 8.6

dead 7346486 2023-07-21 07:05:03 2023-07-21 08:12:20 2023-07-21 08:24:36 0:12:16 0:03:13 0:09:03 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

{'/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."}

dead 7346487 2023-07-21 07:05:11 2023-07-21 08:13:05 2023-07-21 08:16:18 0:03:13 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Expected smithi092's OS to be centos 8 but found rhel 8.6

pass 7346488 2023-07-21 07:05:17 2023-07-21 08:13:05 2023-07-21 08:57:51 0:44:46 0:31:50 0:12:56 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
dead 7346489 2023-07-21 07:05:22 2023-07-21 08:14:06 2023-07-21 08:17:45 0:03:39 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi089

pass 7346490 2023-07-21 07:05:38 2023-07-21 08:14:52 2023-07-21 08:49:35 0:34:43 0:26:16 0:08:27 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7346491 2023-07-21 07:05:44 2023-07-21 08:14:53 2023-07-21 08:43:55 0:29:02 0:15:19 0:13:43 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7346492 2023-07-21 07:06:00 2023-07-21 08:16:25 2023-07-21 08:47:30 0:31:05 0:22:34 0:08:31 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7346493 2023-07-21 07:06:14 2023-07-21 08:16:26 2023-07-21 08:48:57 0:32:31 0:16:15 0:16:16 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7346494 2023-07-21 07:06:24 2023-07-21 08:17:00 2023-07-21 09:14:43 0:57:43 0:44:35 0:13:08 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7346495 2023-07-21 07:06:30 2023-07-21 08:17:01 2023-07-21 09:19:14 1:02:13 0:50:14 0:11:59 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7346496 2023-07-21 07:06:41 2023-07-21 08:17:47 2023-07-21 09:10:33 0:52:46 0:40:19 0:12:27 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7346497 2023-07-21 07:06:57 2023-07-21 08:20:41 2023-07-21 08:54:23 0:33:42 0:19:11 0:14:31 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7346498 2023-07-21 07:07:08 2023-07-21 08:23:46 2023-07-21 09:16:23 0:52:37 0:39:52 0:12:45 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346499 2023-07-21 07:07:14 2023-07-21 08:24:51 2023-07-21 09:02:01 0:37:10 0:29:22 0:07:48 smithi main rhel 8.6 orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
pass 7346500 2023-07-21 07:07:25 2023-07-21 08:25:19 2023-07-21 08:51:16 0:25:57 0:18:07 0:07:50 smithi main rhel 8.6 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 7346501 2023-07-21 07:07:31 2023-07-21 08:25:19 2023-07-21 08:58:30 0:33:11 0:14:30 0:18:41 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
fail 7346502 2023-07-21 07:07:47 2023-07-21 08:28:39 2023-07-21 09:28:38 0:59:59 0:45:53 0:14:06 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi032 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8db2a014-27a3-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7346503 2023-07-21 07:08:03 2023-07-21 08:29:26 2023-07-21 09:20:19 0:50:53 0:35:13 0:15:40 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7346504 2023-07-21 07:08:15 2023-07-21 08:30:32 2023-07-21 09:04:44 0:34:12 0:21:56 0:12:16 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7346505 2023-07-21 07:08:25 2023-07-21 08:30:32 2023-07-21 09:04:19 0:33:47 0:25:16 0:08:31 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7346506 2023-07-21 07:08:26 2023-07-21 08:31:23 2023-07-21 09:17:53 0:46:30 0:33:19 0:13:11 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7346507 2023-07-21 07:08:37 2023-07-21 08:31:29 2023-07-21 09:08:54 0:37:25 0:21:10 0:16:15 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7346508 2023-07-21 07:08:48 2023-07-21 09:00:13 1141 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7346509 2023-07-21 07:08:54 2023-07-21 08:32:51 2023-07-21 09:03:48 0:30:57 0:21:51 0:09:06 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7346510 2023-07-21 07:09:00 2023-07-21 08:33:16 2023-07-21 08:57:32 0:24:16 0:17:09 0:07:07 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7346511 2023-07-21 07:09:16 2023-07-21 08:33:17 2023-07-21 09:30:22 0:57:05 0:48:06 0:08:59 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7346512 2023-07-21 07:09:26 2023-07-21 08:33:17 2023-07-21 09:32:27 0:59:10 0:40:33 0:18:37 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7346513 2023-07-21 07:09:37 2023-07-21 08:33:44 2023-07-21 09:06:44 0:33:00 0:21:58 0:11:02 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7346514 2023-07-21 07:09:48 2023-07-21 08:33:45 2023-07-21 09:29:24 0:55:39 0:44:58 0:10:41 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346515 2023-07-21 07:10:04 2023-07-21 08:33:45 2023-07-21 09:17:10 0:43:25 0:32:53 0:10:32 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7346516 2023-07-21 07:10:10 2023-07-21 09:19:14 2099 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
dead 7346517 2023-07-21 07:10:21 2023-07-21 08:34:54 2023-07-21 08:50:52 0:15:58 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi140

dead 7346518 2023-07-21 07:10:26 2023-07-21 08:35:37 2023-07-21 08:39:56 0:04:19 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi002

dead 7346519 2023-07-21 07:10:36 2023-07-21 08:35:38 2023-07-21 08:40:31 0:04:53 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
Failure Reason:

Error reimaging machines: Expected smithi154's OS to be rhel 8.6 but found centos 8

dead 7346520 2023-07-21 07:10:42 2023-07-21 08:36:13 2023-07-21 08:50:52 0:14:39 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi096

dead 7346521 2023-07-21 07:10:53 2023-07-21 08:36:33 2023-07-21 08:40:58 0:04:25 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Error reimaging machines: Expected smithi167's OS to be centos 8 but found rhel 8.6

dead 7346522 2023-07-21 07:10:59 2023-07-21 08:37:04 2023-07-21 08:41:51 0:04:47 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Error reimaging machines: Expected smithi133's OS to be rhel 8.6 but found centos 8

pass 7346523 2023-07-21 07:11:08 2023-07-21 08:37:30 2023-07-21 09:49:14 1:11:44 1:00:30 0:11:14 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7346524 2023-07-21 07:11:24 2023-07-21 08:39:20 2023-07-21 09:38:12 0:58:52 0:45:49 0:13:03 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7346525 2023-07-21 07:11:30 2023-07-21 08:40:44 2023-07-21 09:14:03 0:33:19 0:22:38 0:10:41 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7346526 2023-07-21 07:11:39 2023-07-21 08:41:04 2023-07-21 09:29:24 0:48:20 0:37:00 0:11:20 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346527 2023-07-21 07:11:45 2023-07-21 08:41:39 2023-07-21 09:14:05 0:32:26 0:14:38 0:17:48 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7346528 2023-07-21 07:11:51 2023-07-21 08:42:06 2023-07-21 09:33:40 0:51:34 0:36:35 0:14:59 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi097 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f836f8c6-27a4-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'"

pass 7346529 2023-07-21 07:12:07 2023-07-21 08:42:21 2023-07-21 10:11:35 1:29:14 0:19:33 1:09:41 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7346530 2023-07-21 07:12:13 2023-07-21 08:42:21 2023-07-21 09:27:25 0:45:04 0:30:11 0:14:53 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

reached maximum tries (301) after waiting for 300 seconds

pass 7346531 2023-07-21 07:12:19 2023-07-21 08:42:21 2023-07-21 09:25:20 0:42:59 0:30:45 0:12:14 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7346532 2023-07-21 07:12:29 2023-07-21 08:42:22 2023-07-21 09:33:09 0:50:47 0:40:10 0:10:37 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} 1
pass 7346533 2023-07-21 07:12:31 2023-07-21 08:42:32 2023-07-21 09:34:02 0:51:30 0:33:28 0:18:02 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
dead 7346534 2023-07-21 07:12:32 2023-07-21 08:42:43 2023-07-21 08:50:52 0:08:09 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi090

dead 7346535 2023-07-21 07:12:33 2023-07-21 08:42:43 2023-07-21 08:57:29 0:14:46 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi124

dead 7346536 2023-07-21 07:12:34 2023-07-21 08:42:49 2023-07-21 08:46:32 0:03:43 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi169

dead 7346537 2023-07-21 07:12:35 2023-07-21 08:43:01 2023-07-21 08:51:32 0:08:31 0:02:11 0:06:20 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

{'/dev/vg_nvme: already exists in filesystem', "Run `vgcreate --help' for more information.", "Creating volume group 'vg_nvme' failed"}

dead 7346538 2023-07-21 07:12:36 2023-07-21 08:43:12 2023-07-21 08:47:22 0:04:10 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: Expected smithi141's OS to be rhel 8.6 but found centos 8

pass 7346539 2023-07-21 07:12:42 2023-07-21 08:44:02 2023-07-21 09:39:51 0:55:49 0:41:51 0:13:58 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7346540 2023-07-21 07:12:58 2023-07-21 08:47:43 2023-07-21 09:43:09 0:55:26 0:37:12 0:18:14 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7346541 2023-07-21 07:13:03 2023-07-21 08:47:44 2023-07-21 09:17:28 0:29:44 0:19:44 0:10:00 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7346542 2023-07-21 07:13:18 2023-07-21 08:48:28 2023-07-21 09:36:49 0:48:21 0:35:57 0:12:24 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7346543 2023-07-21 07:13:24 2023-07-21 08:49:27 2023-07-21 09:24:38 0:35:11 0:26:45 0:08:26 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} 3
dead 7346544 2023-07-21 07:13:30 2023-07-21 08:49:53 2023-07-21 09:04:52 0:14:59 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

Error reimaging machines: Cannot connect to remote host smithi096

dead 7346545 2023-07-21 07:13:36 2023-07-21 08:51:47 2023-07-21 08:53:43 0:01:56 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi140