Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7133417 2023-01-22 23:01:02 2023-01-22 23:01:47 2023-01-22 23:46:15 0:44:28 0:23:11 0:21:17 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi067 with status 4: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:749c36e80e1d077a46b710d0776d199145af6283 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 26e8b09a-9aad-11ed-9e55-001a4aab830c -- bash -c \'ceph mon dump --format json | jq -e \'"\'"\'.mons | .[] | select(.name == "host.a") | .crush_location == "{datacenter=a}"\'"\'"\'\''

pass 7133418 2023-01-22 23:01:03 2023-01-22 23:01:47 2023-01-22 23:50:31 0:48:44 0:30:10 0:18:34 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7133419 2023-01-22 23:01:04 2023-01-22 23:01:48 2023-01-22 23:41:33 0:39:45 0:21:44 0:18:01 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7133420 2023-01-22 23:01:05 2023-01-22 23:01:48 2023-01-22 23:56:44 0:54:56 0:40:17 0:14:39 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7133421 2023-01-22 23:01:06 2023-01-22 23:01:48 2023-01-22 23:30:05 0:28:17 0:18:50 0:09:27 smithi main rhel 8.6 orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 7133422 2023-01-22 23:01:07 2023-01-22 23:01:49 2023-01-22 23:53:59 0:52:10 0:36:39 0:15:31 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7133423 2023-01-22 23:01:08 2023-01-22 23:01:49 2023-01-22 23:36:33 0:34:44 0:18:43 0:16:01 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7133424 2023-01-22 23:01:09 2023-01-22 23:01:49 2023-01-22 23:31:44 0:29:55 0:15:14 0:14:41 smithi main rhel 8.6 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 7133425 2023-01-22 23:01:10 2023-01-22 23:01:49 2023-01-22 23:35:19 0:33:30 0:16:01 0:17:29 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7133426 2023-01-22 23:01:11 2023-01-22 23:01:50 2023-01-22 23:49:36 0:47:46 0:34:26 0:13:20 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7133427 2023-01-22 23:01:12 2023-01-22 23:01:50 2023-01-22 23:54:17 0:52:27 0:41:10 0:11:17 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7133428 2023-01-22 23:01:13 2023-01-22 23:01:50 2023-01-22 23:34:21 0:32:31 0:14:38 0:17:53 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
pass 7133429 2023-01-22 23:01:14 2023-01-22 23:01:50 2023-01-22 23:39:25 0:37:35 0:21:00 0:16:35 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
dead 7133430 2023-01-22 23:01:15 2023-01-22 23:01:51 2023-01-22 23:17:12 0:15:21 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 7133431 2023-01-22 23:01:16 2023-01-22 23:01:51 2023-01-22 23:29:37 0:27:46 0:19:27 0:08:19 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7133432 2023-01-22 23:01:17 2023-01-22 23:01:51 2023-01-22 23:33:09 0:31:18 0:16:50 0:14:28 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7133433 2023-01-22 23:01:18 2023-01-22 23:01:52 2023-01-22 23:33:06 0:31:14 0:18:39 0:12:35 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7133434 2023-01-22 23:01:19 2023-01-22 23:01:52 2023-01-22 23:48:47 0:46:55 0:30:42 0:16:13 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7133435 2023-01-22 23:01:20 2023-01-22 23:01:52 2023-01-22 23:39:21 0:37:29 0:24:33 0:12:56 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7133436 2023-01-22 23:01:21 2023-01-22 23:01:52 2023-01-22 23:19:28 0:17:36 0:09:45 0:07:51 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7133437 2023-01-22 23:01:22 2023-01-22 23:01:53 2023-01-22 23:37:45 0:35:52 0:19:10 0:16:42 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7133438 2023-01-22 23:01:23 2023-01-22 23:01:53 2023-01-23 00:02:43 1:00:50 0:44:38 0:16:12 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7133439 2023-01-22 23:01:24 2023-01-22 23:01:53 2023-01-23 00:02:31 1:00:38 0:40:27 0:20:11 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7133440 2023-01-22 23:01:25 2023-01-22 23:01:53 2023-01-22 23:32:23 0:30:30 0:16:10 0:14:20 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7133441 2023-01-22 23:01:26 2023-01-22 23:01:54 2023-01-22 23:34:11 0:32:17 0:18:23 0:13:54 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 7133442 2023-01-22 23:01:27 2023-01-22 23:01:54 2023-01-22 23:33:13 0:31:19 0:17:38 0:13:41 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7133443 2023-01-22 23:01:28 2023-01-22 23:01:54 2023-01-22 23:52:20 0:50:26 0:31:50 0:18:36 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7133444 2023-01-22 23:01:29 2023-01-22 23:01:55 2023-01-22 23:46:16 0:44:21 0:24:27 0:19:54 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7133445 2023-01-22 23:01:30 2023-01-22 23:01:55 2023-01-22 23:54:37 0:52:42 0:33:17 0:19:25 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7133446 2023-01-22 23:01:31 2023-01-22 23:01:55 2023-01-22 23:41:33 0:39:38 0:20:14 0:19:24 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7133447 2023-01-22 23:01:32 2023-01-22 23:01:55 2023-01-22 23:14:44 0:12:49 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

Stale jobs detected, aborting.

dead 7133448 2023-01-22 23:01:33 2023-01-22 23:01:56 2023-01-22 23:01:57 0:00:01 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/190/task

pass 7133449 2023-01-22 23:01:34 2023-01-22 23:01:56 2023-01-22 23:51:25 0:49:29 0:32:09 0:17:20 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} 1
pass 7133450 2023-01-22 23:01:34 2023-01-22 23:01:56 2023-01-22 23:47:59 0:46:03 0:30:33 0:15:30 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7133451 2023-01-22 23:01:35 2023-01-22 23:01:56 2023-01-22 23:42:42 0:40:46 0:21:30 0:19:16 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7133452 2023-01-22 23:01:36 2023-01-22 23:01:57 2023-01-22 23:38:39 0:36:42 0:20:00 0:16:42 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7133453 2023-01-22 23:01:37 2023-01-22 23:01:57 2023-01-22 23:58:53 0:56:56 0:40:46 0:16:10 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7133454 2023-01-22 23:01:38 2023-01-22 23:01:57 2023-01-22 23:36:23 0:34:26 0:17:06 0:17:20 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
dead 7133455 2023-01-22 23:01:39 2023-01-22 23:01:57 2023-01-22 23:13:52 0:11:55 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

Error reimaging machines: 'ssh_keyscan smithi085.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

pass 7133456 2023-01-22 23:01:40 2023-01-22 23:01:58 2023-01-22 23:54:03 0:52:05 0:39:57 0:12:08 smithi main rhel 8.6 orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7133457 2023-01-22 23:01:41 2023-01-22 23:01:58 2023-01-22 23:59:35 0:57:37 0:43:30 0:14:07 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7133458 2023-01-22 23:01:42 2023-01-22 23:01:58 2023-01-22 23:42:56 0:40:58 0:21:17 0:19:41 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7133459 2023-01-22 23:01:43 2023-01-22 23:01:59 2023-01-22 23:50:42 0:48:43 0:31:30 0:17:13 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7133460 2023-01-22 23:01:44 2023-01-22 23:01:59 2023-01-22 23:30:41 0:28:42 0:16:34 0:12:08 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7133461 2023-01-22 23:01:45 2023-01-22 23:01:59 2023-01-22 23:41:12 0:39:13 0:27:12 0:12:01 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7133462 2023-01-22 23:01:46 2023-01-22 23:01:59 2023-01-22 23:52:28 0:50:29 0:35:31 0:14:58 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7133463 2023-01-22 23:01:47 2023-01-22 23:02:00 2023-01-22 23:37:37 0:35:37 0:17:53 0:17:44 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7133464 2023-01-22 23:01:48 2023-01-22 23:41:39 1496 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi049 with status 4: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:749c36e80e1d077a46b710d0776d199145af6283 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98c3eac8-9aac-11ed-9e55-001a4aab830c -- bash -c \'ceph mon dump --format json | jq -e \'"\'"\'.mons | .[] | select(.name == "host.a") | .crush_location == "{datacenter=a}"\'"\'"\'\''

pass 7133465 2023-01-22 23:01:49 2023-01-22 23:02:00 2023-01-22 23:45:44 0:43:44 0:27:53 0:15:51 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7133466 2023-01-22 23:01:50 2023-01-22 23:02:01 2023-01-22 23:41:02 0:39:01 0:18:14 0:20:47 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7133467 2023-01-22 23:01:51 2023-01-22 23:02:01 2023-01-22 23:41:30 0:39:29 0:21:07 0:18:22 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7133468 2023-01-22 23:01:52 2023-01-22 23:36:26 1064 smithi main centos 8.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} 2
pass 7133469 2023-01-22 23:01:53 2023-01-22 23:02:01 2023-01-22 23:28:30 0:26:29 0:17:13 0:09:16 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7133470 2023-01-22 23:01:54 2023-01-22 23:02:02 2023-01-22 23:34:28 0:32:26 0:16:50 0:15:36 smithi main rhel 8.6 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 7133471 2023-01-22 23:01:55 2023-01-22 23:02:02 2023-01-22 23:39:21 0:37:19 0:17:58 0:19:21 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7133472 2023-01-22 23:01:56 2023-01-23 00:26:31 3852 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7133473 2023-01-22 23:01:57 2023-01-22 23:02:03 2023-01-22 23:55:35 0:53:32 0:41:48 0:11:44 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7133474 2023-01-22 23:01:58 2023-01-22 23:02:03 2023-01-22 23:30:26 0:28:23 0:10:06 0:18:17 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} 1
pass 7133475 2023-01-22 23:01:59 2023-01-22 23:02:03 2023-01-22 23:39:27 0:37:24 0:18:36 0:18:48 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7133476 2023-01-22 23:02:00 2023-01-22 23:02:04 2023-01-22 23:22:01 0:19:57 0:07:15 0:12:42 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

{'smithi122.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi122.front.sepia.ceph.com port 22: No route to host'}}

fail 7133477 2023-01-22 23:02:02 2023-01-22 23:02:14 2023-01-22 23:21:50 0:19:36 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi085 with status 1: 'sudo yum install -y kernel'

dead 7133478 2023-01-22 23:02:03 2023-01-22 23:22:35 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

SSH connection to smithi122 was lost: 'sudo apt-get update'

dead 7133479 2023-01-22 23:02:04 2023-01-22 23:21:50 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SSH connection to smithi085 was lost: 'mktemp'

pass 7133480 2023-01-22 23:02:05 2023-01-22 23:15:06 2023-01-22 23:44:27 0:29:21 0:18:35 0:10:46 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7133481 2023-01-22 23:02:06 2023-01-22 23:17:27 2023-01-22 23:46:59 0:29:32 0:15:43 0:13:49 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
dead 7133482 2023-01-22 23:02:07 2023-01-22 23:21:58 2023-01-22 23:29:36 0:07:38 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

SSH connection to smithi122 was lost: 'sudo grub2-mkconfig -o /boot/grub2/grub.cfg'

pass 7133483 2023-01-22 23:02:08 2023-01-22 23:22:09 2023-01-22 23:45:14 0:23:05 0:16:42 0:06:23 smithi main rhel 8.6 orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7133484 2023-01-22 23:02:09 2023-01-22 23:22:39 2023-01-22 23:29:44 0:07:05 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed on smithi122 with status 1: 'sudo yum install -y kernel'

pass 7133485 2023-01-22 23:02:10 2023-01-22 23:22:50 2023-01-22 23:51:06 0:28:16 0:17:03 0:11:13 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7133486 2023-01-22 23:02:11 2023-01-22 23:28:31 2023-01-23 00:12:45 0:44:14 0:34:39 0:09:35 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7133487 2023-01-22 23:02:12 2023-01-22 23:29:41 2023-01-23 00:13:11 0:43:30 0:34:11 0:09:19 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7133488 2023-01-22 23:02:13 2023-01-22 23:30:12 2023-01-23 00:17:33 0:47:21 0:38:30 0:08:51 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
fail 7133489 2023-01-22 23:02:14 2023-01-22 23:30:32 2023-01-22 23:45:34 0:15:02 0:06:28 0:08:34 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
Failure Reason:

Command failed on smithi137 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

pass 7133490 2023-01-22 23:02:15 2023-01-22 23:30:42 2023-01-22 23:56:26 0:25:44 0:17:50 0:07:54 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7133491 2023-01-22 23:02:16 2023-01-22 23:32:34 2023-01-23 00:16:32 0:43:58 0:33:41 0:10:17 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7133492 2023-01-22 23:02:17 2023-01-22 23:33:15 2023-01-23 00:08:18 0:35:03 0:26:30 0:08:33 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7133493 2023-01-22 23:02:17 2023-01-22 23:33:15 2023-01-22 23:58:28 0:25:13 0:15:58 0:09:15 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7133494 2023-01-22 23:02:18 2023-01-22 23:33:15 2023-01-23 00:06:25 0:33:10 0:21:49 0:11:21 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7133495 2023-01-22 23:02:19 2023-01-22 23:34:26 2023-01-23 00:09:50 0:35:24 0:24:26 0:10:58 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7133496 2023-01-22 23:02:20 2023-01-22 23:35:26 2023-01-23 00:00:21 0:24:55 0:14:28 0:10:27 smithi main centos 8.stream orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7133497 2023-01-22 23:02:21 2023-01-22 23:36:26 2023-01-23 00:12:52 0:36:26 0:30:35 0:05:51 smithi main rhel 8.6 orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} 1
pass 7133498 2023-01-22 23:02:22 2023-01-22 23:36:27 2023-01-23 00:09:37 0:33:10 0:27:46 0:05:24 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7133499 2023-01-22 23:02:23 2023-01-22 23:36:27 2023-01-23 00:04:24 0:27:57 0:17:35 0:10:22 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7133500 2023-01-22 23:02:24 2023-01-22 23:36:37 2023-01-23 00:07:44 0:31:07 0:19:33 0:11:34 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7133501 2023-01-22 23:02:25 2023-01-22 23:37:38 2023-01-23 00:26:59 0:49:21 0:38:58 0:10:23 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7133502 2023-01-22 23:02:26 2023-01-22 23:37:48 2023-01-23 00:24:20 0:46:32 0:39:41 0:06:51 smithi main rhel 8.6 orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7133503 2023-01-22 23:02:27 2023-01-22 23:38:48 2023-01-23 00:04:40 0:25:52 0:15:40 0:10:12 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7133504 2023-01-22 23:02:28 2023-01-22 23:39:29 2023-01-23 00:02:41 0:23:12 0:17:14 0:05:58 smithi main rhel 8.6 orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7133505 2023-01-22 23:02:29 2023-01-22 23:39:29 2023-01-23 00:22:38 0:43:09 0:34:08 0:09:01 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7133506 2023-01-22 23:02:30 2023-01-22 23:39:29 2023-01-23 00:06:47 0:27:18 0:17:19 0:09:59 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7133507 2023-01-22 23:02:31 2023-01-22 23:39:30 2023-01-23 00:47:09 1:07:39 0:55:23 0:12:16 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi158 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9fc144e8-9ab0-11ed-9e55-001a4aab830c -e sha1=749c36e80e1d077a46b710d0776d199145af6283 -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

pass 7133508 2023-01-22 23:02:32 2023-01-22 23:41:10 2023-01-23 00:20:06 0:38:56 0:26:39 0:12:17 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7133509 2023-01-22 23:02:32 2023-01-22 23:41:40 2023-01-23 00:24:25 0:42:45 0:31:00 0:11:45 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7133510 2023-01-22 23:02:33 2023-01-22 23:41:41 2023-01-23 00:08:09 0:26:28 0:20:03 0:06:25 smithi main rhel 8.6 orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7133511 2023-01-22 23:02:34 2023-01-22 23:41:41 2023-01-23 00:13:56 0:32:15 0:20:02 0:12:13 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

Command failed on smithi016 with status 4: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:749c36e80e1d077a46b710d0776d199145af6283 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4bd57330-9ab1-11ed-9e55-001a4aab830c -- bash -c \'ceph mon dump --format json | jq -e \'"\'"\'.mons | .[] | select(.name == "host.a") | .crush_location == "{datacenter=a}"\'"\'"\'\''