Pulpito

yuriw-2023-05-06_14:47:29-orch-reef-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
yuriw 2023-05-06 14:47:29 2023-05-07 12:45:17 2023-05-08 02:08:06 13:22:49 orch reef smithi 1fd31bd 116 22 3

Average wait time: 0:11:24

See other runs of suite 'orch' on branch 'reef'?

See other runs on branch 'reef'?

See other runs scheduled on 2023-05-06?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7264505 2023-05-06 14:47:38 2023-05-07 12:45:17 2023-05-07 13:11:33 0:26:16 0:18:31 0:07:45 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7264507 2023-05-06 14:47:39 2023-05-07 12:45:48 2023-05-07 13:35:47 0:49:59 0:36:53 0:13:06 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8110a11e-ecd7-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264509 2023-05-06 14:47:40 2023-05-07 12:46:18 2023-05-07 13:07:58 0:21:40 0:15:43 0:05:57 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7264511 2023-05-06 14:47:41 2023-05-07 12:46:49 2023-05-07 13:06:19 0:19:30 0:10:32 0:08:58 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7264513 2023-05-06 14:47:42 2023-05-07 12:47:29 2023-05-07 13:22:07 0:34:38 0:25:12 0:09:26 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7264515 2023-05-06 14:47:42 2023-05-07 12:48:00 2023-05-07 13:14:59 0:26:59 0:19:47 0:07:12 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
dead 7264517 2023-05-06 14:47:43 2023-05-07 12:48:00 2023-05-08 00:58:38 12:10:38 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 7264519 2023-05-06 14:47:44 2023-05-07 12:49:30 2023-05-07 13:42:39 0:53:09 0:39:26 0:13:43 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7264521 2023-05-06 14:47:45 2023-05-07 12:49:31 2023-05-07 13:23:49 0:34:18 0:23:53 0:10:25 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
fail 7264523 2023-05-06 14:47:45 2023-05-07 12:50:01 2023-05-07 13:08:39 0:18:38 0:11:05 0:07:33 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi093 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d64cf90c-ecd7-11ed-9b01-001a4aab830c -- ceph mon dump -f json'

pass 7264525 2023-05-06 14:47:46 2023-05-07 12:51:32 2023-05-07 13:25:20 0:33:48 0:25:56 0:07:52 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7264527 2023-05-06 14:47:47 2023-05-07 12:52:12 2023-05-07 13:18:25 0:26:13 0:18:08 0:08:05 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7264529 2023-05-06 14:47:48 2023-05-07 12:52:33 2023-05-07 13:15:07 0:22:34 0:09:29 0:13:05 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7264531 2023-05-06 14:47:49 2023-05-07 12:56:04 2023-05-07 13:26:00 0:29:56 0:18:41 0:11:15 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7264533 2023-05-06 14:47:49 2023-05-07 12:56:04 2023-05-07 13:27:35 0:31:31 0:20:09 0:11:22 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
fail 7264535 2023-05-06 14:47:50 2023-05-07 12:57:35 2023-05-07 14:00:23 1:02:48 0:40:42 0:22:06 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fbb409a-ecdc-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264537 2023-05-06 14:47:51 2023-05-07 12:59:25 2023-05-07 13:24:24 0:24:59 0:18:45 0:06:14 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} 1
pass 7264539 2023-05-06 14:47:52 2023-05-07 12:59:26 2023-05-07 14:05:05 1:05:39 0:42:58 0:22:41 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7264541 2023-05-06 14:47:52 2023-05-07 13:03:57 2023-05-07 14:00:37 0:56:40 0:34:07 0:22:33 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7264543 2023-05-06 14:47:53 2023-05-07 13:04:47 2023-05-07 13:36:13 0:31:26 0:11:15 0:20:11 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7264545 2023-05-06 14:47:54 2023-05-07 13:05:18 2023-05-07 13:40:40 0:35:22 0:23:48 0:11:34 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7264547 2023-05-06 14:47:55 2023-05-07 13:06:28 2023-05-07 14:25:20 1:18:52 0:56:20 0:22:32 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi105 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ac3fed6-ecdb-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

pass 7264549 2023-05-06 14:47:56 2023-05-07 13:07:59 2023-05-07 13:37:18 0:29:19 0:11:59 0:17:20 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7264551 2023-05-06 14:47:57 2023-05-07 13:08:09 2023-05-07 13:36:31 0:28:22 0:18:33 0:09:49 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7264553 2023-05-06 14:47:57 2023-05-07 13:08:50 2023-05-07 13:36:48 0:27:58 0:10:09 0:17:49 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7264555 2023-05-06 14:47:58 2023-05-07 13:09:30 2023-05-07 13:25:14 0:15:44 0:06:19 0:09:25 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi044 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7264557 2023-05-06 14:47:59 2023-05-07 13:09:30 2023-05-07 13:34:37 0:25:07 0:19:02 0:06:05 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7264559 2023-05-06 14:48:00 2023-05-07 13:09:31 2023-05-07 14:03:15 0:53:44 0:36:18 0:17:26 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi040 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b89bb6aa-ecdc-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7264561 2023-05-06 14:48:01 2023-05-07 13:09:51 2023-05-07 14:02:55 0:53:04 0:34:50 0:18:14 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 42f62206-ecdb-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264563 2023-05-06 14:48:01 2023-05-07 13:11:12 2023-05-07 13:36:42 0:25:30 0:18:46 0:06:44 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} 2
pass 7264565 2023-05-06 14:48:02 2023-05-07 13:11:12 2023-05-07 14:18:33 1:07:21 0:47:03 0:20:18 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7264567 2023-05-06 14:48:03 2023-05-07 13:14:43 2023-05-07 13:46:10 0:31:27 0:12:00 0:19:27 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7264569 2023-05-06 14:48:04 2023-05-07 13:15:03 2023-05-07 13:43:01 0:27:58 0:17:27 0:10:31 smithi main ubuntu 20.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7264571 2023-05-06 14:48:05 2023-05-07 13:15:04 2023-05-07 13:42:21 0:27:17 0:09:20 0:17:57 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7264573 2023-05-06 14:48:06 2023-05-07 13:15:14 2023-05-07 14:10:27 0:55:13 0:44:54 0:10:19 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7264575 2023-05-06 14:48:06 2023-05-07 13:18:35 2023-05-07 14:08:06 0:49:31 0:43:46 0:05:45 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7264577 2023-05-06 14:48:07 2023-05-07 13:20:05 2023-05-07 13:43:29 0:23:24 0:04:47 0:18:37 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7264579 2023-05-06 14:48:08 2023-05-07 13:20:46 2023-05-07 13:48:25 0:27:39 0:19:12 0:08:27 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7264581 2023-05-06 14:48:09 2023-05-07 13:22:16 2023-05-07 13:51:50 0:29:34 0:10:36 0:18:58 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7264583 2023-05-06 14:48:10 2023-05-07 13:22:17 2023-05-07 13:56:34 0:34:17 0:22:35 0:11:42 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7264585 2023-05-06 14:48:10 2023-05-07 13:22:17 2023-05-07 14:00:46 0:38:29 0:21:43 0:16:46 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
pass 7264587 2023-05-06 14:48:11 2023-05-07 13:23:38 2023-05-07 13:56:08 0:32:30 0:12:26 0:20:04 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7264589 2023-05-06 14:48:12 2023-05-07 13:23:58 2023-05-07 13:51:50 0:27:52 0:10:59 0:16:53 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7264591 2023-05-06 14:48:13 2023-05-07 13:24:28 2023-05-07 14:32:40 1:08:12 1:00:31 0:07:41 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7264593 2023-05-06 14:48:14 2023-05-07 13:25:29 2023-05-07 14:02:38 0:37:09 0:31:28 0:05:41 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7264595 2023-05-06 14:48:14 2023-05-07 13:25:29 2023-05-07 14:12:24 0:46:55 0:35:31 0:11:24 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi117 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da664098-ecdc-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264597 2023-05-06 14:48:15 2023-05-07 13:26:10 2023-05-07 13:54:49 0:28:39 0:10:56 0:17:43 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7264599 2023-05-06 14:48:16 2023-05-07 13:27:40 2023-05-07 14:06:55 0:39:15 0:32:45 0:06:30 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} 1
pass 7264601 2023-05-06 14:48:17 2023-05-07 13:28:11 2023-05-07 13:51:19 0:23:08 0:17:42 0:05:26 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7264603 2023-05-06 14:48:17 2023-05-07 13:28:11 2023-05-07 13:58:02 0:29:51 0:09:23 0:20:28 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7264605 2023-05-06 14:48:18 2023-05-07 13:30:12 2023-05-07 13:57:39 0:27:27 0:21:17 0:06:10 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7264607 2023-05-06 14:48:19 2023-05-07 13:30:22 2023-05-07 13:57:26 0:27:04 0:18:35 0:08:29 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7264609 2023-05-06 14:48:20 2023-05-07 13:32:33 2023-05-07 14:25:36 0:53:03 0:34:33 0:18:30 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi003 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 72a08dea-ecde-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264611 2023-05-06 14:48:21 2023-05-07 13:34:43 2023-05-07 14:33:27 0:58:44 0:45:25 0:13:19 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
dead 7264613 2023-05-06 14:48:21 2023-05-07 13:35:54 2023-05-07 14:04:16 0:28:22 0:17:48 0:10:34 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

{'smithi060.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}}

pass 7264615 2023-05-06 14:48:22 2023-05-07 13:36:14 2023-05-07 14:01:45 0:25:31 0:17:54 0:07:37 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7264617 2023-05-06 14:48:23 2023-05-07 13:36:45 2023-05-07 14:02:17 0:25:32 0:18:23 0:07:09 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} 1
fail 7264619 2023-05-06 14:48:24 2023-05-07 13:36:45 2023-05-07 14:30:14 0:53:29 0:36:15 0:17:14 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi123 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1f71cc-ece0-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264621 2023-05-06 14:48:24 2023-05-07 13:36:56 2023-05-07 14:00:58 0:24:02 0:17:16 0:06:46 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7264623 2023-05-06 14:48:25 2023-05-07 13:37:26 2023-05-07 14:07:21 0:29:55 0:18:11 0:11:44 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7264625 2023-05-06 14:48:26 2023-05-07 13:39:27 2023-05-07 13:55:51 0:16:24 0:06:26 0:09:58 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

Command failed on smithi145 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7264627 2023-05-06 14:48:27 2023-05-07 13:39:57 2023-05-07 14:07:45 0:27:48 0:20:16 0:07:32 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7264629 2023-05-06 14:48:28 2023-05-07 13:40:48 2023-05-07 14:28:39 0:47:51 0:36:18 0:11:33 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7264631 2023-05-06 14:48:28 2023-05-07 13:42:28 2023-05-07 14:13:36 0:31:08 0:10:16 0:20:52 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7264633 2023-05-06 14:48:29 2023-05-07 13:42:29 2023-05-07 14:18:07 0:35:38 0:29:24 0:06:14 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
pass 7264634 2023-05-06 14:48:30 2023-05-07 13:42:49 2023-05-07 14:06:02 0:23:13 0:17:23 0:05:50 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} 1
pass 7264637 2023-05-06 14:48:31 2023-05-07 14:19:25 550 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7264638 2023-05-06 14:48:32 2023-05-07 13:46:20 2023-05-07 14:46:28 1:00:08 0:37:43 0:22:25 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
fail 7264640 2023-05-06 14:48:32 2023-05-07 13:48:31 2023-05-07 14:32:40 0:44:09 0:23:50 0:20:19 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi073 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d411e4e6-ece0-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264642 2023-05-06 14:48:33 2023-05-07 13:51:22 2023-05-07 14:47:36 0:56:14 0:35:33 0:20:41 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7264644 2023-05-06 14:48:34 2023-05-07 13:51:52 2023-05-07 14:19:10 0:27:18 0:10:16 0:17:02 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7264646 2023-05-06 14:48:35 2023-05-07 13:51:53 2023-05-07 14:32:40 0:40:47 0:16:27 0:24:20 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} 3
pass 7264648 2023-05-06 14:48:35 2023-05-07 13:55:54 2023-05-07 14:16:40 0:20:46 0:15:42 0:05:04 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7264650 2023-05-06 14:48:36 2023-05-07 13:55:54 2023-05-07 14:22:15 0:26:21 0:18:28 0:07:53 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7264652 2023-05-06 14:48:37 2023-05-07 13:56:14 2023-05-07 14:33:06 0:36:52 0:23:58 0:12:54 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7264654 2023-05-06 14:48:38 2023-05-07 13:56:35 2023-05-07 14:20:33 0:23:58 0:16:46 0:07:12 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7264656 2023-05-06 14:48:38 2023-05-07 13:57:35 2023-05-07 14:30:30 0:32:55 0:10:59 0:21:56 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} 1
dead 7264658 2023-05-06 14:48:39 2023-05-07 13:57:46 2023-05-08 02:08:06 12:10:20 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 7264660 2023-05-06 14:48:40 2023-05-07 13:58:06 2023-05-07 14:55:30 0:57:24 0:33:56 0:23:28 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7264662 2023-05-06 14:48:41 2023-05-07 13:58:06 2023-05-07 14:51:29 0:53:23 0:31:30 0:21:53 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
pass 7264664 2023-05-06 14:48:42 2023-05-07 14:00:27 2023-05-07 14:35:41 0:35:14 0:22:15 0:12:59 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7264666 2023-05-06 14:48:42 2023-05-07 14:00:38 2023-05-07 14:29:25 0:28:47 0:18:20 0:10:27 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7264668 2023-05-06 14:48:43 2023-05-07 14:01:08 2023-05-07 14:46:52 0:45:44 0:29:01 0:16:43 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 26c8d7ba-ece3-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264670 2023-05-06 14:48:44 2023-05-07 14:01:48 2023-05-07 14:37:40 0:35:52 0:12:30 0:23:22 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7264672 2023-05-06 14:48:45 2023-05-07 14:02:19 2023-05-07 14:24:20 0:22:01 0:08:45 0:13:16 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7264674 2023-05-06 14:48:45 2023-05-07 14:02:59 2023-05-07 14:29:42 0:26:43 0:20:37 0:06:06 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7264676 2023-05-06 14:48:46 2023-05-07 14:03:00 2023-05-07 14:24:19 0:21:19 0:12:05 0:09:14 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7264678 2023-05-06 14:48:47 2023-05-07 14:03:20 2023-05-07 15:20:24 1:17:04 1:05:13 0:11:51 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

Command failed on smithi060 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 210cc094-ece2-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

pass 7264680 2023-05-06 14:48:48 2023-05-07 14:04:21 2023-05-07 14:24:23 0:20:02 0:12:53 0:07:09 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7264682 2023-05-06 14:48:49 2023-05-07 14:05:11 2023-05-07 15:11:58 1:06:47 0:58:51 0:07:56 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7264684 2023-05-06 14:48:50 2023-05-07 14:07:02 2023-05-07 14:52:02 0:45:00 0:37:53 0:07:07 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7264686 2023-05-06 14:48:50 2023-05-07 14:07:22 2023-05-07 14:25:29 0:18:07 0:10:25 0:07:42 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7264688 2023-05-06 14:48:51 2023-05-07 14:07:53 2023-05-07 14:27:07 0:19:14 0:10:46 0:08:28 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7264690 2023-05-06 14:48:52 2023-05-07 14:08:13 2023-05-07 14:34:12 0:25:59 0:19:43 0:06:16 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7264692 2023-05-06 14:48:53 2023-05-07 14:09:04 2023-05-07 14:29:17 0:20:13 0:11:37 0:08:36 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
fail 7264694 2023-05-06 14:48:53 2023-05-07 14:10:34 2023-05-07 14:27:12 0:16:38 0:06:15 0:10:23 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} 1
Failure Reason:

Command failed on smithi157 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

pass 7264696 2023-05-06 14:48:54 2023-05-07 14:10:34 2023-05-07 14:37:21 0:26:47 0:18:14 0:08:33 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7264698 2023-05-06 14:48:55 2023-05-07 14:12:25 2023-05-07 14:34:52 0:22:27 0:11:40 0:10:47 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} 1
fail 7264700 2023-05-06 14:48:56 2023-05-07 14:13:45 2023-05-07 15:00:00 0:46:15 0:33:54 0:12:21 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi082 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 50cffd22-ece3-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264702 2023-05-06 14:48:57 2023-05-07 14:16:46 2023-05-07 14:39:28 0:22:42 0:12:07 0:10:35 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} 2
pass 7264704 2023-05-06 14:48:58 2023-05-07 14:18:17 2023-05-07 14:56:21 0:38:04 0:30:14 0:07:50 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7264706 2023-05-06 14:48:58 2023-05-07 14:27:09 2023-05-07 14:54:57 0:27:48 0:17:00 0:10:48 smithi main ubuntu 20.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} 1
pass 7264708 2023-05-06 14:48:59 2023-05-07 14:27:09 2023-05-07 14:44:57 0:17:48 0:09:05 0:08:43 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7264710 2023-05-06 14:49:00 2023-05-07 14:27:20 2023-05-07 15:09:50 0:42:30 0:34:31 0:07:59 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7264712 2023-05-06 14:49:01 2023-05-07 14:28:40 2023-05-07 15:13:51 0:45:11 0:39:41 0:05:30 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7264714 2023-05-06 14:49:01 2023-05-07 14:28:41 2023-05-07 14:59:04 0:30:23 0:19:09 0:11:14 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7264716 2023-05-06 14:49:02 2023-05-07 14:29:21 2023-05-07 14:46:48 0:17:27 0:11:04 0:06:23 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7264718 2023-05-06 14:49:03 2023-05-07 14:29:32 2023-05-07 14:56:50 0:27:18 0:21:08 0:06:10 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7264720 2023-05-06 14:49:04 2023-05-07 14:29:42 2023-05-07 14:55:30 0:25:48 0:14:06 0:11:42 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7264722 2023-05-06 14:49:05 2023-05-07 14:30:23 2023-05-07 15:03:26 0:33:03 0:24:45 0:08:18 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} 1
fail 7264724 2023-05-06 14:49:06 2023-05-07 14:30:33 2023-05-07 15:07:28 0:36:55 0:28:30 0:08:25 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b7125722-ece5-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7264726 2023-05-06 14:49:06 2023-05-07 14:32:44 2023-05-07 15:05:48 0:33:04 0:23:14 0:09:50 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi145 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ffb7d44-ece5-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264728 2023-05-06 14:49:07 2023-05-07 14:32:44 2023-05-07 14:51:46 0:19:02 0:12:12 0:06:50 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7264730 2023-05-06 14:49:08 2023-05-07 14:32:45 2023-05-07 15:33:24 1:00:39 0:50:14 0:10:25 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7264732 2023-05-06 14:49:09 2023-05-07 15:19:46 2023-05-07 16:01:53 0:42:07 0:31:23 0:10:44 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7264734 2023-05-06 14:49:10 2023-05-07 15:19:57 2023-05-07 15:39:13 0:19:16 0:12:16 0:07:00 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} 1
pass 7264736 2023-05-06 14:49:11 2023-05-07 15:19:57 2023-05-07 15:37:29 0:17:32 0:09:30 0:08:02 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7264738 2023-05-06 14:49:11 2023-05-07 15:20:27 2023-05-07 15:44:35 0:24:08 0:16:38 0:07:30 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7264739 2023-05-06 14:49:12 2023-05-07 15:20:58 2023-05-07 15:44:48 0:23:50 0:17:07 0:06:43 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7264740 2023-05-06 14:49:13 2023-05-07 15:21:48 2023-05-07 15:37:45 0:15:57 0:08:59 0:06:58 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7264741 2023-05-06 14:49:14 2023-05-07 15:22:29 2023-05-07 15:46:26 0:23:57 0:16:06 0:07:51 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7264742 2023-05-06 14:49:15 2023-05-07 15:23:09 2023-05-07 16:06:15 0:43:06 0:34:12 0:08:54 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7264743 2023-05-06 14:49:15 2023-05-07 15:25:00 2023-05-07 15:55:47 0:30:47 0:19:15 0:11:32 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7264744 2023-05-06 14:49:16 2023-05-07 15:25:50 2023-05-07 16:07:30 0:41:40 0:34:26 0:07:14 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Command failed on smithi078 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7867424-ecec-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264745 2023-05-06 14:49:17 2023-05-07 15:26:21 2023-05-07 16:08:34 0:42:13 0:33:28 0:08:45 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7264746 2023-05-06 14:49:18 2023-05-07 15:27:31 2023-05-07 15:59:12 0:31:41 0:23:49 0:07:52 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7264747 2023-05-06 14:49:19 2023-05-07 15:28:22 2023-05-07 16:05:10 0:36:48 0:25:37 0:11:11 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7264748 2023-05-06 14:49:20 2023-05-07 15:29:02 2023-05-07 15:54:45 0:25:43 0:19:01 0:06:42 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7264749 2023-05-06 14:49:20 2023-05-07 15:29:43 2023-05-07 15:47:10 0:17:27 0:10:22 0:07:05 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7264750 2023-05-06 14:49:21 2023-05-07 15:30:13 2023-05-07 16:02:03 0:31:50 0:25:03 0:06:47 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} 3
fail 7264751 2023-05-06 14:49:22 2023-05-07 15:31:04 2023-05-07 15:49:11 0:18:07 0:06:32 0:11:35 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

Command failed on smithi002 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'

fail 7264752 2023-05-06 14:49:23 2023-05-07 15:33:15 2023-05-07 16:49:46 1:16:31 1:06:00 0:10:31 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi098 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97150a2e-ecee-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''

pass 7264753 2023-05-06 14:49:23 2023-05-07 15:33:25 2023-05-07 15:52:37 0:19:12 0:10:30 0:08:42 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} 2
fail 7264754 2023-05-06 14:49:24 2023-05-07 15:35:36 2023-05-07 16:15:25 0:39:49 0:28:07 0:11:42 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 26235b3a-ecef-11ed-9b01-001a4aab830c -e sha1=1fd31bd5efc0285e085e8f305f8e4a7a9f22f84c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7264755 2023-05-06 14:49:25 2023-05-07 15:36:06 2023-05-07 15:59:41 0:23:35 0:14:00 0:09:35 smithi main centos 8.stream orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} 2
pass 7264756 2023-05-06 14:49:26 2023-05-07 15:36:07 2023-05-07 15:57:55 0:21:48 0:12:02 0:09:46 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7264757 2023-05-06 14:49:27 2023-05-07 15:36:27 2023-05-07 15:53:46 0:17:19 0:10:08 0:07:11 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
pass 7264758 2023-05-06 14:49:27 2023-05-07 15:36:47 2023-05-07 15:52:24 0:15:37 0:09:04 0:06:33 smithi main centos 8.stream orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7264759 2023-05-06 14:49:28 2023-05-07 15:37:08 2023-05-07 16:36:16 0:59:08 0:48:55 0:10:13 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7264760 2023-05-06 14:49:29 2023-05-07 15:37:28 2023-05-07 16:24:41 0:47:13 0:39:07 0:08:06 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7264761 2023-05-06 14:49:30 2023-05-07 15:37:39 2023-05-07 16:03:06 0:25:27 0:18:37 0:06:50 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2