Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7089286 2022-11-23 17:42:38 2022-11-28 01:25:28 2022-11-28 01:56:20 0:30:52 0:20:29 0:10:23 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
pass 7089287 2022-11-23 17:42:39 2022-11-28 01:26:31 2022-11-28 01:56:36 0:30:05 0:18:51 0:11:14 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7089288 2022-11-23 17:42:40 2022-11-28 01:26:32 2022-11-28 01:58:51 0:32:19 0:19:26 0:12:53 smithi main ubuntu 20.04 orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} 1
pass 7089289 2022-11-23 17:42:41 2022-11-28 01:27:02 2022-11-28 02:23:44 0:56:42 0:43:43 0:12:59 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7089290 2022-11-23 17:42:43 2022-11-28 01:27:08 2022-11-28 02:20:54 0:53:46 0:41:50 0:11:56 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7089291 2022-11-23 17:42:44 2022-11-28 01:29:43 2022-11-28 01:56:36 0:26:53 0:16:55 0:09:58 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 7089292 2022-11-23 17:42:45 2022-11-28 01:30:13 2022-11-28 02:02:59 0:32:46 0:18:21 0:14:25 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7089293 2022-11-23 17:42:46 2022-11-28 01:31:09 2022-11-28 02:01:26 0:30:17 0:15:16 0:15:01 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7089294 2022-11-23 17:42:47 2022-11-28 01:32:44 2022-11-28 02:23:44 0:51:00 0:39:57 0:11:03 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7089295 2022-11-23 17:42:48 2022-11-28 01:32:44 2022-11-28 02:04:21 0:31:37 0:21:10 0:10:27 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)

pass 7089296 2022-11-23 17:42:49 2022-11-28 01:34:29 2022-11-28 02:12:35 0:38:06 0:24:33 0:13:33 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7089297 2022-11-23 17:42:51 2022-11-28 01:35:10 2022-11-28 02:04:17 0:29:07 0:16:48 0:12:19 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
dead 7089298 2022-11-23 17:42:52 2022-11-28 01:35:31 2022-11-28 01:56:49 0:21:18 0:07:45 0:13:33 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

{'smithi093.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['rpm', '-e', 'ceph-debuginfo'], 'delta': '0:00:00.012412', 'end': '2022-11-28 01:48:31.799017', 'invocation': {'module_args': {'_raw_params': 'rpm -e ceph-debuginfo', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-11-28 01:48:31.786605', 'stderr': 'error: Failed dependencies:\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-radosgw-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) libcephfs2-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-mirror-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-base-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-osd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rbd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-common-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mgr-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-fuse-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librbd1-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rgw-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-immutable-object-cache-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mds-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librados-devel-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-cephfs-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-fuse-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mon-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rados-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-test-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librados2-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64\n\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-nbd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', 'stderr_lines': ['error: Failed dependencies:', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-radosgw-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) libcephfs2-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-mirror-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-base-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-osd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rbd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-common-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mgr-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-fuse-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librbd1-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rgw-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-immutable-object-cache-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mds-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librados-devel-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-cephfs-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-fuse-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-mon-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) python3-rados-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) ceph-test-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) librados2-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64', '\tceph-debuginfo(x86-64) = 2:18.0.0-594.g697b0d99.el8 is needed by (installed) rbd-nbd-debuginfo-2:18.0.0-594.g697b0d99.el8.x86_64'], 'stdout': '', 'stdout_lines': []}}

fail 7089299 2022-11-23 17:42:53 2022-11-28 01:36:51 2022-11-28 02:00:07 0:23:16 0:08:16 0:15:00 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

Command failed on smithi106 with status 1: 'sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e516bbbc-6ebf-11ed-843b-001a4aab830c --force'

dead 7089300 2022-11-23 17:42:54 2022-11-28 01:37:07 2022-11-28 02:11:55 0:34:48 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

dead 7089301 2022-11-23 17:42:55 2022-11-28 01:37:38 2022-11-28 01:41:09 0:03:31 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi163

fail 7089302 2022-11-23 17:42:57 2022-11-28 01:38:12 2022-11-28 01:50:05 0:11:53 0:03:57 0:07:56 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi038 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

fail 7089303 2022-11-23 17:42:58 2022-11-28 01:38:27 2022-11-28 01:50:05 0:11:38 0:04:03 0:07:35 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

Command failed on smithi055 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

pass 7089304 2022-11-23 17:42:59 2022-11-28 01:38:52 2022-11-28 02:04:01 0:25:09 0:15:00 0:10:09 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli} 1
pass 7089305 2022-11-23 17:43:00 2022-11-28 01:38:52 2022-11-28 02:06:23 0:27:31 0:15:45 0:11:46 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} 2
fail 7089306 2022-11-23 17:43:01 2022-11-28 01:38:52 2022-11-28 01:55:32 0:16:40 0:04:54 0:11:46 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi035 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

dead 7089307 2022-11-23 17:43:02 2022-11-28 01:39:38 2022-11-28 02:19:29 0:39:51 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

pass 7089308 2022-11-23 17:43:04 2022-11-28 01:39:38 2022-11-28 02:39:21 0:59:43 0:49:38 0:10:05 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7089309 2022-11-23 17:43:05 2022-11-28 01:40:45 2022-11-28 02:17:17 0:36:32 0:26:34 0:09:58 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7089310 2022-11-23 17:43:06 2022-11-28 01:40:45 2022-11-28 02:13:55 0:33:10 0:19:09 0:14:01 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7089311 2022-11-23 17:43:07 2022-11-28 01:41:15 2022-11-28 03:12:23 1:31:08 0:37:03 0:54:05 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli_mon} 5
dead 7089312 2022-11-23 17:43:08 2022-11-28 01:42:20 2022-11-28 01:46:32 0:04:12 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi159

fail 7089313 2022-11-23 17:43:10 2022-11-28 01:42:40 2022-11-28 02:20:05 0:37:25 0:23:28 0:13:57 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi149 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ef2c0ee-6ec0-11ed-843b-001a4aab830c -e sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''

fail 7089314 2022-11-23 17:43:11 2022-11-28 01:42:45 2022-11-28 02:09:47 0:27:02 0:07:40 0:19:22 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2} 3
Failure Reason:

Command failed on smithi146 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'

pass 7089315 2022-11-23 17:43:12 2022-11-28 01:47:25 2022-11-28 02:16:22 0:28:57 0:18:25 0:10:32 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7089316 2022-11-23 17:43:13 2022-11-28 01:48:10 2022-11-28 02:17:18 0:29:08 0:15:50 0:13:18 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
dead 7089317 2022-11-23 17:43:14 2022-11-28 01:50:33 2022-11-28 01:53:27 0:02:54 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi055

pass 7089318 2022-11-23 17:43:16 2022-11-28 01:50:45 2022-11-28 02:11:57 0:21:12 0:12:42 0:08:30 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_adoption} 1
pass 7089319 2022-11-23 17:43:17 2022-11-28 01:51:11 2022-11-28 02:41:00 0:49:49 0:40:06 0:09:43 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7089320 2022-11-23 17:43:18 2022-11-28 01:52:07 2022-11-28 02:20:37 0:28:30 0:20:01 0:08:29 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
pass 7089321 2022-11-23 17:43:19 2022-11-28 01:52:12 2022-11-28 02:45:37 0:53:25 0:41:29 0:11:56 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
pass 7089322 2022-11-23 17:43:20 2022-11-28 01:55:15 2022-11-28 02:18:56 0:23:41 0:16:14 0:07:27 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} 1
pass 7089323 2022-11-23 17:43:22 2022-11-28 01:55:16 2022-11-28 02:39:21 0:44:05 0:33:48 0:10:17 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7089324 2022-11-23 17:43:23 2022-11-28 01:55:51 2022-11-28 02:42:26 0:46:35 0:37:02 0:09:33 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
dead 7089325 2022-11-23 17:43:24 2022-11-28 01:56:49 2022-11-28 02:29:16 0:32:27 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

pass 7089326 2022-11-23 17:43:25 2022-11-28 01:57:09 2022-11-28 02:42:46 0:45:37 0:34:19 0:11:18 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
dead 7089327 2022-11-23 17:43:27 2022-11-28 01:57:10 2022-11-28 02:31:45 0:34:35 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

dead 7089328 2022-11-23 17:43:28 2022-11-28 01:57:21 2022-11-28 02:01:09 0:03:48 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi161

fail 7089329 2022-11-23 17:43:29 2022-11-28 01:57:46 2022-11-28 02:26:32 0:28:46 0:18:14 0:10:32 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi112.front.sepia.ceph.com: ['type=AVC msg=audit(1669602212.771:19378): avc: denied { ioctl } for pid=120324 comm="iptables" path="/var/lib/containers/storage/overlay/3949c31c8b9b98917048da392236cba26f7ffae5207ba7b5844cd476e7e5b3f2/merged" dev="overlay" ino=3412539 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1669602212.812:19379): avc: denied { ioctl } for pid=120328 comm="iptables" path="/var/lib/containers/storage/overlay/3949c31c8b9b98917048da392236cba26f7ffae5207ba7b5844cd476e7e5b3f2/merged" dev="overlay" ino=3412539 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 7089330 2022-11-23 17:43:30 2022-11-28 01:57:46 2022-11-28 02:25:00 0:27:14 0:15:33 0:11:41 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7089331 2022-11-23 17:43:31 2022-11-28 02:00:12 2022-11-28 02:52:29 0:52:17 0:42:42 0:09:35 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 7089332 2022-11-23 17:43:32 2022-11-28 02:00:53 2022-11-28 02:39:46 0:38:53 0:28:30 0:10:23 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7089333 2022-11-23 17:43:33 2022-11-28 02:02:00 2022-11-28 02:38:10 0:36:10 0:20:34 0:15:36 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi155 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.155:/foouser /mnt/foo'"

fail 7089334 2022-11-23 17:43:35 2022-11-28 02:02:51 2022-12-01 02:39:38 3 days, 0:36:47 6:20:18 2 days, 18:16:29 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Command failed on smithi105 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.105:/fake /mnt/foo'"

pass 7089335 2022-11-23 17:43:36 2022-11-28 02:03:37 2022-11-28 02:21:39 0:18:02 0:10:44 0:07:18 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7089336 2022-11-23 17:43:37 2022-11-28 02:03:42 2022-11-28 02:30:44 0:27:02 0:17:17 0:09:45 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7089337 2022-11-23 17:43:38 2022-11-28 02:11:07 2022-11-28 02:44:25 0:33:18 0:20:53 0:12:25 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 45035270-6ec4-11ed-843b-001a4aab830c -e sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''

pass 7089338 2022-11-23 17:43:39 2022-11-28 02:12:27 2022-11-28 02:39:21 0:26:54 0:18:11 0:08:43 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7089339 2022-11-23 17:43:40 2022-11-28 02:12:28 2022-11-28 02:40:41 0:28:13 0:17:07 0:11:06 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi074 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.74:/fake /mnt/foo -o port=2999'"

pass 7089340 2022-11-23 17:43:42 2022-11-28 02:13:08 2022-11-28 03:03:27 0:50:19 0:38:54 0:11:25 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7089341 2022-11-23 17:43:43 2022-11-28 02:14:31 2022-11-28 03:05:58 0:51:27 0:40:03 0:11:24 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7089342 2022-11-23 17:43:44 2022-11-28 02:15:18 2022-11-28 02:54:18 0:39:00 0:28:43 0:10:17 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7089343 2022-11-23 17:43:45 2022-11-28 02:21:23 2022-11-28 02:49:25 0:28:02 0:17:48 0:10:14 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7089344 2022-11-23 17:43:46 2022-11-28 02:21:33 2022-11-28 02:47:01 0:25:28 0:16:34 0:08:54 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 7089345 2022-11-23 17:43:47 2022-11-28 02:21:40 2022-11-28 02:53:07 0:31:27 0:17:21 0:14:06 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
dead 7089346 2022-11-23 17:43:49 2022-11-28 02:21:40 2022-11-28 02:35:41 0:14:01 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi145

fail 7089347 2022-11-23 17:43:50 2022-11-28 02:23:54 2022-11-28 03:00:12 0:36:18 0:22:38 0:13:40 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} 1
Failure Reason:

'wait for operator' reached maximum tries (90) after waiting for 900 seconds

pass 7089348 2022-11-23 17:43:51 2022-11-28 02:23:59 2022-11-28 03:17:30 0:53:31 0:34:43 0:18:48 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7089349 2022-11-23 17:43:52 2022-11-23 21:24:26 2022-11-23 21:52:37 0:28:11 0:16:55 0:11:16 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7089350 2022-11-23 17:43:53 2022-11-28 02:24:05 2022-11-28 03:03:06 0:39:01 0:25:32 0:13:29 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
fail 7089351 2022-11-23 17:43:55 2022-11-28 02:24:05 2022-11-28 02:55:42 0:31:37 0:18:54 0:12:43 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs} 1
Failure Reason:

Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS)

pass 7089352 2022-11-23 17:43:56 2022-11-28 02:24:05 2022-11-28 02:55:12 0:31:07 0:20:27 0:10:40 smithi main rhel 8.6 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} 2
dead 7089353 2022-11-23 17:43:57 2022-11-28 02:25:17 2022-11-28 02:29:04 0:03:47 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi112

pass 7089354 2022-11-23 17:43:58 2022-11-28 02:27:21 2022-11-28 03:48:10 1:20:49 1:03:37 0:17:12 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7089355 2022-11-23 17:43:59 2022-11-28 02:31:09 2022-11-28 03:35:39 1:04:30 0:43:54 0:20:36 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7089356 2022-11-23 17:44:00 2022-11-28 02:31:44 2022-11-28 03:02:18 0:30:34 0:17:02 0:13:32 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
fail 7089357 2022-11-23 17:44:02 2022-11-28 02:32:19 2022-11-28 02:45:09 0:12:50 0:04:03 0:08:47 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi120 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'

pass 7089358 2022-11-23 17:44:03 2022-11-28 02:32:58 2022-11-28 03:24:07 0:51:09 0:33:43 0:17:26 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7089359 2022-11-23 17:44:04 2022-11-28 02:36:10 2022-11-28 03:07:33 0:31:23 0:16:09 0:15:14 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7089360 2022-11-23 17:44:05 2022-11-28 02:38:41 2022-11-28 03:10:19 0:31:38 0:16:04 0:15:34 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7089361 2022-11-23 17:44:06 2022-11-28 02:39:52 2022-11-28 03:06:50 0:26:58 0:17:08 0:09:50 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI)

dead 7089362 2022-11-23 17:44:07 2022-11-28 02:39:52 2022-11-28 02:43:13 0:03:21 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi134

dead 7089363 2022-11-23 17:44:08 2022-11-28 02:39:52 2022-11-28 02:42:38 0:02:46 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi165

pass 7089364 2022-11-23 17:44:10 2022-11-28 02:39:53 2022-11-28 03:23:15 0:43:22 0:34:44 0:08:38 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7089365 2022-11-23 17:44:11 2022-11-28 02:39:53 2022-11-28 03:19:48 0:39:55 0:27:40 0:12:15 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7089366 2022-11-23 17:44:12 2022-11-28 02:41:29 2022-11-28 03:10:55 0:29:26 0:18:10 0:11:16 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7089367 2022-11-23 17:44:13 2022-11-28 02:42:01 2022-11-28 03:22:36 0:40:35 0:27:37 0:12:58 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} 5
pass 7089368 2022-11-23 17:44:14 2022-11-28 02:42:48 2022-11-28 03:10:50 0:28:02 0:18:50 0:09:12 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7089369 2022-11-23 17:44:15 2022-11-28 02:42:48 2022-11-28 03:15:48 0:33:00 0:18:47 0:14:13 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7089370 2022-11-23 17:44:16 2022-11-28 02:44:41 2022-11-28 03:16:29 0:31:48 0:20:07 0:11:41 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7089371 2022-11-23 17:44:18 2022-11-28 02:45:22 2022-11-28 03:36:21 0:50:59 0:34:25 0:16:34 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7089372 2022-11-23 17:44:19 2022-11-28 02:45:22 2022-11-28 03:37:45 0:52:23 0:38:51 0:13:32 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7089373 2022-11-23 17:44:20 2022-11-28 02:45:49 2022-11-28 03:24:41 0:38:52 0:27:08 0:11:44 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7089374 2022-11-23 17:44:21 2022-11-28 02:47:32 2022-11-28 03:10:03 0:22:31 0:14:59 0:07:32 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} 1
pass 7089375 2022-11-23 17:44:22 2022-11-28 02:47:43 2022-11-28 03:14:23 0:26:40 0:16:29 0:10:11 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7089376 2022-11-23 17:44:24 2022-11-28 02:49:14 2022-11-28 03:31:07 0:41:53 0:23:33 0:18:20 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7089377 2022-11-23 17:44:25 2022-11-28 02:49:30 2022-11-28 03:23:15 0:33:45 0:22:00 0:11:45 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

Command failed on smithi094 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9f0134ae-6ec9-11ed-843b-001a4aab830c -e sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''

fail 7089378 2022-11-23 17:44:26 2022-11-28 02:49:30 2022-11-28 03:20:45 0:31:15 0:17:23 0:13:52 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

Command failed on smithi037 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.37:/foobucket /mnt/foo'"

pass 7089379 2022-11-23 17:44:27 2022-11-28 02:51:01 2022-11-28 03:19:05 0:28:04 0:15:16 0:12:48 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7089380 2022-11-23 17:44:28 2022-11-28 02:52:30 2022-11-28 03:13:43 0:21:13 0:07:29 0:13:44 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} 1
Failure Reason:

Command failed on smithi187 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'

fail 7089381 2022-11-23 17:44:29 2022-11-28 02:52:30 2022-11-28 03:22:34 0:30:04 0:20:18 0:09:46 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi081.front.sepia.ceph.com: ['type=AVC msg=audit(1669605573.282:19305): avc: denied { ioctl } for pid=113130 comm="iptables" path="/var/lib/containers/storage/overlay/61fccfedb97779a2cc7295e8cab380961e6b100953a18bec200649ef4fa325c4/merged" dev="overlay" ino=3540444 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

fail 7089382 2022-11-23 17:44:31 2022-11-28 02:53:30 2022-11-28 03:25:19 0:31:49 0:19:05 0:12:44 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

Command failed on smithi159 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.159:/foouser /mnt/foo'"

pass 7089383 2022-11-23 17:44:32 2022-11-28 02:53:30 2022-11-28 03:39:49 0:46:19 0:34:52 0:11:27 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7089384 2022-11-23 17:44:33 2022-11-28 02:54:46 2022-11-28 03:42:45 0:47:59 0:40:01 0:07:58 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7089385 2022-11-23 17:44:34 2022-11-28 02:55:26 2022-11-28 03:21:40 0:26:14 0:14:14 0:12:00 smithi main ubuntu 20.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} 2
dead 7089386 2022-11-23 17:44:35 2022-11-28 02:55:26 2022-11-28 03:07:10 0:11:44 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi189

pass 7089387 2022-11-23 17:44:36 2022-11-28 02:55:27 2022-11-28 03:25:02 0:29:35 0:17:17 0:12:18 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
pass 7089388 2022-11-23 17:44:37 2022-11-28 02:55:43 2022-11-28 03:17:54 0:22:11 0:15:22 0:06:49 smithi main rhel 8.6 orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} 1
pass 7089389 2022-11-23 17:44:39 2022-11-28 02:55:43 2022-11-28 03:54:03 0:58:20 0:40:40 0:17:40 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7089390 2022-11-23 17:44:40 2022-11-28 03:01:06 2022-11-28 03:52:58 0:51:52 0:41:12 0:10:40 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
dead 7089391 2022-11-23 17:44:41 2022-11-28 03:03:12 2022-11-28 03:27:08 0:23:56 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

pass 7089392 2022-11-23 17:44:42 2022-11-28 03:03:12 2022-11-28 03:31:49 0:28:37 0:15:17 0:13:20 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7089393 2022-11-23 17:44:43 2022-11-28 03:03:58 2022-11-28 03:21:22 0:17:24 0:05:55 0:11:29 smithi main ubuntu 20.04 orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
fail 7089394 2022-11-23 17:44:44 2022-11-28 03:05:31 2022-11-28 03:36:56 0:31:25 0:19:51 0:11:34 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi060 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.60:/fake /mnt/foo -o port=2999'"

pass 7089395 2022-11-23 17:44:45 2022-11-28 03:05:32 2022-11-28 03:35:30 0:29:58 0:17:58 0:12:00 smithi main centos 8.stream orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7089396 2022-11-23 17:44:46 2022-11-28 03:05:32 2022-11-28 03:30:57 0:25:25 0:15:14 0:10:11 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7089397 2022-11-23 17:44:48 2022-11-28 03:06:32 2022-11-28 04:10:37 1:04:05 0:54:17 0:09:48 smithi main rhel 8.6 orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7089398 2022-11-23 17:44:49 2022-11-28 03:07:48 2022-11-28 03:44:37 0:36:49 0:27:53 0:08:56 smithi main rhel 8.6 orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7089399 2022-11-23 17:44:50 2022-11-28 03:07:48 2022-11-28 03:59:36 0:51:48 0:34:10 0:17:38 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7089400 2022-11-23 17:44:51 2022-11-28 03:08:45 2022-11-28 03:35:16 0:26:31 0:16:45 0:09:46 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} 1
pass 7089401 2022-11-23 17:44:52 2022-11-28 03:08:45 2022-11-28 03:36:04 0:27:19 0:14:52 0:12:27 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7089402 2022-11-23 17:44:53 2022-11-28 03:10:33 2022-11-28 03:39:12 0:28:39 0:18:00 0:10:39 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7089403 2022-11-23 17:44:55 2022-11-28 03:10:58 2022-11-28 03:43:11 0:32:13 0:22:17 0:09:56 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7089404 2022-11-23 17:44:56 2022-11-28 03:10:58 2022-11-28 03:38:04 0:27:06 0:19:03 0:08:03 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} 2
dead 7089405 2022-11-23 17:44:57 2022-11-28 03:10:59 2022-11-28 03:15:17 0:04:18 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi040

dead 7089406 2022-11-23 17:44:58 2022-11-28 03:12:51 2022-11-28 03:21:31 0:08:40 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi169

pass 7089407 2022-11-23 17:44:59 2022-11-28 03:12:51 2022-11-28 04:10:37 0:57:46 0:44:23 0:13:23 smithi main ubuntu 20.04 orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7089408 2022-11-23 17:45:00 2022-11-28 03:12:51 2022-11-28 04:12:30 0:59:39 0:38:13 0:21:26 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7089409 2022-11-23 17:45:02 2022-11-28 03:14:24 2022-11-28 03:42:45 0:28:21 0:18:16 0:10:05 smithi main rhel 8.6 orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7089410 2022-11-23 17:45:03 2022-11-28 03:16:04 2022-11-28 04:00:36 0:44:32 0:33:45 0:10:47 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7089411 2022-11-23 17:45:04 2022-11-28 03:16:09 2022-11-28 03:44:37 0:28:28 0:16:49 0:11:39 smithi main rhel 8.6 orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7089412 2022-11-23 17:45:05 2022-11-28 03:17:06 2022-11-28 03:48:10 0:31:04 0:18:02 0:13:02 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
fail 7089413 2022-11-23 17:45:06 2022-11-28 03:18:22 2022-11-28 04:05:51 0:47:29 0:27:00 0:20:29 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} 3
Failure Reason:

'check osd count' reached maximum tries (90) after waiting for 900 seconds

pass 7089414 2022-11-23 17:45:07 2022-11-28 03:19:21 2022-11-28 03:49:32 0:30:11 0:19:53 0:10:18 smithi main rhel 8.6 orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7089415 2022-11-23 17:45:08 2022-11-28 03:20:43 2022-11-28 03:46:48 0:26:05 0:19:23 0:06:42 smithi main rhel 8.6 orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7089416 2022-11-23 17:45:10 2022-11-28 03:20:50 2022-11-28 03:48:11 0:27:21 0:15:28 0:11:53 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2