Pulpito

gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
gabrioux 2024-09-21 10:07:29 2024-09-21 10:12:45 2024-09-21 20:09:03 9:56:18 orch:cephadm wip-guits-main-2024-09-21-0813 smithi 5c1cdc3 95 19 4

Average wait time: 0:10:50

See other runs of suite 'orch:cephadm' on branch 'wip-guits-main-2024-09-21-0813'?

See other runs on branch 'wip-guits-main-2024-09-21-0813'?

See other runs scheduled on 2024-09-21?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7913801 2024-09-21 10:07:46 2024-09-21 10:12:25 2024-09-21 10:46:01 0:33:36 0:22:14 0:11:22 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7913802 2024-09-21 10:07:47 2024-09-21 10:12:45 2024-09-21 10:37:51 0:25:06 0:14:49 0:10:17 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} 3
pass 7913803 2024-09-21 10:07:49 2024-09-21 10:12:56 2024-09-21 10:58:02 0:45:06 0:32:51 0:12:15 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7913804 2024-09-21 10:07:50 2024-09-21 10:15:16 2024-09-21 10:59:24 0:44:08 0:32:45 0:11:23 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7913805 2024-09-21 10:07:51 2024-09-21 10:16:27 2024-09-21 11:02:00 0:45:33 0:35:20 0:10:13 smithi main centos 9.stream orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/nfs} 1
pass 7913806 2024-09-21 10:07:52 2024-09-21 10:16:37 2024-09-21 10:40:36 0:23:59 0:13:28 0:10:31 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7913807 2024-09-21 10:07:54 2024-09-21 10:16:38 2024-09-21 10:42:58 0:26:20 0:11:19 0:15:01 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7913808 2024-09-21 10:07:55 2024-09-21 10:19:59 2024-09-21 10:53:33 0:33:34 0:21:19 0:12:15 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7913809 2024-09-21 10:07:56 2024-09-21 10:20:59 2024-09-21 10:56:37 0:35:38 0:22:45 0:12:53 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-09-21T10:38:17.359711+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7913810 2024-09-21 10:07:57 2024-09-21 10:23:40 2024-09-21 10:49:18 0:25:38 0:14:53 0:10:45 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7913811 2024-09-21 10:07:58 2024-09-21 10:24:20 2024-09-21 10:51:51 0:27:31 0:18:59 0:08:32 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final} 1
pass 7913812 2024-09-21 10:08:00 2024-09-21 10:24:21 2024-09-21 10:45:57 0:21:36 0:10:48 0:10:48 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
dead 7913813 2024-09-21 10:08:01 2024-09-21 10:25:11 2024-09-21 10:41:20 0:16:09 0:03:48 0:12:21 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

['ubuntu@smithi179.front.sepia.ceph.com: Permission denied (publickey).']

pass 7913814 2024-09-21 10:08:02 2024-09-21 10:25:31 2024-09-21 11:06:59 0:41:28 0:31:12 0:10:16 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7913815 2024-09-21 10:08:03 2024-09-21 10:26:02 2024-09-21 11:02:51 0:36:49 0:16:13 0:20:36 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_ips} 4
Failure Reason:

SELinux denials found on ubuntu@smithi050.front.sepia.ceph.com: ['type=AVC msg=audit(1726916363.525:10856): avc: denied { nlmsg_read } for pid=60268 comm="ss" scontext=system_u:system_r:container_t:s0:c825,c898 tcontext=system_u:system_r:container_t:s0:c825,c898 tclass=netlink_tcpdiag_socket permissive=1']

pass 7913816 2024-09-21 10:08:04 2024-09-21 10:37:54 2024-09-21 11:11:00 0:33:06 0:23:50 0:09:16 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7913817 2024-09-21 10:08:05 2024-09-21 10:38:04 2024-09-21 10:58:41 0:20:37 0:12:31 0:08:06 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7913818 2024-09-21 10:08:07 2024-09-21 10:38:04 2024-09-21 11:05:55 0:27:51 0:15:05 0:12:46 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7913819 2024-09-21 10:08:08 2024-09-21 10:40:25 2024-09-21 11:15:39 0:35:14 0:22:39 0:12:35 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7913820 2024-09-21 10:08:09 2024-09-21 10:40:55 2024-09-21 11:05:56 0:25:01 0:12:29 0:12:32 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7913821 2024-09-21 10:08:10 2024-09-21 10:41:36 2024-09-21 11:12:16 0:30:40 0:19:58 0:10:42 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} 2
pass 7913822 2024-09-21 10:08:11 2024-09-21 10:42:46 2024-09-21 11:18:25 0:35:39 0:26:24 0:09:15 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7913823 2024-09-21 10:08:13 2024-09-21 10:42:47 2024-09-21 11:22:15 0:39:28 0:28:41 0:10:47 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7913824 2024-09-21 10:08:14 2024-09-21 10:43:17 2024-09-21 11:41:18 0:58:01 0:45:38 0:12:23 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
pass 7913825 2024-09-21 10:08:15 2024-09-21 10:45:38 2024-09-21 11:21:50 0:36:12 0:25:59 0:10:13 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
fail 7913826 2024-09-21 10:08:16 2024-09-21 10:46:08 2024-09-21 11:47:17 1:01:09 0:52:19 0:08:50 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7913827 2024-09-21 10:08:17 2024-09-21 10:46:08 2024-09-21 11:09:31 0:23:23 0:14:11 0:09:12 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
fail 7913828 2024-09-21 10:08:18 2024-09-21 10:46:19 2024-09-21 11:40:52 0:54:33 0:42:17 0:12:16 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e76ddb12-7808-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

pass 7913829 2024-09-21 10:08:20 2024-09-21 10:49:40 2024-09-21 11:26:18 0:36:38 0:23:35 0:13:03 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
pass 7913830 2024-09-21 10:08:21 2024-09-21 10:52:10 2024-09-21 11:14:21 0:22:11 0:12:38 0:09:33 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7913831 2024-09-21 10:08:22 2024-09-21 10:53:11 2024-09-21 11:13:34 0:20:23 0:10:09 0:10:14 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} 2
pass 7913832 2024-09-21 10:08:23 2024-09-21 10:53:51 2024-09-21 11:26:44 0:32:53 0:21:30 0:11:23 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7913833 2024-09-21 10:08:24 2024-09-21 10:56:02 2024-09-21 11:17:51 0:21:49 0:12:02 0:09:47 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

Command failed on smithi082 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4110ff54-780a-11ef-baf6-efdc52797490 -- bash -c \'set -e\nset -x\nwhile true; do TOKEN=$(ceph rgw realm tokens | jq -r \'"\'"\'.[0].token\'"\'"\'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done\nTOKENS=$(ceph rgw realm tokens)\necho $TOKENS | jq --exit-status \'"\'"\'.[0].realm == "myrealm1"\'"\'"\'\necho $TOKENS | jq --exit-status \'"\'"\'.[0].token\'"\'"\'\nTOKEN_JSON=$(ceph rgw realm tokens | jq -r \'"\'"\'.[0].token\'"\'"\' | base64 --decode)\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.realm_name == "myrealm1"\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.endpoint | test("http://.+:\\\\d+")\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.access_key\'"\'"\'\necho $TOKEN_JSON | jq --exit-status \'"\'"\'.secret\'"\'"\'\n\''

pass 7913834 2024-09-21 10:08:26 2024-09-21 10:56:52 2024-09-21 11:29:08 0:32:16 0:21:01 0:11:15 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7913835 2024-09-21 10:08:27 2024-09-21 10:57:43 2024-09-21 11:21:04 0:23:21 0:13:12 0:10:09 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7913836 2024-09-21 10:08:28 2024-09-21 10:58:13 2024-09-21 11:58:24 1:00:11 0:49:19 0:10:52 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7913837 2024-09-21 10:08:29 2024-09-21 10:58:44 2024-09-21 11:18:23 0:19:39 0:08:48 0:10:51 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (30) after waiting for 300 seconds

dead 7913838 2024-09-21 10:08:30 2024-09-21 10:59:34 2024-09-21 19:10:28 8:10:54 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7913839 2024-09-21 10:08:32 2024-09-21 11:02:15 2024-09-21 11:22:00 0:19:45 0:10:22 0:09:23 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7913840 2024-09-21 10:08:33 2024-09-21 11:03:05 2024-09-21 12:02:34 0:59:29 0:49:23 0:10:06 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7913841 2024-09-21 10:08:34 2024-09-21 11:03:06 2024-09-21 11:26:07 0:23:01 0:11:12 0:11:49 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} 2
pass 7913842 2024-09-21 10:08:35 2024-09-21 11:04:36 2024-09-21 11:39:37 0:35:01 0:22:49 0:12:12 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7913843 2024-09-21 10:08:36 2024-09-21 11:06:07 2024-09-21 11:32:48 0:26:41 0:14:45 0:11:56 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7913844 2024-09-21 10:08:37 2024-09-21 11:07:17 2024-09-21 11:32:17 0:25:00 0:14:03 0:10:57 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7913845 2024-09-21 10:08:39 2024-09-21 11:09:28 2024-09-21 11:31:04 0:21:36 0:12:53 0:08:43 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7913846 2024-09-21 10:08:40 2024-09-21 11:09:28 2024-09-21 11:33:05 0:23:37 0:12:48 0:10:49 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw} 2
pass 7913847 2024-09-21 10:08:41 2024-09-21 11:09:49 2024-09-21 11:31:15 0:21:26 0:11:44 0:09:42 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} 2
pass 7913848 2024-09-21 10:08:42 2024-09-21 11:10:09 2024-09-21 11:36:07 0:25:58 0:14:58 0:11:00 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7913849 2024-09-21 10:08:43 2024-09-21 11:11:10 2024-09-21 11:42:13 0:31:03 0:19:45 0:11:18 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7913850 2024-09-21 10:08:44 2024-09-21 11:12:00 2024-09-21 11:55:13 0:43:13 0:33:57 0:09:16 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7913851 2024-09-21 10:08:46 2024-09-21 11:12:10 2024-09-21 11:31:18 0:19:08 0:10:11 0:08:57 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7913852 2024-09-21 10:08:47 2024-09-21 11:12:31 2024-09-21 12:29:12 1:16:41 1:06:22 0:10:19 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7913853 2024-09-21 10:08:48 2024-09-21 11:13:21 2024-09-21 11:37:35 0:24:14 0:12:34 0:11:40 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7913854 2024-09-21 10:08:49 2024-09-21 11:13:52 2024-09-21 12:32:28 1:18:36 1:08:02 0:10:34 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7913855 2024-09-21 10:08:50 2024-09-21 11:14:32 2024-09-21 11:43:25 0:28:53 0:18:46 0:10:07 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_domain} 2
pass 7913856 2024-09-21 10:08:51 2024-09-21 11:15:53 2024-09-21 12:00:39 0:44:46 0:33:30 0:11:16 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7913857 2024-09-21 10:08:53 2024-09-21 11:15:53 2024-09-21 11:45:24 0:29:31 0:20:23 0:09:08 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
pass 7913858 2024-09-21 10:08:54 2024-09-21 11:15:53 2024-09-21 11:41:09 0:25:16 0:13:08 0:12:08 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7913859 2024-09-21 10:08:55 2024-09-21 11:18:14 2024-09-21 11:48:06 0:29:52 0:19:15 0:10:37 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7913860 2024-09-21 10:08:56 2024-09-21 11:18:35 2024-09-21 12:15:33 0:56:58 0:47:32 0:09:26 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7913861 2024-09-21 10:08:57 2024-09-21 11:18:35 2024-09-21 11:53:15 0:34:40 0:21:29 0:13:11 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7913862 2024-09-21 10:08:59 2024-09-21 11:20:56 2024-09-21 11:41:53 0:20:57 0:10:02 0:10:55 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_basic} 2
pass 7913863 2024-09-21 10:09:00 2024-09-21 11:21:16 2024-09-21 11:54:49 0:33:33 0:23:16 0:10:17 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
pass 7913864 2024-09-21 10:09:01 2024-09-21 11:22:06 2024-09-21 11:37:07 0:15:01 0:05:35 0:09:26 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7913865 2024-09-21 10:09:02 2024-09-21 11:22:07 2024-09-21 12:05:16 0:43:09 0:32:48 0:10:21 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7913866 2024-09-21 10:09:03 2024-09-21 11:22:17 2024-09-21 11:45:12 0:22:55 0:12:51 0:10:04 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7913867 2024-09-21 10:09:04 2024-09-21 11:22:17 2024-09-21 11:45:59 0:23:42 0:15:01 0:08:41 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7913868 2024-09-21 10:09:06 2024-09-21 11:22:28 2024-09-21 11:46:48 0:24:20 0:13:02 0:11:18 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7913869 2024-09-21 10:09:07 2024-09-21 11:23:38 2024-09-21 11:44:43 0:21:05 0:11:26 0:09:39 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} 1
pass 7913870 2024-09-21 10:09:08 2024-09-21 11:23:49 2024-09-21 11:47:39 0:23:50 0:10:42 0:13:08 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7913871 2024-09-21 10:09:09 2024-09-21 11:26:29 2024-09-21 12:10:45 0:44:16 0:33:07 0:11:09 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7913872 2024-09-21 10:09:10 2024-09-21 11:26:40 2024-09-21 11:50:26 0:23:46 0:13:56 0:09:50 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7913873 2024-09-21 10:09:11 2024-09-21 11:26:40 2024-09-21 11:49:37 0:22:57 0:12:54 0:10:03 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7913874 2024-09-21 10:09:13 2024-09-21 11:27:01 2024-09-21 11:54:32 0:27:31 0:15:14 0:12:17 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_basic} 4
pass 7913875 2024-09-21 10:09:14 2024-09-21 11:29:31 2024-09-21 11:55:06 0:25:35 0:14:37 0:10:58 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7913876 2024-09-21 10:09:15 2024-09-21 11:30:02 2024-09-21 12:10:30 0:40:28 0:28:28 0:12:00 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7913877 2024-09-21 10:09:16 2024-09-21 11:31:32 2024-09-21 12:14:45 0:43:13 0:34:35 0:08:38 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7913878 2024-09-21 10:09:17 2024-09-21 11:31:33 2024-09-21 11:54:29 0:22:56 0:13:02 0:09:54 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7913879 2024-09-21 10:09:19 2024-09-21 11:31:43 2024-09-21 12:03:56 0:32:13 0:22:12 0:10:01 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7913880 2024-09-21 10:09:20 2024-09-21 11:32:34 2024-09-21 12:20:19 0:47:45 0:37:46 0:09:59 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7913881 2024-09-21 10:09:21 2024-09-21 11:33:04 2024-09-21 11:56:38 0:23:34 0:13:56 0:09:38 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7913882 2024-09-21 10:09:22 2024-09-21 11:33:04 2024-09-21 12:28:38 0:55:34 0:43:57 0:11:37 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 32402db0-780f-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\''

pass 7913883 2024-09-21 10:09:24 2024-09-21 11:33:15 2024-09-21 12:13:17 0:40:02 0:26:59 0:13:03 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_ctdb_res_dom} 4
pass 7913884 2024-09-21 10:09:25 2024-09-21 11:35:36 2024-09-21 12:20:05 0:44:29 0:33:10 0:11:19 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7913885 2024-09-21 10:09:26 2024-09-21 11:36:27 2024-09-21 12:10:20 0:33:53 0:24:27 0:09:26 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
pass 7913886 2024-09-21 10:09:27 2024-09-21 11:36:47 2024-09-21 12:00:08 0:23:21 0:13:19 0:10:02 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7913887 2024-09-21 10:09:28 2024-09-21 11:37:17 2024-09-21 12:01:36 0:24:19 0:12:31 0:11:48 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7913888 2024-09-21 10:09:30 2024-09-21 11:37:48 2024-09-21 12:03:12 0:25:24 0:15:28 0:09:56 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7913889 2024-09-21 10:09:31 2024-09-21 11:38:08 2024-09-21 12:35:59 0:57:51 0:46:41 0:11:10 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
fail 7913890 2024-09-21 10:09:32 2024-09-21 11:39:49 2024-09-21 12:08:34 0:28:45 0:17:36 0:11:09 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ips} 4
Failure Reason:

"2024-09-21T12:06:21.494621+0000 mon.a (mon.0) 787 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log

pass 7913891 2024-09-21 10:09:33 2024-09-21 11:41:29 2024-09-21 12:14:34 0:33:05 0:23:29 0:09:36 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7913892 2024-09-21 10:09:34 2024-09-21 11:41:30 2024-09-21 12:04:12 0:22:42 0:13:19 0:09:23 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7913893 2024-09-21 10:09:36 2024-09-21 11:41:50 2024-09-21 12:03:16 0:21:26 0:08:56 0:12:30 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Config file not found: "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephadm.conf".

pass 7913894 2024-09-21 10:09:37 2024-09-21 11:42:00 2024-09-21 12:24:52 0:42:52 0:33:34 0:09:18 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7913895 2024-09-21 10:09:38 2024-09-21 11:42:11 2024-09-21 12:05:37 0:23:26 0:12:26 0:11:00 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

No module named 'tasks.vip'

pass 7913896 2024-09-21 10:09:39 2024-09-21 11:42:31 2024-09-21 12:06:01 0:23:30 0:10:52 0:12:38 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
fail 7913897 2024-09-21 10:09:40 2024-09-21 11:45:02 2024-09-21 12:03:16 0:18:14 0:07:43 0:10:31 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

No module named 'tasks.cephadm'

fail 7913898 2024-09-21 10:09:42 2024-09-21 11:45:42 2024-09-21 12:03:38 0:17:56 0:07:37 0:10:19 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

No module named 'tasks.nvme_loop'

fail 7913899 2024-09-21 10:09:43 2024-09-21 11:46:13 2024-09-21 12:04:07 0:17:54 0:05:43 0:12:11 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} 2
Failure Reason:

Config file not found: "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephadm.conf".

pass 7913900 2024-09-21 10:09:44 2024-09-21 11:47:03 2024-09-21 12:23:14 0:36:11 0:26:26 0:09:45 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7913901 2024-09-21 10:09:45 2024-09-21 11:47:34 2024-09-21 12:31:05 0:43:31 0:33:43 0:09:48 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7913902 2024-09-21 10:09:46 2024-09-21 11:47:54 2024-09-21 12:15:29 0:27:35 0:17:32 0:10:03 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
fail 7913903 2024-09-21 10:09:48 2024-09-21 11:48:25 2024-09-21 12:02:34 0:14:09 0:04:10 0:09:59 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

No module named 'tasks.cephadm'

pass 7913904 2024-09-21 10:09:49 2024-09-21 11:49:55 2024-09-21 12:44:54 0:54:59 0:40:59 0:14:00 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7913905 2024-09-21 10:09:50 2024-09-21 11:52:56 2024-09-21 12:23:48 0:30:52 0:20:09 0:10:43 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7913906 2024-09-21 10:09:51 2024-09-21 11:53:26 2024-09-21 12:22:17 0:28:51 0:18:24 0:10:27 smithi main ubuntu 22.04 orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} 2
pass 7913907 2024-09-21 10:09:52 2024-09-21 11:54:47 2024-09-21 12:36:17 0:41:30 0:32:48 0:08:42 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
dead 7913908 2024-09-21 10:09:53 2024-09-21 11:54:47 2024-09-21 20:04:25 8:09:38 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

hit max job timeout

fail 7913909 2024-09-21 10:09:54 2024-09-21 11:55:08 2024-09-21 12:42:15 0:47:07 0:37:37 0:09:30 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7913910 2024-09-21 10:09:56 2024-09-21 11:55:28 2024-09-21 12:18:32 0:23:04 0:12:48 0:10:16 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
fail 7913911 2024-09-21 10:09:57 2024-09-21 11:55:28 2024-09-21 12:14:00 0:18:32 0:07:36 0:10:56 smithi main ubuntu 22.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

No module named 'tasks'

fail 7913912 2024-09-21 10:09:58 2024-09-21 11:56:29 2024-09-21 12:12:23 0:15:54 0:03:52 0:12:02 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

No module named 'tasks'

pass 7913913 2024-09-21 10:09:59 2024-09-21 11:56:49 2024-09-21 13:05:38 1:08:49 0:57:01 0:11:48 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
dead 7913914 2024-09-21 10:10:00 2024-09-21 11:58:40 2024-09-21 20:09:03 8:10:23 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

hit max job timeout

pass 7913915 2024-09-21 10:10:02 2024-09-21 12:00:21 2024-09-21 12:22:51 0:22:30 0:10:48 0:11:42 smithi main centos 9.stream orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom} 2
pass 7913916 2024-09-21 10:10:03 2024-09-21 12:01:02 2024-09-21 12:35:39 0:34:37 0:23:07 0:11:30 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
pass 7913917 2024-09-21 10:10:04 2024-09-21 12:01:52 2024-09-21 12:27:46 0:25:54 0:15:09 0:10:45 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_set_mon_crush_locations} 3
pass 7913918 2024-09-21 10:10:05 2024-09-21 12:02:53 2024-09-21 12:35:08 0:32:15 0:22:11 0:10:04 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2