Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7893480 2024-09-07 07:25:15 2024-09-07 07:31:09 2024-09-07 08:03:05 0:31:56 0:22:39 0:09:17 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7893481 2024-09-07 07:25:16 2024-09-07 07:31:29 2024-09-07 07:59:23 0:27:54 0:21:04 0:06:50 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 7893482 2024-09-07 07:25:17 2024-09-07 07:31:30 2024-09-07 08:16:26 0:44:56 0:35:01 0:09:55 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7893483 2024-09-07 07:25:19 2024-09-07 07:35:11 2024-09-07 08:23:34 0:48:23 0:40:26 0:07:57 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7893484 2024-09-07 07:25:20 2024-09-07 07:36:32 2024-09-07 08:29:48 0:53:16 0:41:31 0:11:45 smithi main ubuntu 22.04 orch:cephadm/nfs/{cluster/{1-node} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7893485 2024-09-07 07:25:21 2024-09-07 07:38:02 2024-09-07 07:57:16 0:19:14 0:11:36 0:07:38 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} 1
pass 7893486 2024-09-07 07:25:23 2024-09-07 07:38:02 2024-09-07 07:59:23 0:21:21 0:10:45 0:10:36 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
pass 7893487 2024-09-07 07:25:24 2024-09-07 07:42:24 2024-09-07 08:11:40 0:29:16 0:21:25 0:07:51 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
pass 7893488 2024-09-07 07:25:26 2024-09-07 07:42:34 2024-09-07 08:09:49 0:27:15 0:15:48 0:11:27 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7893489 2024-09-07 07:25:27 2024-09-07 07:46:15 2024-09-07 08:04:53 0:18:38 0:10:37 0:08:01 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
pass 7893490 2024-09-07 07:25:28 2024-09-07 07:47:46 2024-09-07 08:10:46 0:23:00 0:10:42 0:12:18 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
pass 7893491 2024-09-07 07:25:30 2024-09-07 07:53:47 2024-09-07 08:50:40 0:56:53 0:46:57 0:09:56 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7893492 2024-09-07 07:25:31 2024-09-07 07:57:28 2024-09-07 08:51:01 0:53:33 0:45:37 0:07:56 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
pass 7893493 2024-09-07 07:25:32 2024-09-07 07:57:59 2024-09-07 08:21:18 0:23:19 0:13:40 0:09:39 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_host_drain} 3
pass 7893494 2024-09-07 07:25:34 2024-09-07 07:59:40 2024-09-07 08:32:20 0:32:40 0:22:18 0:10:22 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
pass 7893495 2024-09-07 07:25:35 2024-09-07 08:03:21 2024-09-07 08:28:29 0:25:08 0:15:47 0:09:21 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7893496 2024-09-07 07:25:36 2024-09-07 08:04:42 2024-09-07 08:37:03 0:32:21 0:20:34 0:11:47 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7893497 2024-09-07 07:25:38 2024-09-07 08:05:12 2024-09-07 08:38:28 0:33:16 0:22:04 0:11:12 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7893498 2024-09-07 07:25:39 2024-09-07 08:06:53 2024-09-07 08:29:07 0:22:14 0:12:21 0:09:53 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7893499 2024-09-07 07:25:40 2024-09-07 08:10:04 2024-09-07 08:46:40 0:36:36 0:26:52 0:09:44 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
pass 7893500 2024-09-07 07:25:42 2024-09-07 08:11:04 2024-09-07 08:48:35 0:37:31 0:30:31 0:07:00 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7893501 2024-09-07 07:25:43 2024-09-07 08:11:05 2024-09-07 09:07:17 0:56:12 0:45:07 0:11:05 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
fail 7893502 2024-09-07 07:25:44 2024-09-07 08:11:45 2024-09-07 08:23:08 0:11:23 0:03:40 0:07:43 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

fail 7893503 2024-09-07 07:25:46 2024-09-07 08:11:56 2024-09-07 08:36:33 0:24:37 0:07:48 0:16:49 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

['ubuntu@smithi193.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).']

fail 7893504 2024-09-07 07:25:47 2024-09-07 08:16:37 2024-09-07 08:29:06 0:12:29 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Stale jobs detected, aborting.

pass 7893505 2024-09-07 07:25:48 2024-09-07 08:21:28 2024-09-07 08:42:31 0:21:03 0:12:47 0:08:16 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7893506 2024-09-07 07:25:49 2024-09-07 08:23:19 2024-09-07 08:54:11 0:30:52 0:19:57 0:10:55 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7893507 2024-09-07 07:25:51 2024-09-07 08:24:40 2024-09-07 08:55:40 0:31:00 0:21:07 0:09:53 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7893508 2024-09-07 07:25:52 2024-09-07 08:28:41 2024-09-07 08:56:19 0:27:38 0:19:30 0:08:08 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cb7b83e-6cf5-11ef-bcea-c7b262605968 -e sha1=03cef208dc8a39e0b8a1806b4763767a2ff62439 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 1\'"\'"\'\''

pass 7893509 2024-09-07 07:25:54 2024-09-07 08:29:21 2024-09-07 08:48:57 0:19:36 0:13:17 0:06:19 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7893510 2024-09-07 07:25:55 2024-09-07 08:29:22 2024-09-07 09:01:56 0:32:34 0:21:28 0:11:06 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7893511 2024-09-07 07:25:56 2024-09-07 08:29:22 2024-09-07 09:29:52 1:00:30 0:49:11 0:11:19 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 7893512 2024-09-07 07:25:58 2024-09-07 08:30:03 2024-09-07 09:12:04 0:42:01 0:34:55 0:07:06 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

pass 7893513 2024-09-07 07:25:59 2024-09-07 08:31:03 2024-09-07 08:54:14 0:23:11 0:16:30 0:06:41 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7893514 2024-09-07 07:26:00 2024-09-07 08:31:04 2024-09-07 08:50:26 0:19:22 0:11:10 0:08:12 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
pass 7893515 2024-09-07 07:26:02 2024-09-07 08:33:15 2024-09-07 09:22:54 0:49:39 0:36:57 0:12:42 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
pass 7893516 2024-09-07 07:26:03 2024-09-07 08:36:46 2024-09-07 09:00:02 0:23:16 0:14:39 0:08:37 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7893517 2024-09-07 07:26:04 2024-09-07 08:38:47 2024-09-07 09:10:02 0:31:15 0:22:03 0:09:12 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
pass 7893518 2024-09-07 07:26:06 2024-09-07 08:40:47 2024-09-07 09:02:13 0:21:26 0:15:01 0:06:25 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7893519 2024-09-07 07:26:07 2024-09-07 08:41:08 2024-09-07 09:30:02 0:48:54 0:40:39 0:08:15 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7893520 2024-09-07 07:26:08 2024-09-07 08:42:49 2024-09-07 09:07:54 0:25:05 0:11:51 0:13:14 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} 1
pass 7893521 2024-09-07 07:26:10 2024-09-07 08:45:40 2024-09-07 09:05:41 0:20:01 0:11:56 0:08:05 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7893522 2024-09-07 07:26:11 2024-09-07 08:46:50 2024-09-07 09:09:01 0:22:11 0:14:13 0:07:58 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7893523 2024-09-07 07:26:12 2024-09-07 08:47:41 2024-09-07 09:18:38 0:30:57 0:19:53 0:11:04 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7893524 2024-09-07 07:26:14 2024-09-07 08:48:52 2024-09-07 09:49:41 1:00:49 0:49:28 0:11:21 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7893525 2024-09-07 07:26:15 2024-09-07 08:49:12 2024-09-07 09:32:03 0:42:51 0:33:37 0:09:14 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7893526 2024-09-07 07:26:16 2024-09-07 08:50:43 2024-09-07 09:08:16 0:17:33 0:10:08 0:07:25 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
fail 7893527 2024-09-07 07:26:18 2024-09-07 08:50:43 2024-09-07 09:02:04 0:11:21 0:03:40 0:07:41 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

pass 7893528 2024-09-07 07:26:19 2024-09-07 08:50:54 2024-09-07 09:10:06 0:19:12 0:12:44 0:06:28 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7893529 2024-09-07 07:26:21 2024-09-07 08:51:14 2024-09-07 09:38:05 0:46:51 0:33:09 0:13:42 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7893530 2024-09-07 07:26:22 2024-09-07 08:54:25 2024-09-07 09:13:20 0:18:55 0:13:09 0:05:46 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
fail 7893531 2024-09-07 07:26:23 2024-09-07 08:54:26 2024-09-07 09:16:05 0:21:39 0:11:24 0:10:15 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f368955f75d280ab61cfdc8a737fe7204b5a0c20 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7893532 2024-09-07 07:26:25 2024-09-07 08:54:26 2024-09-07 09:21:51 0:27:25 0:19:36 0:07:49 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6575aa56-6cf8-11ef-bcea-c7b262605968 -e sha1=03cef208dc8a39e0b8a1806b4763767a2ff62439 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 1\'"\'"\'\''

pass 7893533 2024-09-07 07:26:26 2024-09-07 08:54:37 2024-09-07 09:50:57 0:56:20 0:49:02 0:07:18 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7893534 2024-09-07 07:26:27 2024-09-07 08:55:57 2024-09-07 09:28:14 0:32:17 0:22:43 0:09:34 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
pass 7893535 2024-09-07 07:26:29 2024-09-07 08:56:38 2024-09-07 09:32:10 0:35:32 0:20:52 0:14:40 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7893536 2024-09-07 07:26:30 2024-09-07 09:00:19 2024-09-07 09:30:24 0:30:05 0:22:10 0:07:55 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
fail 7893537 2024-09-07 07:26:31 2024-09-07 09:01:40 2024-09-07 09:29:55 0:28:15 0:20:15 0:08:00 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi039 with status 2: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ae854cc-6cf9-11ef-bcea-c7b262605968 -e sha1=03cef208dc8a39e0b8a1806b4763767a2ff62439 -- bash -c 'ceph orch ps'"

pass 7893538 2024-09-07 07:26:33 2024-09-07 09:02:10 2024-09-07 09:21:07 0:18:57 0:12:18 0:06:39 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} 1
pass 7893539 2024-09-07 07:26:34 2024-09-07 09:02:10 2024-09-07 09:28:03 0:25:53 0:14:35 0:11:18 smithi main ubuntu 22.04 orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli} 2
pass 7893540 2024-09-07 07:26:35 2024-09-07 09:02:21 2024-09-07 09:21:29 0:19:08 0:13:28 0:05:40 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7893541 2024-09-07 07:26:36 2024-09-07 09:02:31 2024-09-07 09:24:23 0:21:52 0:11:51 0:10:01 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} 1
pass 7893542 2024-09-07 07:26:38 2024-09-07 09:05:12 2024-09-07 09:23:13 0:18:01 0:10:50 0:07:11 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
pass 7893543 2024-09-07 07:26:39 2024-09-07 09:05:53 2024-09-07 10:00:33 0:54:40 0:45:35 0:09:05 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
pass 7893544 2024-09-07 07:26:40 2024-09-07 09:07:33 2024-09-07 09:19:45 0:12:12 0:05:13 0:06:59 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_repos} 1
pass 7893545 2024-09-07 07:26:42 2024-09-07 09:08:04 2024-09-07 09:30:08 0:22:04 0:14:17 0:07:47 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
pass 7893546 2024-09-07 07:26:43 2024-09-07 09:08:34 2024-09-07 09:29:45 0:21:11 0:14:02 0:07:09 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
pass 7893547 2024-09-07 07:26:44 2024-09-07 09:08:45 2024-09-07 09:44:07 0:35:22 0:29:13 0:06:09 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7893548 2024-09-07 07:26:46 2024-09-07 09:09:05 2024-09-07 09:48:40 0:39:35 0:33:28 0:06:07 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
pass 7893549 2024-09-07 07:26:47 2024-09-07 09:09:16 2024-09-07 09:47:41 0:38:25 0:31:01 0:07:24 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7893550 2024-09-07 07:26:48 2024-09-07 09:10:17 2024-09-07 09:42:04 0:31:47 0:22:13 0:09:34 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7893551 2024-09-07 07:26:50 2024-09-07 09:10:17 2024-09-07 09:30:23 0:20:06 0:11:34 0:08:32 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
pass 7893552 2024-09-07 07:26:51 2024-09-07 09:10:57 2024-09-07 09:31:03 0:20:06 0:12:32 0:07:34 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
fail 7893553 2024-09-07 07:26:52 2024-09-07 09:11:28 2024-09-07 09:22:26 0:10:58 0:03:43 0:07:15 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0

pass 7893554 2024-09-07 07:26:54 2024-09-07 09:11:29 2024-09-07 09:33:18 0:21:49 0:14:29 0:07:20 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7893555 2024-09-07 07:26:55 2024-09-07 09:12:20 2024-09-07 09:55:07 0:42:47 0:32:06 0:10:41 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
pass 7893556 2024-09-07 07:26:56 2024-09-07 09:13:30 2024-09-07 10:01:27 0:47:57 0:39:40 0:08:17 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7893557 2024-09-07 07:26:58 2024-09-07 09:14:31 2024-09-07 09:33:40 0:19:09 0:11:37 0:07:32 smithi main centos 9.stream orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} 1
pass 7893558 2024-09-07 07:26:59 2024-09-07 09:14:51 2024-09-07 09:39:24 0:24:33 0:15:44 0:08:49 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7893559 2024-09-07 07:27:00 2024-09-07 09:15:52 2024-09-07 10:16:10 1:00:18 0:50:00 0:10:18 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7893560 2024-09-07 07:27:02 2024-09-07 09:16:23 2024-09-07 09:54:25 0:38:02 0:24:00 0:14:02 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
fail 7893561 2024-09-07 07:27:03 2024-09-07 09:20:04 2024-09-07 09:32:50 0:12:46 0:03:41 0:09:05 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

pass 7893562 2024-09-07 07:27:04 2024-09-07 09:21:44 2024-09-07 09:51:08 0:29:24 0:22:18 0:07:06 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
pass 7893563 2024-09-07 07:27:06 2024-09-07 09:22:05 2024-09-07 09:55:40 0:33:35 0:24:19 0:09:16 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7893564 2024-09-07 07:27:07 2024-09-07 09:22:15 2024-09-07 09:41:37 0:19:22 0:12:08 0:07:14 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7893565 2024-09-07 07:27:08 2024-09-07 09:22:36 2024-09-07 09:49:53 0:27:17 0:20:51 0:06:26 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi059 with status 2: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52f284c2-6cfc-11ef-bcea-c7b262605968 -e sha1=03cef208dc8a39e0b8a1806b4763767a2ff62439 -- bash -c 'ceph orch ps'"

pass 7893566 2024-09-07 07:27:09 2024-09-07 09:22:56 2024-09-07 09:44:04 0:21:08 0:13:48 0:07:20 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
pass 7893567 2024-09-07 07:27:11 2024-09-07 09:23:07 2024-09-07 09:40:48 0:17:41 0:10:17 0:07:24 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
pass 7893568 2024-09-07 07:27:12 2024-09-07 09:23:27 2024-09-07 10:11:32 0:48:05 0:37:05 0:11:00 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7893569 2024-09-07 07:27:13 2024-09-07 09:23:38 2024-09-07 09:42:35 0:18:57 0:11:58 0:06:59 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7893570 2024-09-07 07:27:15 2024-09-07 09:23:38 2024-09-07 10:02:05 0:38:27 0:27:03 0:11:24 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
pass 7893571 2024-09-07 07:27:16 2024-09-07 09:26:30 2024-09-07 10:09:37 0:43:07 0:33:37 0:09:30 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7893572 2024-09-07 07:27:17 2024-09-07 09:28:21 2024-09-07 10:09:31 0:41:10 0:34:11 0:06:59 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7893573 2024-09-07 07:27:19 2024-09-07 09:28:32 2024-09-07 09:51:03 0:22:31 0:13:51 0:08:40 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7893574 2024-09-07 07:27:20 2024-09-07 09:29:52 2024-09-07 10:07:02 0:37:10 0:31:10 0:06:00 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7893575 2024-09-07 07:27:21 2024-09-07 09:30:03 2024-09-07 10:18:39 0:48:36 0:37:28 0:11:08 smithi main ubuntu 22.04 orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} 5
pass 7893576 2024-09-07 07:27:23 2024-09-07 09:30:13 2024-09-07 10:02:00 0:31:47 0:20:36 0:11:11 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7893577 2024-09-07 07:27:24 2024-09-07 09:30:14 2024-09-07 09:50:07 0:19:53 0:11:58 0:07:55 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite} 3
pass 7893578 2024-09-07 07:27:25 2024-09-07 09:30:34 2024-09-07 10:12:50 0:42:16 0:32:24 0:09:52 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7893579 2024-09-07 07:27:26 2024-09-07 09:30:35 2024-09-07 10:02:56 0:32:21 0:21:35 0:10:46 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
fail 7893580 2024-09-07 07:27:28 2024-09-07 09:31:15 2024-09-07 09:43:29 0:12:14 0:03:48 0:08:26 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0

pass 7893581 2024-09-07 07:27:29 2024-09-07 09:32:06 2024-09-07 09:51:26 0:19:20 0:13:15 0:06:05 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
pass 7893582 2024-09-07 07:27:30 2024-09-07 09:32:16 2024-09-07 10:27:49 0:55:33 0:48:54 0:06:39 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7893583 2024-09-07 07:27:32 2024-09-07 09:32:27 2024-09-07 09:56:08 0:23:41 0:17:10 0:06:31 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7893584 2024-09-07 07:27:33 2024-09-07 09:33:07 2024-09-07 10:05:23 0:32:16 0:22:24 0:09:52 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
pass 7893585 2024-09-07 07:27:34 2024-09-07 09:33:38 2024-09-07 10:07:27 0:33:49 0:22:02 0:11:47 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
fail 7893586 2024-09-07 07:27:36 2024-09-07 09:36:29 2024-09-07 09:47:34 0:11:05 0:03:40 0:07:25 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific