Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7138433 2023-01-25 17:57:00 2023-01-26 20:27:03 2023-01-26 20:54:03 0:27:00 0:17:37 0:09:23 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli} 1
fail 7138434 2023-01-25 17:57:01 2023-01-26 20:27:04 2023-01-26 20:58:39 0:31:35 0:20:13 0:11:22 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138435 2023-01-25 17:57:03 2023-01-26 20:29:34 2023-01-26 20:58:22 0:28:48 0:21:06 0:07:42 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138436 2023-01-25 17:57:04 2023-01-26 20:30:35 2023-01-26 20:58:13 0:27:38 0:21:30 0:06:08 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

Command failed on smithi062 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b90aa842-9dba-11ed-9e56-001a4aab830c -- ceph orch apply grafana '1;smithi062=a'"

pass 7138437 2023-01-25 17:57:05 2023-01-26 20:31:15 2023-01-26 21:14:35 0:43:20 0:32:05 0:11:15 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7138438 2023-01-25 17:57:06 2023-01-26 20:35:26 2023-01-26 21:25:21 0:49:55 0:38:15 0:11:40 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7138439 2023-01-25 17:57:07 2023-01-26 20:37:57 2023-01-26 21:01:15 0:23:18 0:16:55 0:06:23 smithi main rhel 8.4 orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} 2
Failure Reason:

"2023-01-26T20:54:59.009011+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138440 2023-01-25 17:57:08 2023-01-26 20:38:17 2023-01-26 21:26:28 0:48:11 0:36:44 0:11:27 smithi main centos 8.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
fail 7138441 2023-01-25 17:57:09 2023-01-26 20:39:17 2023-01-26 21:04:32 0:25:15 0:18:43 0:06:32 smithi main rhel 8.4 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

pass 7138442 2023-01-25 17:57:10 2023-01-26 20:39:28 2023-01-26 21:24:33 0:45:05 0:32:51 0:12:14 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7138443 2023-01-25 17:57:11 2023-01-26 20:40:38 2023-01-26 21:44:56 1:04:18 0:53:43 0:10:35 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 7138444 2023-01-25 17:57:12 2023-01-26 20:40:38 2023-01-26 21:22:09 0:41:31 0:29:36 0:11:55 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138445 2023-01-25 17:57:13 2023-01-26 20:42:09 2023-01-26 21:09:09 0:27:00 0:20:46 0:06:14 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138446 2023-01-25 17:57:14 2023-01-26 20:42:09 2023-01-26 21:23:45 0:41:36 0:30:23 0:11:13 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138447 2023-01-25 17:57:15 2023-01-26 20:43:40 2023-01-26 21:15:44 0:32:04 0:25:07 0:06:57 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138448 2023-01-25 17:57:16 2023-01-26 20:44:20 2023-01-26 21:03:18 0:18:58 0:13:40 0:05:18 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} 1
fail 7138449 2023-01-25 17:57:17 2023-01-26 20:44:20 2023-01-26 21:16:28 0:32:08 0:21:15 0:10:53 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138450 2023-01-25 17:57:18 2023-01-26 20:44:31 2023-01-26 21:25:18 0:40:47 0:29:43 0:11:04 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138451 2023-01-25 17:57:19 2023-01-26 20:45:21 2023-01-26 21:07:34 0:22:13 0:08:51 0:13:22 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7138452 2023-01-25 17:57:20 2023-01-26 20:47:12 2023-01-26 21:18:42 0:31:30 0:20:36 0:10:54 smithi main rhel 8.4 orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138453 2023-01-25 17:57:21 2023-01-26 20:51:42 2023-01-26 21:33:24 0:41:42 0:32:31 0:09:11 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 7138454 2023-01-25 17:57:22 2023-01-26 20:51:43 2023-01-26 21:27:00 0:35:17 0:23:26 0:11:51 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138455 2023-01-25 17:57:23 2023-01-26 20:54:03 2023-01-26 21:27:20 0:33:17 0:20:45 0:12:32 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138456 2023-01-25 17:57:24 2023-01-26 20:55:44 2023-01-26 21:32:30 0:36:46 0:25:54 0:10:52 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138457 2023-01-25 17:57:25 2023-01-26 20:57:24 2023-01-26 21:44:51 0:47:27 0:34:35 0:12:52 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7138458 2023-01-25 17:57:26 2023-01-26 20:57:25 2023-01-26 21:32:40 0:35:15 0:25:17 0:09:58 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138459 2023-01-25 17:57:27 2023-01-26 20:57:25 2023-01-26 21:16:14 0:18:49 0:08:53 0:09:56 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7138460 2023-01-25 17:57:28 2023-01-26 20:57:25 2023-01-26 21:29:13 0:31:48 0:20:52 0:10:56 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138461 2023-01-25 17:57:29 2023-01-26 20:58:16 2023-01-26 21:35:55 0:37:39 0:26:41 0:10:58 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138462 2023-01-25 17:57:30 2023-01-26 20:58:26 2023-01-26 21:39:00 0:40:34 0:31:05 0:09:29 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} 1
fail 7138463 2023-01-25 17:57:31 2023-01-26 20:58:26 2023-01-26 21:25:44 0:27:18 0:20:26 0:06:52 smithi main rhel 8.4 orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138464 2023-01-25 17:57:32 2023-01-26 20:58:46 2023-01-26 21:32:32 0:33:46 0:23:00 0:10:46 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138465 2023-01-25 17:57:33 2023-01-26 20:59:27 2023-01-26 21:27:01 0:27:34 0:20:51 0:06:43 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138466 2023-01-25 17:57:34 2023-01-26 20:59:47 2023-01-26 21:35:27 0:35:40 0:26:17 0:09:23 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138467 2023-01-25 17:57:36 2023-01-26 21:00:17 2023-01-26 21:34:09 0:33:52 0:25:49 0:08:03 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138468 2023-01-25 17:57:37 2023-01-26 21:01:18 2023-01-26 21:27:30 0:26:12 0:18:21 0:07:51 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} 1
pass 7138469 2023-01-25 17:57:38 2023-01-26 21:02:08 2023-01-26 21:46:36 0:44:28 0:33:33 0:10:55 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7138470 2023-01-25 17:57:39 2023-01-26 21:03:19 2023-01-26 22:04:52 1:01:33 0:46:57 0:14:36 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
pass 7138471 2023-01-25 17:57:40 2023-01-26 21:07:40 2023-01-26 21:52:04 0:44:24 0:33:37 0:10:47 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7138472 2023-01-25 17:57:41 2023-01-26 21:09:11 2023-01-26 21:41:56 0:32:45 0:20:40 0:12:05 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138473 2023-01-25 17:57:42 2023-01-26 21:14:42 2023-01-26 21:47:41 0:32:59 0:26:43 0:06:16 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138474 2023-01-25 17:57:43 2023-01-26 21:14:42 2023-01-26 21:53:49 0:39:07 0:31:45 0:07:22 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
fail 7138475 2023-01-25 17:57:44 2023-01-26 21:16:33 2023-01-26 21:45:35 0:29:02 0:20:10 0:08:52 smithi main rhel 8.4 orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138476 2023-01-25 17:57:45 2023-01-26 21:18:43 2023-01-26 21:51:20 0:32:37 0:23:32 0:09:05 smithi main rhel 8.4 orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138477 2023-01-25 17:57:46 2023-01-26 21:22:14 2023-01-26 21:54:27 0:32:13 0:21:48 0:10:25 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138478 2023-01-25 17:57:47 2023-01-26 21:22:34 2023-01-26 21:56:57 0:34:23 0:26:56 0:07:27 smithi main rhel 8.4 orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138479 2023-01-25 17:57:48 2023-01-26 21:23:55 2023-01-26 22:05:45 0:41:50 0:29:04 0:12:46 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138480 2023-01-25 17:57:49 2023-01-26 21:24:35 2023-01-26 21:43:54 0:19:19 0:09:38 0:09:41 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} 1
pass 7138481 2023-01-25 17:57:50 2023-01-26 21:24:35 2023-01-26 22:06:56 0:42:21 0:32:36 0:09:45 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 7138482 2023-01-25 17:57:52 2023-01-26 21:25:26 2023-01-26 21:54:28 0:29:02 0:20:30 0:08:32 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138483 2023-01-25 17:57:53 2023-01-26 21:25:26 2023-01-26 22:09:32 0:44:06 0:33:19 0:10:47 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
fail 7138484 2023-01-25 17:57:54 2023-01-26 21:25:46 2023-01-26 22:01:33 0:35:47 0:26:07 0:09:40 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138485 2023-01-25 17:57:55 2023-01-26 21:26:37 2023-01-26 21:47:54 0:21:17 0:12:48 0:08:29 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7138486 2023-01-25 17:57:56 2023-01-26 21:26:37 2023-01-26 21:50:09 0:23:32 0:17:03 0:06:29 smithi main rhel 8.4 orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} 2
Failure Reason:

"2023-01-26T21:44:06.162737+0000 mgr.z (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138487 2023-01-25 17:57:57 2023-01-26 21:27:07 2023-01-26 21:52:00 0:24:53 0:18:30 0:06:23 smithi main rhel 8.4 orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
Failure Reason:

timeout expired in wait_until_healthy

fail 7138488 2023-01-25 17:57:58 2023-01-26 21:27:07 2023-01-26 21:59:05 0:31:58 0:23:56 0:08:02 smithi main rhel 8.4 orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138489 2023-01-25 17:57:59 2023-01-26 21:27:28 2023-01-26 21:58:59 0:31:31 0:20:56 0:10:35 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138490 2023-01-25 17:58:00 2023-01-26 21:27:38 2023-01-26 22:04:16 0:36:38 0:27:50 0:08:48 smithi main rhel 8.4 orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138491 2023-01-25 17:58:01 2023-01-26 21:29:19 2023-01-26 22:05:41 0:36:22 0:24:26 0:11:56 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138492 2023-01-25 17:58:02 2023-01-26 21:32:39 2023-01-26 21:49:25 0:16:46 0:08:53 0:07:53 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi202 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7138493 2023-01-25 17:58:03 2023-01-26 21:32:40 2023-01-26 22:04:47 0:32:07 0:21:42 0:10:25 smithi main ubuntu 20.04 orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138494 2023-01-25 17:58:04 2023-01-26 21:32:50 2023-01-26 22:00:59 0:28:09 0:20:54 0:07:15 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138495 2023-01-25 17:58:05 2023-01-26 21:33:30 2023-01-26 22:09:03 0:35:33 0:27:44 0:07:49 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138496 2023-01-25 17:58:06 2023-01-26 21:34:11 2023-01-26 22:11:08 0:36:57 0:31:06 0:05:51 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_nfs} 1
pass 7138497 2023-01-25 17:58:07 2023-01-26 21:34:11 2023-01-26 22:18:38 0:44:27 0:32:49 0:11:38 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7138498 2023-01-25 17:58:08 2023-01-26 21:35:31 2023-01-26 22:40:42 1:05:11 0:52:54 0:12:17 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
fail 7138499 2023-01-25 17:58:09 2023-01-26 21:36:02 2023-01-26 22:24:06 0:48:04 0:31:04 0:17:00 smithi main ubuntu 20.04 orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138500 2023-01-25 17:58:10 2023-01-26 21:42:03 2023-01-26 22:10:43 0:28:40 0:20:54 0:07:46 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138501 2023-01-25 17:58:11 2023-01-26 21:44:03 2023-01-26 22:28:20 0:44:17 0:30:52 0:13:25 smithi main ubuntu 20.04 orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138502 2023-01-25 17:58:13 2023-01-26 21:44:54 2023-01-26 22:04:18 0:19:24 0:13:17 0:06:07 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Command failed on smithi172 with status 127: 'sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f61b644c-9dc4-11ed-9e56-001a4aab830c -- ceph mon dump -f json'

pass 7138503 2023-01-25 17:58:14 2023-01-26 21:45:04 2023-01-26 22:10:37 0:25:33 0:18:17 0:07:16 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} 1
pass 7138504 2023-01-25 17:58:15 2023-01-26 21:45:45 2023-01-26 22:36:02 0:50:17 0:39:00 0:11:17 smithi main centos 8.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
fail 7138505 2023-01-25 17:58:16 2023-01-26 21:46:45 2023-01-26 22:16:33 0:29:48 0:20:25 0:09:23 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138506 2023-01-25 17:58:17 2023-01-26 21:47:45 2023-01-26 22:19:49 0:32:04 0:21:50 0:10:14 smithi main ubuntu 20.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138507 2023-01-25 17:58:18 2023-01-26 21:47:56 2023-01-26 22:30:14 0:42:18 0:29:54 0:12:24 smithi main ubuntu 20.04 orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138508 2023-01-25 17:58:19 2023-01-26 21:50:16 2023-01-26 22:42:02 0:51:46 0:39:53 0:11:53 smithi main ubuntu 20.04 orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
pass 7138509 2023-01-25 17:58:20 2023-01-26 21:52:07 2023-01-26 22:35:22 0:43:15 0:32:24 0:10:51 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 7138510 2023-01-25 17:58:21 2023-01-26 21:53:57 2023-01-26 22:27:11 0:33:14 0:23:07 0:10:07 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138511 2023-01-25 17:58:22 2023-01-26 21:53:58 2023-01-26 22:22:53 0:28:55 0:20:29 0:08:26 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138512 2023-01-25 17:58:23 2023-01-26 21:53:58 2023-01-26 22:29:18 0:35:20 0:26:07 0:09:13 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138513 2023-01-25 17:58:24 2023-01-26 21:54:28 2023-01-26 22:51:27 0:56:59 0:47:26 0:09:33 smithi main centos 8.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
fail 7138514 2023-01-25 17:58:25 2023-01-26 21:54:29 2023-01-26 22:32:21 0:37:52 0:24:39 0:13:13 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138515 2023-01-25 17:58:26 2023-01-26 21:56:59 2023-01-26 22:22:10 0:25:11 0:12:59 0:12:12 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_adoption} 1
fail 7138516 2023-01-25 17:58:27 2023-01-26 21:59:00 2023-01-26 22:30:53 0:31:53 0:20:52 0:11:01 smithi main centos 8.stream orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138517 2023-01-25 17:58:28 2023-01-26 21:59:10 2023-01-26 22:34:14 0:35:04 0:25:51 0:09:13 smithi main centos 8.stream orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138518 2023-01-25 17:58:29 2023-01-26 21:59:20 2023-01-26 22:21:56 0:22:36 0:13:35 0:09:01 smithi main centos 8.stream orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

fail 7138519 2023-01-25 17:58:30 2023-01-26 21:59:21 2023-01-26 22:32:27 0:33:06 0:20:56 0:12:10 smithi main centos 8.stream orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

timeout expired in wait_until_healthy

dead 7138520 2023-01-25 17:58:31 2023-01-26 22:01:01 2023-01-26 22:05:55 0:04:54 smithi main centos 8.stream orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Error reimaging machines: 'NoneType' object has no attribute '_fields'

fail 7138521 2023-01-25 17:58:32 2023-01-26 22:01:42 2023-01-26 22:31:28 0:29:46 0:20:32 0:09:14 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138522 2023-01-25 17:58:33 2023-01-26 22:04:22 2023-01-26 22:39:20 0:34:58 0:26:32 0:08:26 smithi main centos 8.stream orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138523 2023-01-25 17:58:34 2023-01-26 22:04:23 2023-01-26 22:36:16 0:31:53 0:25:18 0:06:35 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138524 2023-01-25 17:58:35 2023-01-26 22:04:53 2023-01-26 22:19:54 0:15:01 0:08:33 0:06:28 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi203 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fddc3e5ab97025e2a660ac57b8fffb8d94aa8485 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

pass 7138525 2023-01-25 17:58:36 2023-01-26 22:04:53 2023-01-26 22:48:51 0:43:58 0:32:43 0:11:15 smithi main centos 8.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7138526 2023-01-25 17:58:37 2023-01-26 22:05:44 2023-01-26 22:52:36 0:46:52 0:34:07 0:12:45 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
fail 7138527 2023-01-25 17:58:38 2023-01-26 22:05:54 2023-01-26 22:33:05 0:27:11 0:20:55 0:06:16 smithi main rhel 8.4 orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

timeout expired in wait_until_healthy

fail 7138528 2023-01-25 17:58:39 2023-01-26 22:06:14 2023-01-26 22:40:24 0:34:10 0:26:58 0:07:12 smithi main rhel 8.4 orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

timeout expired in wait_until_healthy

pass 7138529 2023-01-25 17:58:40 2023-01-26 22:07:05 2023-01-26 22:45:34 0:38:29 0:33:11 0:05:18 smithi main rhel 8.4 orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/classic task/test_nfs} 1