Pulpito

yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
yuriw 2022-12-22 21:14:13 2022-12-23 03:21:53 orch pacific_16.2.11_RC3 smithi 22be1b8 157 13 3

Average wait time: 0:08:06

See other runs of suite 'orch' on branch 'pacific_16.2.11_RC3'?

See other runs on branch 'pacific_16.2.11_RC3'?

See other runs scheduled on 2022-12-22?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7125426 2022-12-22 21:15:55 2022-12-22 22:31:26 931 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} 1
pass 7125431 2022-12-22 21:15:57 2022-12-22 22:09:30 2022-12-22 22:34:38 0:25:08 0:16:14 0:08:54 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7125434 2022-12-22 21:15:58 2022-12-22 22:11:13 2022-12-22 22:51:04 0:39:51 0:33:00 0:06:51 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125437 2022-12-22 21:16:00 2022-12-22 22:11:44 2022-12-22 22:54:12 0:42:28 0:34:17 0:08:11 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
pass 7125439 2022-12-22 21:16:01 2022-12-22 22:14:15 2022-12-22 22:48:18 0:34:03 0:23:55 0:10:08 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 7125441 2022-12-22 21:16:02 2022-12-22 22:15:26 2022-12-22 22:50:58 0:35:32 0:27:39 0:07:53 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} 5
pass 7125442 2022-12-22 21:16:03 2022-12-22 22:15:27 2022-12-22 22:44:16 0:28:49 0:17:43 0:11:06 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7125444 2022-12-22 21:16:10 2022-12-22 22:16:39 2022-12-22 22:40:38 0:23:59 0:15:45 0:08:14 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
fail 7125446 2022-12-22 21:16:12 2022-12-22 22:16:52 2022-12-22 22:51:48 0:34:56 0:23:30 0:11:26 smithi main centos 8.stream orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7125449 2022-12-22 21:16:13 2022-12-22 22:21:04 2022-12-22 22:58:05 0:37:01 0:31:01 0:06:00 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125451 2022-12-22 21:16:20 2022-12-22 22:21:15 2022-12-22 23:01:08 0:39:53 0:32:01 0:07:52 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125453 2022-12-22 21:16:31 2022-12-22 22:45:04 676 smithi main ubuntu 20.04 orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} 2
pass 7125455 2022-12-22 21:16:33 2022-12-22 22:23:00 2022-12-22 23:10:01 0:47:01 0:40:30 0:06:31 smithi main centos 8.stream orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} 3
pass 7125457 2022-12-22 21:16:34 2022-12-22 22:49:39 1048 smithi main centos 8.stream orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} 2
pass 7125459 2022-12-22 21:16:35 2022-12-22 22:25:12 2022-12-22 22:50:30 0:25:18 0:15:46 0:09:32 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7125460 2022-12-22 21:16:37 2022-12-22 22:26:42 2022-12-22 22:46:12 0:19:30 0:12:54 0:06:36 smithi main centos 8.stream orch/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} 1
pass 7125462 2022-12-22 21:16:38 2022-12-22 22:28:44 2022-12-22 23:09:50 0:41:06 0:33:37 0:07:29 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 7125464 2022-12-22 21:16:44 2022-12-22 22:29:15 2022-12-22 23:33:38 1:04:23 0:53:32 0:10:51 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7125467 2022-12-22 21:16:46 2022-12-22 22:30:46 2022-12-22 23:12:30 0:41:44 0:35:05 0:06:39 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7125469 2022-12-22 21:16:47 2022-12-22 22:31:17 2022-12-22 22:51:00 0:19:43 0:12:23 0:07:20 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} 1
pass 7125471 2022-12-22 21:16:53 2022-12-22 22:31:28 2022-12-22 23:24:08 0:52:40 0:44:50 0:07:50 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 7125472 2022-12-22 21:16:55 2022-12-22 22:31:59 2022-12-22 22:54:11 0:22:12 0:14:22 0:07:50 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
fail 7125475 2022-12-22 21:16:56 2022-12-22 22:53:04 717 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7125476 2022-12-22 21:16:58 2022-12-22 22:34:21 2022-12-22 22:55:38 0:21:17 0:15:18 0:05:59 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 7125478 2022-12-22 21:16:59 2022-12-22 22:34:41 2022-12-23 00:20:04 1:45:23 1:36:47 0:08:36 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 7125481 2022-12-22 21:17:06 2022-12-22 22:56:45 770 smithi main rhel 8.4 orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7125482 2022-12-22 21:17:07 2022-12-22 22:37:33 2022-12-22 23:15:04 0:37:31 0:30:28 0:07:03 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125484 2022-12-22 21:17:09 2022-12-22 22:38:14 2022-12-22 23:00:42 0:22:28 0:14:20 0:08:08 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7125486 2022-12-22 21:17:10 2022-12-22 22:39:35 2022-12-22 23:28:54 0:49:19 0:39:49 0:09:30 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
fail 7125488 2022-12-22 21:17:12 2022-12-22 22:41:36 2022-12-22 22:58:25 0:16:49 0:07:56 0:08:53 smithi main ubuntu 18.04 orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} 3
Failure Reason:

Command failed on smithi039 with status 1: 'sudo kubeadm init --node-name smithi039 --token abcdef.i8mbkebhcx1ttcvo --pod-network-cidr 10.249.48.0/21'

pass 7125490 2022-12-22 21:17:28 2022-12-22 22:43:08 2022-12-22 23:14:57 0:31:49 0:24:34 0:07:15 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7125492 2022-12-22 21:17:39 2022-12-22 22:44:19 2022-12-22 22:59:52 0:15:33 0:08:51 0:06:42 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} 1
pass 7125494 2022-12-22 21:17:51 2022-12-22 22:44:50 2022-12-22 23:06:28 0:21:38 0:15:33 0:06:05 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 7125496 2022-12-22 21:17:52 2022-12-22 22:46:21 2022-12-22 23:14:00 0:27:39 0:20:33 0:07:06 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7125498 2022-12-22 21:17:54 2022-12-22 22:48:02 2022-12-22 23:36:10 0:48:08 0:36:43 0:11:25 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
pass 7125500 2022-12-22 21:18:10 2022-12-22 22:49:43 2022-12-22 23:30:23 0:40:40 0:32:45 0:07:55 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125502 2022-12-22 21:18:11 2022-12-22 22:50:44 2022-12-22 23:25:47 0:35:03 0:27:20 0:07:43 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7125504 2022-12-22 21:18:13 2022-12-22 22:51:05 2022-12-22 23:27:54 0:36:49 0:27:39 0:09:10 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
pass 7125507 2022-12-22 21:18:19 2022-12-22 23:25:21 1382 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7125508 2022-12-22 21:18:21 2022-12-22 22:51:07 2022-12-22 23:11:59 0:20:52 0:13:02 0:07:50 smithi main rhel 8.4 orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
pass 7125510 2022-12-22 21:18:22 2022-12-22 22:53:08 2022-12-22 23:22:56 0:29:48 0:22:17 0:07:31 smithi main ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 7125512 2022-12-22 21:18:23 2022-12-22 22:53:28 2022-12-22 23:31:20 0:37:52 0:29:37 0:08:15 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125514 2022-12-22 21:18:24 2022-12-22 22:54:19 2022-12-22 23:17:23 0:23:04 0:15:28 0:07:36 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7125516 2022-12-22 21:18:41 2022-12-22 22:54:30 2022-12-22 23:44:03 0:49:33 0:43:12 0:06:21 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 7125518 2022-12-22 21:18:44 2022-12-22 23:47:38 2441 smithi main ubuntu 18.04 orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7125520 2022-12-22 21:18:45 2022-12-22 22:55:42 2022-12-22 23:40:05 0:44:23 0:17:27 0:26:56 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} 1
pass 7125522 2022-12-22 21:18:47 2022-12-22 22:56:53 2022-12-22 23:57:21 1:00:28 0:52:20 0:08:08 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 7125524 2022-12-22 21:18:56 2022-12-22 22:58:14 2022-12-22 23:37:05 0:38:51 0:30:34 0:08:17 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125527 2022-12-22 21:18:59 2022-12-22 22:58:45 2022-12-22 23:34:30 0:35:45 0:23:56 0:11:49 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 7125528 2022-12-22 21:19:05 2022-12-22 22:59:46 2022-12-22 23:20:21 0:20:35 0:12:50 0:07:45 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7125530 2022-12-22 21:19:07 2022-12-22 23:00:17 2022-12-22 23:37:35 0:37:18 0:27:40 0:09:38 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
pass 7125532 2022-12-22 21:19:18 2022-12-22 23:33:08 1159 smithi main ubuntu 18.04 orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7125534 2022-12-22 21:19:27 2022-12-22 23:01:19 2022-12-22 23:34:51 0:33:32 0:25:13 0:08:19 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
fail 7125536 2022-12-22 21:19:28 2022-12-22 23:03:00 2022-12-22 23:19:43 0:16:43 0:07:16 0:09:27 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

Command failed on smithi146 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97a18eaa-824e-11ed-97ac-001a4aab830c -- ceph mon dump -f json'

dead 7125538 2022-12-22 21:19:30 2022-12-22 23:08:12 2022-12-22 23:20:14 0:12:02 0:03:57 0:08:05 smithi main orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

{'smithi154.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.163554', 'end': '2022-12-22 23:18:13.939310', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-22 23:18:09.775756', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi052.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.258490', 'end': '2022-12-22 23:18:17.001882', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-22 23:18:12.743392', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}}

pass 7125540 2022-12-22 21:19:36 2022-12-22 23:09:53 2022-12-22 23:49:13 0:39:20 0:31:31 0:07:49 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125542 2022-12-22 21:19:38 2022-12-22 23:10:04 2022-12-22 23:36:58 0:26:54 0:17:35 0:09:19 smithi main centos 8.stream orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} 2
pass 7125544 2022-12-22 21:19:39 2022-12-22 23:12:25 2022-12-22 23:31:05 0:18:40 0:11:49 0:06:51 smithi main rhel 8.4 orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 7125546 2022-12-22 21:19:40 2022-12-22 23:12:36 2022-12-23 00:13:27 1:00:51 0:52:41 0:08:10 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 7125548 2022-12-22 21:19:41 2022-12-22 23:14:17 2022-12-23 00:19:26 1:05:09 0:54:15 0:10:54 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7125550 2022-12-22 21:19:43 2022-12-22 23:17:19 2022-12-22 23:59:25 0:42:06 0:31:02 0:11:04 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7125552 2022-12-22 21:19:44 2022-12-22 23:17:39 2022-12-22 23:36:38 0:18:59 0:12:14 0:06:45 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} 1
pass 7125554 2022-12-22 21:19:45 2022-12-22 23:18:10 2022-12-22 23:43:18 0:25:08 0:17:43 0:07:25 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7125556 2022-12-22 21:19:47 2022-12-22 23:20:21 2022-12-23 00:09:52 0:49:31 0:43:40 0:05:51 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
fail 7125558 2022-12-22 21:19:48 2022-12-22 23:20:22 2022-12-22 23:40:48 0:20:26 0:11:17 0:09:09 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7125560 2022-12-22 21:19:55 2022-12-22 23:22:13 2022-12-22 23:43:22 0:21:09 0:15:22 0:05:47 smithi main ubuntu 18.04 orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7125562 2022-12-22 21:19:56 2022-12-22 23:23:04 2022-12-22 23:45:06 0:22:02 0:15:36 0:06:26 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 7125564 2022-12-22 21:19:57 2022-12-22 23:24:15 2022-12-22 23:52:12 0:27:57 0:16:53 0:11:04 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
pass 7125566 2022-12-22 21:20:04 2022-12-23 00:03:19 1851 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125569 2022-12-22 21:20:05 2022-12-22 23:27:37 2022-12-23 00:07:31 0:39:54 0:33:14 0:06:40 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125571 2022-12-22 21:20:07 2022-12-22 23:28:38 2022-12-22 23:50:57 0:22:19 0:14:53 0:07:26 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
pass 7125573 2022-12-22 21:20:08 2022-12-22 23:30:29 2022-12-23 00:12:10 0:41:41 0:34:08 0:07:33 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 7125575 2022-12-22 21:20:09 2022-12-22 23:31:20 2022-12-23 00:15:15 0:43:55 0:36:53 0:07:02 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7125577 2022-12-22 21:20:15 2022-12-22 23:33:11 2022-12-22 23:48:53 0:15:42 0:08:38 0:07:04 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} 1
pass 7125579 2022-12-22 21:20:22 2022-12-22 23:34:22 2022-12-23 01:44:35 2:10:13 1:58:14 0:11:59 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} 3
fail 7125580 2022-12-22 21:20:24 2022-12-22 23:34:33 2022-12-22 23:48:09 0:13:36 0:07:05 0:06:31 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
Failure Reason:

Command failed on smithi081 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8fc942d2-8252-11ed-97ac-001a4aab830c -- ceph mon dump -f json'

pass 7125583 2022-12-22 21:20:25 2022-12-22 23:36:14 2022-12-22 23:55:48 0:19:34 0:13:28 0:06:06 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7125585 2022-12-22 21:20:41 2022-12-23 00:15:04 1788 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125587 2022-12-22 21:20:44 2022-12-22 23:37:36 2022-12-23 00:21:09 0:43:33 0:32:04 0:11:29 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7125588 2022-12-22 21:20:45 2022-12-22 23:39:07 2022-12-23 00:11:56 0:32:49 0:27:18 0:05:31 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
pass 7125591 2022-12-22 21:20:47 2022-12-22 23:41:38 2022-12-23 00:13:28 0:31:50 0:19:19 0:12:31 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
pass 7125593 2022-12-22 21:21:02 2022-12-22 23:43:30 2022-12-23 00:27:06 0:43:36 0:37:20 0:06:16 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 7125595 2022-12-22 21:21:15 2022-12-22 23:44:11 2022-12-23 00:14:43 0:30:32 0:21:55 0:08:37 smithi main ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
fail 7125596 2022-12-22 21:21:16 2022-12-22 23:44:41 2022-12-23 00:02:40 0:17:59 0:07:57 0:10:02 smithi main ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

Command failed on smithi016 with status 1: 'sudo kubeadm init --node-name smithi016 --token abcdef.41t5c0xiy5mgxj6t --pod-network-cidr 10.248.120.0/21'

fail 7125598 2022-12-22 21:21:18 2022-12-22 23:44:52 2022-12-23 00:00:06 0:15:14 0:07:42 0:07:32 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

Command failed on smithi170 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f579e9d2-8253-11ed-97ac-001a4aab830c -- ceph mon dump -f json'

pass 7125600 2022-12-22 21:21:24 2022-12-22 23:44:52 2022-12-23 00:32:31 0:47:39 0:40:27 0:07:12 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
pass 7125602 2022-12-22 21:21:25 2022-12-22 23:45:03 2022-12-23 00:18:02 0:32:59 0:25:12 0:07:47 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 7125604 2022-12-22 21:21:26 2022-12-22 23:45:14 2022-12-23 00:10:23 0:25:09 0:15:51 0:09:18 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} 1
pass 7125606 2022-12-22 21:21:28 2022-12-22 23:47:25 2022-12-23 00:13:41 0:26:16 0:18:34 0:07:42 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7125608 2022-12-22 21:21:29 2022-12-22 23:47:46 2022-12-23 00:28:10 0:40:24 0:32:11 0:08:13 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125610 2022-12-22 21:21:45 2022-12-22 23:48:27 2022-12-23 00:47:06 0:58:39 0:51:14 0:07:25 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 7125612 2022-12-22 21:21:58 2022-12-23 00:25:32 1449 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
pass 7125615 2022-12-22 21:22:07 2022-12-22 23:52:19 2022-12-23 00:31:50 0:39:31 0:27:36 0:11:55 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} 5
pass 7125616 2022-12-22 21:22:08 2022-12-22 23:55:51 2022-12-23 00:18:23 0:22:32 0:15:21 0:07:11 smithi main centos 8.stream orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7125619 2022-12-22 21:22:10 2022-12-22 23:57:52 2022-12-23 00:30:03 0:32:11 0:20:41 0:11:30 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
fail 7125621 2022-12-22 21:22:11 2022-12-22 23:57:53 2022-12-23 00:29:42 0:31:49 0:24:21 0:07:28 smithi main centos 8.stream orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} 2
Failure Reason:

Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

pass 7125623 2022-12-22 21:22:12 2022-12-22 23:59:34 2022-12-23 00:39:16 0:39:42 0:32:22 0:07:20 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125625 2022-12-22 21:22:19 2022-12-23 00:01:25 2022-12-23 00:40:00 0:38:35 0:32:43 0:05:52 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125627 2022-12-22 21:22:22 2022-12-23 00:02:06 2022-12-23 00:21:34 0:19:28 0:13:37 0:05:51 smithi main rhel 8.4 orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} 2
pass 7125628 2022-12-22 21:22:25 2022-12-23 00:02:26 2022-12-23 00:26:08 0:23:42 0:15:56 0:07:46 smithi main rhel 8.4 orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} 3
pass 7125631 2022-12-22 21:22:34 2022-12-23 00:32:38 1072 smithi main centos 8.stream orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} 2
pass 7125632 2022-12-22 21:22:41 2022-12-23 00:06:18 2022-12-23 00:29:26 0:23:08 0:17:25 0:05:43 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7125634 2022-12-22 21:22:47 2022-12-23 00:07:49 2022-12-23 00:29:06 0:21:17 0:14:45 0:06:32 smithi main ubuntu 18.04 orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} 1
pass 7125636 2022-12-22 21:22:53 2022-12-23 00:55:09 2256 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
pass 7125639 2022-12-22 21:22:54 2022-12-23 00:10:53 2022-12-23 00:45:08 0:34:15 0:27:03 0:07:12 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7125641 2022-12-22 21:22:56 2022-12-23 00:13:35 2022-12-23 00:56:37 0:43:02 0:36:12 0:06:50 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 7125643 2022-12-22 21:22:57 2022-12-23 00:14:48 2022-12-23 00:33:08 0:18:20 0:12:35 0:05:45 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} 1
pass 7125645 2022-12-22 21:22:58 2022-12-23 00:14:48 2022-12-23 00:57:12 0:42:24 0:35:08 0:07:16 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
pass 7125647 2022-12-22 21:23:08 2022-12-23 00:15:29 2022-12-23 00:40:11 0:24:42 0:16:53 0:07:49 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
pass 7125649 2022-12-22 21:23:10 2022-12-23 00:17:35 2022-12-23 00:36:58 0:19:23 0:12:51 0:06:32 smithi main rhel 8.4 orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
fail 7125651 2022-12-22 21:23:11 2022-12-23 00:36:57 679 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7125652 2022-12-22 21:23:17 2022-12-23 00:18:06 2022-12-23 00:42:28 0:24:22 0:16:04 0:08:18 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} 2
pass 7125654 2022-12-22 21:23:19 2022-12-23 00:19:18 2022-12-23 01:03:34 0:44:16 0:36:01 0:08:15 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 7125657 2022-12-22 21:23:20 2022-12-23 00:58:57 1826 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125659 2022-12-22 21:23:26 2022-12-23 00:22:19 2022-12-23 00:42:28 0:20:09 0:13:19 0:06:50 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} 2
pass 7125661 2022-12-22 21:23:33 2022-12-23 01:24:59 3160 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
pass 7125663 2022-12-22 21:23:34 2022-12-23 00:26:15 2022-12-23 01:01:14 0:34:59 0:29:28 0:05:31 smithi main ubuntu 18.04 orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 7125665 2022-12-22 21:23:35 2022-12-23 00:27:06 2022-12-23 00:42:34 0:15:28 0:08:44 0:06:44 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} 1
pass 7125666 2022-12-22 21:23:52 2022-12-23 00:27:17 2022-12-23 00:48:34 0:21:17 0:15:33 0:05:44 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} 2
pass 7125669 2022-12-22 21:23:57 2022-12-23 00:29:33 2022-12-23 00:53:20 0:23:47 0:16:21 0:07:26 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
pass 7125671 2022-12-22 21:24:00 2022-12-23 02:06:45 5058 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 7125672 2022-12-22 21:24:02 2022-12-23 00:30:04 2022-12-23 00:53:50 0:23:46 0:14:09 0:09:37 smithi main rhel 8.4 orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 7125674 2022-12-22 21:24:03 2022-12-23 00:32:08 2022-12-23 01:13:55 0:41:47 0:33:35 0:08:12 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125676 2022-12-22 21:24:04 2022-12-23 00:32:54 2022-12-23 01:37:49 1:04:55 0:53:43 0:11:12 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7125679 2022-12-22 21:24:06 2022-12-23 01:10:24 1666 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} 1
pass 7125681 2022-12-22 21:24:16 2022-12-23 01:11:13 1445 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
pass 7125683 2022-12-22 21:24:17 2022-12-23 01:09:10 1315 smithi main ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 7125685 2022-12-22 21:24:18 2022-12-23 00:39:26 2022-12-23 01:28:38 0:49:12 0:36:12 0:13:00 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 7125687 2022-12-22 21:24:31 2022-12-23 01:18:07 1863 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125689 2022-12-22 21:24:33 2022-12-23 00:41:28 2022-12-23 01:05:27 0:23:59 0:16:52 0:07:07 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} 2
pass 7125691 2022-12-22 21:24:34 2022-12-23 00:42:30 2022-12-23 01:24:28 0:41:58 0:34:49 0:07:09 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
pass 7125693 2022-12-22 21:24:50 2022-12-23 00:42:40 2022-12-23 01:35:22 0:52:42 0:42:18 0:10:24 smithi main ubuntu 20.04 orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 7125695 2022-12-22 21:24:59 2022-12-23 00:43:51 2022-12-23 01:07:30 0:23:39 0:15:55 0:07:44 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} 1
pass 7125696 2022-12-22 21:25:10 2022-12-23 00:43:52 2022-12-23 01:22:34 0:38:42 0:29:39 0:09:03 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125698 2022-12-22 21:25:21 2022-12-23 00:45:33 2022-12-23 01:05:54 0:20:21 0:12:30 0:07:51 smithi main rhel 8.4 orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} 2
pass 7125701 2022-12-22 21:25:30 2022-12-23 01:24:51 1457 smithi main ubuntu 20.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 7125703 2022-12-22 21:25:31 2022-12-23 00:53:21 2022-12-23 01:13:33 0:20:12 0:12:04 0:08:08 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} 2
dead 7125705 2022-12-22 21:25:33 2022-12-23 00:54:06 2022-12-23 01:26:04 0:31:58 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

fail 7125706 2022-12-22 21:25:34 2022-12-23 00:55:38 2022-12-23 01:09:51 0:14:13 0:07:25 0:06:48 smithi main ubuntu 18.04 orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} 1
Failure Reason:

Command failed on smithi102 with status 1: 'sudo kubeadm init --node-name smithi102 --token abcdef.dz3ckrzpj50xrttg --pod-network-cidr 10.251.40.0/21'

pass 7125707 2022-12-22 21:25:35 2022-12-23 00:56:38 2022-12-23 02:04:27 1:07:49 1:00:41 0:07:08 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 7125708 2022-12-22 21:25:48 2022-12-23 00:56:59 2022-12-23 01:17:14 0:20:15 0:13:01 0:07:14 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
dead 7125709 2022-12-22 21:25:49 2022-12-23 00:57:09 2022-12-23 01:09:13 0:12:04 0:04:02 0:08:02 smithi main orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} 2
Failure Reason:

{'smithi190.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.441469', 'end': '2022-12-23 01:07:20.348544', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:15.907075', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi176.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.278285', 'end': '2022-12-23 01:07:20.368907', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:16.090622', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}}

pass 7125710 2022-12-22 21:25:51 2022-12-23 00:57:20 2022-12-23 01:36:15 0:38:55 0:30:07 0:08:48 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125711 2022-12-22 21:25:53 2022-12-23 00:59:01 2022-12-23 01:24:11 0:25:10 0:17:44 0:07:26 smithi main centos 8.stream orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} 2
pass 7125712 2022-12-22 21:25:59 2022-12-23 00:59:01 2022-12-23 01:18:05 0:19:04 0:11:53 0:07:11 smithi main rhel 8.4 orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} 1
pass 7125713 2022-12-22 21:26:09 2022-12-23 00:59:02 2022-12-23 01:45:45 0:46:43 0:38:39 0:08:04 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
pass 7125714 2022-12-22 21:26:11 2022-12-23 01:00:35 2022-12-23 01:43:15 0:42:40 0:32:00 0:10:40 smithi main ubuntu 20.04 orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} 2
pass 7125715 2022-12-22 21:26:12 2022-12-23 01:01:17 2022-12-23 01:34:03 0:32:46 0:26:05 0:06:41 smithi main centos 8.stream orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 7125716 2022-12-22 21:26:24 2022-12-23 01:01:18 2022-12-23 01:20:48 0:19:30 0:12:18 0:07:12 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} 1
pass 7125717 2022-12-22 21:26:25 2022-12-23 01:01:48 2022-12-23 01:25:51 0:24:03 0:16:22 0:07:41 smithi main ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
pass 7125718 2022-12-22 21:26:27 2022-12-23 01:02:22 2022-12-23 01:44:36 0:42:14 0:33:53 0:08:21 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
fail 7125719 2022-12-22 21:26:28 2022-12-23 01:03:12 2022-12-23 01:26:02 0:22:50 0:15:28 0:07:22 smithi main ubuntu 18.04 orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi045 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d9407c0-825f-11ed-97ac-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''

fail 7125720 2022-12-22 21:26:30 2022-12-23 01:03:43 2022-12-23 01:22:14 0:18:31 0:11:43 0:06:48 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

Command failed (workunit test cephadm/test_cephadm.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

pass 7125721 2022-12-22 21:26:37 2022-12-23 01:03:43 2022-12-23 01:25:35 0:21:52 0:15:19 0:06:33 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} 2
pass 7125722 2022-12-22 21:26:43 2022-12-23 01:03:54 2022-12-23 01:34:20 0:30:26 0:19:48 0:10:38 smithi main ubuntu 20.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} 2
pass 7125723 2022-12-22 21:26:45 2022-12-23 01:03:54 2022-12-23 01:44:52 0:40:58 0:32:56 0:08:02 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125724 2022-12-22 21:26:47 2022-12-23 01:05:15 2022-12-23 01:53:25 0:48:10 0:36:11 0:11:59 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 7125725 2022-12-22 21:26:48 2022-12-23 01:05:35 2022-12-23 01:45:03 0:39:28 0:32:26 0:07:02 smithi main centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
pass 7125726 2022-12-22 21:27:05 2022-12-23 01:05:46 2022-12-23 01:29:20 0:23:34 0:17:05 0:06:29 smithi main centos 8.stream orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 7125727 2022-12-22 21:27:06 2022-12-23 01:05:56 2022-12-23 01:52:08 0:46:12 0:37:33 0:08:39 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 7125728 2022-12-22 21:27:23 2022-12-23 01:05:57 2022-12-23 01:48:40 0:42:43 0:35:07 0:07:36 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 7125729 2022-12-22 21:27:29 2022-12-23 01:07:17 2022-12-23 01:22:39 0:15:22 0:08:51 0:06:31 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} 1
pass 7125730 2022-12-22 21:27:32 2022-12-23 01:07:38 2022-12-23 01:28:54 0:21:16 0:15:20 0:05:56 smithi main rhel 8.4 orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} 2
pass 7125731 2022-12-22 21:27:34 2022-12-23 01:07:38 2022-12-23 01:36:15 0:28:37 0:18:13 0:10:24 smithi main ubuntu 20.04 orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
pass 7125732 2022-12-22 21:27:36 2022-12-23 01:08:08 2022-12-23 01:30:21 0:22:13 0:14:20 0:07:53 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
pass 7125733 2022-12-22 21:27:38 2022-12-23 01:08:49 2022-12-23 01:46:18 0:37:29 0:31:13 0:06:16 smithi main centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 7125734 2022-12-22 21:27:49 2022-12-23 01:08:59 2022-12-23 02:02:18 0:53:19 0:46:52 0:06:27 smithi main centos 8.stream orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} 2
pass 7125735 2022-12-22 21:27:54 2022-12-23 01:09:20 2022-12-23 01:42:50 0:33:30 0:27:18 0:06:12 smithi main centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} 1
pass 7125736 2022-12-22 21:27:55 2022-12-23 01:09:20 2022-12-23 03:21:53 2:12:33 2:05:30 0:07:03 smithi main ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 7125737 2022-12-22 21:27:57 2022-12-23 01:09:51 2022-12-23 01:38:31 0:28:40 0:21:48 0:06:52 smithi main ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
pass 7125738 2022-12-22 21:28:08 2022-12-23 01:09:51 2022-12-23 01:33:16 0:23:25 0:17:07 0:06:18 smithi main rhel 8.4 orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
pass 7125739 2022-12-22 21:28:12 2022-12-23 01:09:51 2022-12-23 02:12:44 1:02:53 0:54:52 0:08:01 smithi main centos 8.stream orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 7125740 2022-12-22 21:28:14 2022-12-23 01:10:02 2022-12-23 01:42:53 0:32:51 0:24:49 0:08:02 smithi main rhel 8.4 orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2