Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 6755674 2022-03-23 14:04:11 2022-03-24 07:42:03 2022-03-24 14:21:37 6:39:34 smithi master centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 6755676 2022-03-23 14:04:12 2022-03-24 07:42:04 2022-03-24 08:05:23 0:23:19 0:14:21 0:08:58 smithi master centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
pass 6755678 2022-03-23 14:04:13 2022-03-24 07:42:15 2022-03-24 08:27:43 0:45:28 0:36:05 0:09:23 smithi master ubuntu 18.04 orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6755681 2022-03-23 14:04:14 2022-03-24 07:43:06 2022-03-24 08:40:45 0:57:39 0:48:33 0:09:06 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 6755682 2022-03-23 14:04:15 2022-03-24 07:43:16 2022-03-24 08:10:16 0:27:00 0:16:11 0:10:49 smithi master ubuntu 18.04 orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
pass 6755685 2022-03-23 14:04:16 2022-03-24 07:44:28 2022-03-24 08:13:55 0:29:27 0:19:53 0:09:34 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
pass 6755687 2022-03-23 14:04:17 2022-03-24 08:08:31 871 smithi master centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
fail 6755689 2022-03-23 14:04:18 2022-03-24 07:45:29 2022-03-24 08:07:05 0:21:36 0:10:52 0:10:44 smithi master centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi105 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bd0f3b52-ab48-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi105:vg_nvme/lv_4'

dead 6755691 2022-03-23 14:04:19 2022-03-24 07:46:00 2022-03-24 14:26:38 6:40:38 smithi master centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 6755693 2022-03-23 14:04:20 2022-03-24 07:46:41 2022-03-24 09:55:33 2:08:52 1:58:55 0:09:57 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 6755695 2022-03-23 14:04:21 2022-03-24 07:48:22 2022-03-24 08:23:31 0:35:09 0:26:40 0:08:29 smithi master centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6755697 2022-03-23 14:04:22 2022-03-24 07:52:43 2022-03-24 08:31:18 0:38:35 0:27:52 0:10:43 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 6755699 2022-03-23 14:04:23 2022-03-24 07:54:24 2022-03-24 08:24:56 0:30:32 0:17:18 0:13:14 smithi master ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
fail 6755701 2022-03-23 14:04:24 2022-03-24 07:59:00 2022-03-24 08:15:06 0:16:06 0:05:32 0:10:34 smithi master ubuntu 20.04 orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} 1
Failure Reason:

[Errno 2] Cannot find file on the remote 'ubuntu@smithi025.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml'

pass 6755703 2022-03-23 14:04:25 2022-03-24 07:59:31 2022-03-24 08:25:01 0:25:30 0:16:17 0:09:13 smithi master ubuntu 18.04 orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
pass 6755705 2022-03-23 14:04:26 2022-03-24 07:59:42 2022-03-24 08:53:41 0:53:59 0:43:24 0:10:35 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
dead 6755707 2022-03-23 14:04:27 2022-03-24 08:03:43 2022-03-24 14:43:19 6:39:36 smithi master centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 6755709 2022-03-23 14:04:27 2022-03-24 08:04:14 2022-03-24 08:43:32 0:39:18 0:26:59 0:12:19 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
fail 6755711 2022-03-23 14:04:28 2022-03-24 08:06:05 2022-03-24 08:29:28 0:23:23 0:14:34 0:08:49 smithi master centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} 1
Failure Reason:

SELinux denials found on ubuntu@smithi084.front.sepia.ceph.com: ['type=AVC msg=audit(1648110447.842:7438): avc: denied { ioctl } for pid=53623 comm="iptables" path="/var/lib/containers/storage/overlay/bc1faafb46711b1ceabfaa70297d5b58fbeff228be42fbec0d08362a1fabbd23/merged" dev="overlay" ino=3410216 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']

pass 6755713 2022-03-23 14:04:29 2022-03-24 08:06:36 2022-03-24 08:47:58 0:41:22 0:30:26 0:10:56 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} 3
pass 6755715 2022-03-23 14:04:30 2022-03-24 08:08:57 2022-03-24 09:49:21 1:40:24 1:30:26 0:09:58 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
dead 6755717 2022-03-23 14:04:31 2022-03-24 08:09:27 2022-03-24 08:30:15 0:20:48 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} 3
Failure Reason:

SSH connection to smithi039 was lost: 'uname -r'

pass 6755719 2022-03-23 14:04:32 2022-03-24 08:12:08 2022-03-24 09:09:39 0:57:31 0:46:21 0:11:10 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} 3
pass 6755721 2022-03-23 14:04:33 2022-03-24 08:13:59 2022-03-24 08:51:41 0:37:42 0:26:25 0:11:17 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} 3
fail 6755723 2022-03-23 14:04:34 2022-03-24 08:16:10 2022-03-24 08:42:39 0:26:29 0:13:29 0:13:00 smithi master ubuntu 18.04 orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi109 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:133ced88c1cfbaa04af35ef1668bdf3506aa4dca shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0c685b2-ab4c-11ec-8c35-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''

pass 6755725 2022-03-23 14:04:35 2022-03-24 08:23:32 2022-03-24 08:46:01 0:22:29 0:15:04 0:07:25 smithi master centos 8.stream orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
pass 6755727 2022-03-23 14:04:36 2022-03-24 08:25:03 2022-03-24 09:08:08 0:43:05 0:31:20 0:11:45 smithi master centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
dead 6755729 2022-03-23 14:04:37 2022-03-24 08:27:54 2022-03-24 15:09:24 6:41:30 smithi master centos 8.stream orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

hit max job timeout

pass 6755731 2022-03-23 14:04:38 2022-03-24 08:30:15 2022-03-24 09:07:13 0:36:58 0:27:20 0:09:38 smithi master centos 8.stream orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6755733 2022-03-23 14:04:39 2022-03-24 08:30:25 2022-03-24 10:24:24 1:53:59 1:43:56 0:10:03 smithi master ubuntu 18.04 orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} 3
pass 6755735 2022-03-23 14:04:40 2022-03-24 08:31:26 2022-03-24 08:59:08 0:27:42 0:17:11 0:10:31 smithi master ubuntu 18.04 orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2