Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi183.front.sepia.ceph.com smithi True True 2022-12-19 14:28:42.155798 mchangir x86_64 /home/teuthworker/archive/mchangir-2022-12-19_13:50:26-fs:workload-mds-fix-scrubbing-assertion-failure-for-diri-distro-default-smithi/7121296
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 7121168 2022-12-18 05:37:10 2022-12-19 13:34:01 smithi main ubuntu 20.04 rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

Error reimaging machines: 403 Client Error: Forbidden for url: http://fog.front.sepia.ceph.com/fog/host

dead 7119913 2022-12-15 16:59:14 2022-12-15 17:59:47 2022-12-15 18:00:27 0:00:40 smithi main centos 8.stream rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} 1
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f9a20170d30>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119908 2022-12-15 16:58:10 2022-12-15 17:59:08 2022-12-15 17:59:47 0:00:39 smithi main rhel 8.4 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc878fcafa0>: Failed to establish a new connection: [Errno 113] No route to host'))

fail 7119865 2022-12-15 16:52:45 2022-12-15 17:37:43 2022-12-15 17:57:57 0:20:14 0:05:10 0:15:04 smithi main ubuntu 18.04 rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

Command failed on smithi088 with status 2: 'git archive --remote=https://git.ceph.com/ceph-ci.git 25247086556727088a4e5f94004449b27369ea05 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm'

dead 7119853 2022-12-15 16:51:01 2022-12-15 17:32:10 2022-12-15 17:35:55 0:03:45 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

Error reimaging machines: Failed to power on smithi183

fail 7119809 2022-12-15 16:47:31 2022-12-15 17:12:14 2022-12-15 17:31:34 0:19:20 0:08:16 0:11:04 smithi main rhel 8.4 rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

Command failed on smithi115 with status 2: 'git archive --remote=https://git.ceph.com/ceph-ci.git 25247086556727088a4e5f94004449b27369ea05 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm'

dead 7119406 2022-12-15 16:23:15 2022-12-15 18:44:26 2022-12-15 18:44:28 0:00:02 smithi main ubuntu 20.04 rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ffb59ff9610>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119397 2022-12-15 16:22:27 2022-12-15 18:44:23 2022-12-15 18:44:25 0:00:02 smithi main centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f53510d8af0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119388 2022-12-15 16:21:54 2022-12-15 18:44:18 2022-12-15 18:44:22 0:00:04 smithi main ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff29ca539d0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119374 2022-12-15 16:21:26 2022-12-15 18:44:13 2022-12-15 18:44:16 0:00:03 smithi main centos 8.stream rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f421d3e4700>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119367 2022-12-15 16:21:22 2022-12-15 18:44:11 2022-12-15 18:44:13 0:00:02 smithi main rhel 8.6 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f7ad39bdaf0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119353 2022-12-15 16:20:53 2022-12-15 18:44:06 2022-12-15 18:44:10 0:00:04 smithi main ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f49436ea8b0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119340 2022-12-15 16:19:53 2022-12-15 18:44:01 2022-12-15 18:44:04 0:00:03 smithi main ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3e19554940>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119324 2022-12-15 16:18:34 2022-12-15 18:43:54 2022-12-15 18:43:58 0:00:04 smithi main rhel 8.6 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2abc791a00>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119311 2022-12-15 16:18:01 2022-12-15 18:43:49 2022-12-15 18:43:51 0:00:02 smithi main centos 8.stream rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff7082d48e0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119299 2022-12-15 16:17:25 2022-12-15 18:43:45 2022-12-15 18:43:49 0:00:04 smithi main centos 8.stream rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb8148cc6d0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119270 2022-12-15 16:15:35 2022-12-15 18:43:35 2022-12-15 18:43:39 0:00:04 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd2ee1a2af0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119264 2022-12-15 16:15:03 2022-12-15 18:43:32 2022-12-15 18:43:33 0:00:01 smithi main ubuntu 20.04 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f844f29db20>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119254 2022-12-15 16:14:48 2022-12-15 18:43:28 2022-12-15 18:43:30 0:00:02 smithi main centos 8.stream rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f43d0124ac0>: Failed to establish a new connection: [Errno 113] No route to host'))

dead 7119241 2022-12-15 16:14:26 2022-12-15 18:43:23 2022-12-15 18:43:27 0:00:04 smithi main ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: HTTPConnectionPool(host='fog.front.sepia.ceph.com', port=80): Max retries exceeded with url: /fog/host (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7febdd8ff3a0>: Failed to establish a new connection: [Errno 113] No route to host'))