Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi109.front.sepia.ceph.com smithi True True 2021-07-26 08:49:54.290443 vshankar centos 8 x86_64 /home/teuthworker/archive/vshankar-2021-07-26_08:39:20-fs-wip-kcephfs-new-mount-syntax-20210726-023839-distro-basic-smithi/6293345
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6293345 2021-07-26 08:39:36 2021-07-26 08:48:43 2021-07-26 09:16:56 0:28:13 0:17:00 0:11:13 smithi master centos 8.3 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}} 3
Failure Reason:

"2021-07-26T09:10:47.722914+0000 mon.a (mon.0) 162 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6293104 2021-07-26 06:42:29 2021-07-26 08:14:16 2021-07-26 08:49:47 0:35:31 0:25:19 0:10:12 smithi master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} 2
pass 6292830 2021-07-26 06:09:00 2021-07-26 06:28:59 2021-07-26 08:14:25 1:45:26 1:33:05 0:12:21 smithi master centos 8.2 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} 3
pass 6292752 2021-07-26 05:48:24 2021-07-26 05:48:57 2021-07-26 06:31:14 0:42:17 0:29:38 0:12:39 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} 3
pass 6292372 2021-07-25 15:39:21 2021-07-25 15:39:24 2021-07-25 16:14:30 0:35:06 0:24:05 0:11:01 smithi master centos 8.stream rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8.stream} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} 2
pass 6292330 2021-07-25 14:27:49 2021-07-25 14:28:40 2021-07-25 15:15:48 0:47:08 0:36:40 0:10:28 smithi master centos 8.stream rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} 2
pass 6291885 2021-07-25 06:52:59 2021-07-25 09:05:52 2021-07-25 11:51:34 2:45:42 2:39:10 0:06:32 smithi master rhel 8.4 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} 1
pass 6291816 2021-07-25 06:51:50 2021-07-25 08:28:36 2021-07-25 09:06:21 0:37:45 0:28:06 0:09:39 smithi master centos 8.stream rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8.stream} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 6291776 2021-07-25 06:51:10 2021-07-25 08:09:00 2021-07-25 08:28:48 0:19:48 0:09:44 0:10:04 smithi master centos 8.stream rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8.stream}} 1
pass 6291711 2021-07-25 06:50:05 2021-07-25 07:40:56 2021-07-25 08:09:51 0:28:55 0:19:05 0:09:50 smithi master centos 8.3 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6291653 2021-07-25 06:49:06 2021-07-25 07:13:25 2021-07-25 07:40:50 0:27:25 0:17:32 0:09:53 smithi master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6291580 2021-07-25 06:47:43 2021-07-25 06:48:35 2021-07-25 07:13:14 0:24:39 0:13:48 0:10:51 smithi master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} 2
pass 6291009 2021-07-25 03:33:08 2021-07-25 03:33:08 2021-07-25 06:44:58 3:11:50 2:54:55 0:16:55 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} 4
dead 6290741 2021-07-25 02:46:55 2021-07-25 03:07:55 2021-07-25 03:23:20 0:15:25 smithi master centos 8.3 rados/cephadm/smoke-roleless/{0-distro/centos_8.3_kubic_stable 1-start 2-services/nfs2 3-final} 2
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6290637 2021-07-25 02:45:16 2021-07-25 02:45:17 2021-07-25 03:07:56 0:22:39 0:08:28 0:14:11 smithi master centos 8.stream rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8.stream}} 1
Failure Reason:

Command failed on smithi109 with status 1: 'sudo yum -y install ceph-mgr-cephadm'

pass 6290584 2021-07-24 16:36:56 2021-07-24 21:14:46 2021-07-24 22:19:32 1:04:46 0:52:47 0:11:59 smithi master ubuntu 20.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} 2
pass 6290292 2021-07-24 16:30:33 2021-07-24 18:17:21 2021-07-24 21:14:55 2:57:34 2:26:06 0:31:28 smithi master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
pass 6290261 2021-07-24 16:29:48 2021-07-24 17:41:29 2021-07-24 18:17:03 0:35:34 0:24:44 0:10:50 smithi master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
pass 6290173 2021-07-24 16:13:31 2021-07-24 16:14:10 2021-07-24 17:42:05 1:27:55 1:12:08 0:15:47 smithi master ubuntu 20.04 upgrade/octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} 2
fail 6290150 2021-07-24 14:23:47 2021-07-24 15:06:17 2021-07-24 15:27:54 0:21:37 0:09:40 0:11:57 smithi master ubuntu 18.04 upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} 5
Failure Reason:

Command failed on smithi018 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.5-94-g8e0e9efa-1bionic cephadm=16.2.5-94-g8e0e9efa-1bionic ceph-mds=16.2.5-94-g8e0e9efa-1bionic ceph-mgr=16.2.5-94-g8e0e9efa-1bionic ceph-common=16.2.5-94-g8e0e9efa-1bionic ceph-fuse=16.2.5-94-g8e0e9efa-1bionic ceph-test=16.2.5-94-g8e0e9efa-1bionic radosgw=16.2.5-94-g8e0e9efa-1bionic python3-rados=16.2.5-94-g8e0e9efa-1bionic python3-rgw=16.2.5-94-g8e0e9efa-1bionic python3-cephfs=16.2.5-94-g8e0e9efa-1bionic python3-rbd=16.2.5-94-g8e0e9efa-1bionic libcephfs2=16.2.5-94-g8e0e9efa-1bionic libcephfs-dev=16.2.5-94-g8e0e9efa-1bionic librados2=16.2.5-94-g8e0e9efa-1bionic librbd1=16.2.5-94-g8e0e9efa-1bionic rbd-fuse=16.2.5-94-g8e0e9efa-1bionic'