Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi138.front.sepia.ceph.com smithi True True 2021-01-16 16:53:46.587407 scheduled_jafaj@teuthology rhel 8.3 x86_64 /home/teuthworker/archive/jafaj-2021-01-12_18:34:36-rados-wip-jan-testing-2021-01-12-1728-distro-basic-smithi/5780388
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 5791757 2021-01-16 07:07:49 2021-01-16 12:53:40 2021-01-16 13:15:40 0:22:00 0:12:23 0:09:37 smithi master centos 8.2 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} 2
pass 5791668 2021-01-16 07:06:40 2021-01-16 12:06:58 2021-01-16 12:52:58 0:46:00 0:35:23 0:10:37 smithi master centos 8.2 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
pass 5791637 2021-01-16 07:06:16 2021-01-16 11:46:29 2021-01-16 12:08:29 0:22:00 0:14:50 0:07:10 smithi master rhel 8.0 rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} 2
pass 5791582 2021-01-16 07:05:33 2021-01-16 11:20:57 2021-01-16 11:36:56 0:15:59 0:06:44 0:09:15 smithi master ubuntu 18.04 rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
pass 5791506 2021-01-16 07:04:32 2021-01-16 10:42:54 2021-01-16 11:20:54 0:38:00 0:28:47 0:09:13 smithi master centos 8.2 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5791438 2021-01-16 07:03:37 2021-01-16 10:06:15 2021-01-16 10:44:15 0:38:00 0:26:00 0:12:00 smithi master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
pass 5790742 2021-01-16 05:01:15 2021-01-16 08:31:53 2021-01-16 10:11:55 1:40:02 1:31:58 0:08:04 smithi master rhel 8.3 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_suites_dbench}} 3
pass 5790653 2021-01-16 04:00:45 2021-01-16 07:59:04 2021-01-16 08:35:04 0:36:00 0:22:12 0:13:48 smithi master centos 8.2 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
fail 5790567 2021-01-16 03:59:34 2021-01-16 06:55:29 2021-01-16 08:03:29 1:08:00 0:54:37 0:13:23 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} 3
Failure Reason:

"2021-01-16T07:26:35.366143+0000 mds.c (mds.0) 104 : cluster [WRN] Scrub error on inode 0x100000001f8 (/client.0/tmp/iogen_3.1p0/src) see mds.c log and `damage ls` output for details" in cluster log

pass 5790545 2021-01-16 03:59:17 2021-01-16 06:43:01 2021-01-16 07:03:01 0:20:00 0:09:52 0:10:08 smithi master ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 5790515 2021-01-16 03:58:53 2021-01-16 06:23:00 2021-01-16 06:43:00 0:20:00 0:09:13 0:10:47 smithi master ubuntu 18.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} 2
pass 5790223 2021-01-16 01:12:40 2021-01-16 05:52:35 2021-01-16 06:22:35 0:30:00 0:20:16 0:09:44 smithi master centos 8.2 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 2
fail 5790069 2021-01-16 01:10:35 2021-01-16 04:29:47 2021-01-16 05:53:48 1:24:01 1:13:15 0:10:46 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} 2
Failure Reason:

wait_for_recovery: failed before timeout expired

pass 5790018 2021-01-16 01:09:54 2021-01-16 04:01:39 2021-01-16 04:31:39 0:30:00 0:15:59 0:14:01 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect_set_object} 2
pass 5789977 2021-01-16 01:09:22 2021-01-16 03:24:02 2021-01-16 04:06:03 0:42:01 0:33:40 0:08:21 smithi master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
pass 5789916 2021-01-16 01:08:34 2021-01-16 02:47:39 2021-01-16 03:25:39 0:38:00 0:12:14 0:25:46 smithi master centos 8.2 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} 1
pass 5789909 2021-01-16 01:08:28 2021-01-16 02:47:38 2021-01-16 03:05:37 0:17:59 0:09:40 0:08:19 smithi master centos 8.2 rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 5789855 2021-01-15 22:37:28 2021-01-16 00:37:24 2021-01-16 01:03:24 0:26:00 0:13:27 0:12:33 smithi master centos 8.2 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} 2
pass 5789829 2021-01-15 22:37:08 2021-01-16 00:15:40 2021-01-16 00:39:40 0:24:00 0:15:57 0:08:03 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
pass 5789737 2021-01-15 22:35:55 2021-01-15 23:06:31 2021-01-16 00:18:31 1:12:00 1:00:58 0:11:02 smithi master centos 8.2 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2