Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi125.front.sepia.ceph.com smithi True True 2020-10-24 20:07:39.596758 scheduled_jafaj@teuthology rhel 8.1 x86_64 /home/teuthworker/archive/jafaj-2020-10-23_06:21:43-rados-wip-jan-testing-2020-10-22-1610-distro-basic-smithi/5550315
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5554573 2020-10-24 10:42:13 2020-10-24 11:13:04 2020-10-24 11:43:03 0:29:59 0:22:43 0:07:16 smithi master centos 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

"2020-10-24T11:25:47.429298+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log

pass 5554511 2020-10-24 10:41:25 2020-10-24 10:44:21 2020-10-24 11:16:20 0:31:59 0:20:45 0:11:14 smithi master ubuntu 18.04 rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 5554380 2020-10-24 07:06:08 2020-10-24 09:36:12 2020-10-24 10:08:12 0:32:00 0:25:46 0:06:14 smithi master centos 8.1 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} 2
pass 5554348 2020-10-24 07:05:43 2020-10-24 09:22:11 2020-10-24 09:36:11 0:14:00 0:05:37 0:08:23 smithi master ubuntu 18.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 5554246 2020-10-24 07:04:22 2020-10-24 08:38:24 2020-10-24 09:14:24 0:36:00 0:10:05 0:25:55 smithi master centos 8.1 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
fail 5554215 2020-10-24 07:03:58 2020-10-24 08:22:08 2020-10-24 08:58:08 0:36:00 0:26:58 0:09:02 smithi master rhel 8.1 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27871caa7f053fdc338077e0bbc1e51521761205 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 5554046 2020-10-24 06:34:10 2020-10-24 19:39:18 2020-10-24 20:07:18 0:28:00 0:11:21 0:16:39 smithi master ubuntu 18.04 multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} 3
pass 5554007 2020-10-24 06:33:38 2020-10-24 19:04:08 2020-10-24 19:46:08 0:42:00 0:21:15 0:20:45 smithi master centos 8.1 multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} 3
pass 5553968 2020-10-24 06:33:07 2020-10-24 18:29:29 2020-10-24 19:15:29 0:46:00 0:15:14 0:30:46 smithi master ubuntu 18.04 multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} 3
pass 5553915 2020-10-24 06:32:26 2020-10-24 17:41:30 2020-10-24 18:01:30 0:20:00 0:12:34 0:07:26 smithi master rhel 8.1 multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} 3
pass 5553899 2020-10-24 06:32:13 2020-10-24 17:27:19 2020-10-24 18:51:20 1:24:01 0:41:11 0:42:50 smithi master centos 8.1 multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} 3
pass 5553883 2020-10-24 06:32:01 2020-10-24 17:12:49 2020-10-24 17:44:49 0:32:00 0:18:06 0:13:54 smithi master centos 8.1 multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} 3
pass 5553840 2020-10-24 06:31:28 2020-10-24 16:33:09 2020-10-24 17:21:09 0:48:00 0:35:45 0:12:15 smithi master centos 8.1 multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} 3
pass 5553793 2020-10-24 06:30:51 2020-10-24 15:55:39 2020-10-24 16:35:39 0:40:00 0:18:56 0:21:04 smithi master rhel 8.1 multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_mds_metrics} 3
pass 5553781 2020-10-24 06:30:41 2020-10-24 15:44:11 2020-10-24 16:08:11 0:24:00 0:17:06 0:06:54 smithi master rhel 8.1 multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} 3
pass 5553716 2020-10-24 06:29:40 2020-10-24 14:48:03 2020-10-24 15:46:03 0:58:00 0:40:53 0:17:07 smithi master ubuntu 18.04 kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} 3
pass 5553656 2020-10-24 06:28:53 2020-10-24 14:03:14 2020-10-24 14:55:15 0:52:01 0:40:04 0:11:57 smithi master ubuntu 18.04 kcephfs/mixed-clients/{begin clusters/1-mds-2-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 4
pass 5553475 2020-10-24 06:26:21 2020-10-24 12:09:51 2020-10-24 13:57:53 1:48:02 1:35:56 0:12:06 smithi master ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_kernel_untar_build} 2
pass 5553412 2020-10-24 06:25:28 2020-10-24 11:41:19 2020-10-24 12:13:19 0:32:00 0:20:38 0:11:22 smithi master ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_fsync} 2
pass 5553331 2020-10-24 06:24:24 2020-10-24 10:08:14 2020-10-24 10:46:14 0:38:00 0:30:49 0:07:11 smithi master centos 8.1 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/client-recovery} 2