Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6027858 2021-04-08 04:31:56 2021-04-08 04:33:07 2021-04-08 05:03:06 0:29:59 0:20:05 0:09:54 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 6027859 2021-04-08 04:31:57 2021-04-08 04:33:08 2021-04-08 05:46:58 1:13:50 1:06:51 0:06:59 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
pass 6027860 2021-04-08 04:31:57 2021-04-08 04:33:08 2021-04-08 04:58:49 0:25:41 0:14:34 0:11:07 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} 2
pass 6027861 2021-04-08 04:31:58 2021-04-08 04:33:09 2021-04-08 05:20:57 0:47:48 0:36:49 0:10:59 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
pass 6027862 2021-04-08 04:31:59 2021-04-08 04:33:09 2021-04-08 05:11:46 0:38:37 0:26:34 0:12:03 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
fail 6027863 2021-04-08 04:32:00 2021-04-08 04:33:10 2021-04-08 04:56:36 0:23:26 0:14:07 0:09:19 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
Failure Reason:

"2021-04-08T04:51:15.893852+0000 mds.d (mds.4269) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027864 2021-04-08 04:32:01 2021-04-08 04:33:10 2021-04-08 05:04:56 0:31:46 0:21:55 0:09:51 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment} 2
pass 6027865 2021-04-08 04:32:01 2021-04-08 04:33:11 2021-04-08 05:10:55 0:37:44 0:24:39 0:13:05 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
fail 6027866 2021-04-08 04:32:02 2021-04-08 04:33:11 2021-04-08 05:10:07 0:36:56 0:23:06 0:13:50 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
Failure Reason:

"2021-04-08T05:01:49.347691+0000 mds.a (mds.4273) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027867 2021-04-08 04:32:03 2021-04-08 04:33:14 2021-04-08 05:19:06 0:45:52 0:34:48 0:11:04 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
pass 6027868 2021-04-08 04:32:04 2021-04-08 04:33:14 2021-04-08 05:14:57 0:41:43 0:29:55 0:11:48 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}} 2
pass 6027869 2021-04-08 04:32:04 2021-04-08 04:33:15 2021-04-08 05:16:57 0:43:42 0:25:23 0:18:19 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} 2
fail 6027870 2021-04-08 04:32:05 2021-04-08 04:33:15 2021-04-08 05:16:22 0:43:07 0:28:22 0:14:45 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
Failure Reason:

"2021-04-08T05:03:35.225387+0000 mds.e (mds.4306) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027871 2021-04-08 04:32:06 2021-04-08 04:33:16 2021-04-08 05:01:24 0:28:08 0:18:33 0:09:35 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
fail 6027872 2021-04-08 04:32:06 2021-04-08 04:33:16 2021-04-08 05:13:38 0:40:22 0:27:07 0:13:15 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
Failure Reason:

"2021-04-08T05:05:06.812447+0000 mds.e (mds.4294) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027873 2021-04-08 04:32:07 2021-04-08 04:33:17 2021-04-08 05:13:02 0:39:45 0:24:09 0:15:36 smithi master ubuntu 20.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 6027874 2021-04-08 04:32:08 2021-04-08 04:33:17 2021-04-08 04:54:27 0:21:10 0:10:37 0:10:33 smithi master fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137} 1
pass 6027875 2021-04-08 04:32:09 2021-04-08 04:33:18 2021-04-08 05:44:59 1:11:41 0:57:25 0:14:16 smithi master centos 8.3 fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} 2
pass 6027876 2021-04-08 04:32:09 2021-04-08 04:33:18 2021-04-08 05:07:40 0:34:22 0:21:49 0:12:33 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} 2
pass 6027877 2021-04-08 04:32:10 2021-04-08 04:33:19 2021-04-08 04:59:43 0:26:24 0:16:00 0:10:24 smithi master rhel 8.3 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client} 2
pass 6027878 2021-04-08 04:32:11 2021-04-08 04:33:19 2021-04-08 05:59:06 1:25:47 1:12:44 0:13:03 smithi master ubuntu 20.04 fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} 1
pass 6027879 2021-04-08 04:32:12 2021-04-08 04:33:20 2021-04-08 05:12:56 0:39:36 0:33:13 0:06:23 smithi master rhel 8.3 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 6027880 2021-04-08 04:32:12 2021-04-08 04:33:20 2021-04-08 05:17:22 0:44:02 0:27:42 0:16:20 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} 5
fail 6027881 2021-04-08 04:32:13 2021-04-08 04:33:21 2021-04-08 05:07:37 0:34:16 0:20:03 0:14:13 smithi master ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} 2
Failure Reason:

Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

pass 6027882 2021-04-08 04:32:14 2021-04-08 04:33:21 2021-04-08 04:57:45 0:24:24 0:16:35 0:07:49 smithi master rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
pass 6027883 2021-04-08 04:32:14 2021-04-08 04:33:22 2021-04-08 05:19:16 0:45:54 0:35:30 0:10:24 smithi master ubuntu 18.04 fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell} 2
pass 6027884 2021-04-08 04:32:15 2021-04-08 04:33:22 2021-04-08 06:27:45 1:54:23 1:42:34 0:11:49 smithi master centos 8.3 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 6027885 2021-04-08 04:32:16 2021-04-08 04:33:23 2021-04-08 06:49:48 2:16:25 2:04:30 0:11:55 smithi master ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} 2
pass 6027886 2021-04-08 04:32:17 2021-04-08 04:33:23 2021-04-08 04:53:02 0:19:39 0:09:30 0:10:09 smithi master centos 8.3 fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{centos_8} tasks/fstop} 1
pass 6027887 2021-04-08 04:32:17 2021-04-08 04:33:23 2021-04-08 05:35:46 1:02:23 0:51:32 0:10:51 smithi master centos 8.3 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
pass 6027888 2021-04-08 04:32:18 2021-04-08 04:33:24 2021-04-08 05:27:39 0:54:15 0:40:08 0:14:07 smithi master fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
pass 6027889 2021-04-08 04:32:19 2021-04-08 04:33:24 2021-04-08 06:13:42 1:40:18 1:27:19 0:12:59 smithi master centos 8.3 fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} 1
pass 6027890 2021-04-08 04:32:19 2021-04-08 04:33:25 2021-04-08 07:36:01 3:02:36 2:51:23 0:11:13 smithi master centos 8.3 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/valgrind} 2
pass 6027891 2021-04-08 04:32:20 2021-04-08 04:33:25 2021-04-08 05:22:57 0:49:32 0:37:35 0:11:57 smithi master centos 8.3 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} 2
pass 6027892 2021-04-08 04:32:21 2021-04-08 04:33:26 2021-04-08 05:10:55 0:37:29 0:24:05 0:13:24 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
fail 6027893 2021-04-08 04:32:21 2021-04-08 04:33:26 2021-04-08 07:46:02 3:12:36 2:55:33 0:17:03 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
Failure Reason:

"2021-04-08T05:06:40.961794+0000 mds.d (mds.4302) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

fail 6027894 2021-04-08 04:32:22 2021-04-08 04:33:27 2021-04-08 06:42:54 2:09:27 1:55:30 0:13:57 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9ff5aa9ab67a69334226e0146d5a4abfed082420 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 6027895 2021-04-08 04:32:23 2021-04-08 04:33:27 2021-04-08 05:04:03 0:30:36 0:20:41 0:09:55 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
Failure Reason:

"2021-04-08T04:56:44.331822+0000 mds.d (mds.4293) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027896 2021-04-08 04:32:24 2021-04-08 04:33:28 2021-04-08 05:13:26 0:39:58 0:28:27 0:11:31 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
pass 6027897 2021-04-08 04:32:24 2021-04-08 04:33:28 2021-04-08 05:17:46 0:44:18 0:31:29 0:12:49 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} 2
pass 6027898 2021-04-08 04:32:25 2021-04-08 04:33:29 2021-04-08 05:19:20 0:45:51 0:31:17 0:14:34 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
pass 6027899 2021-04-08 04:32:26 2021-04-08 04:33:29 2021-04-08 05:16:57 0:43:28 0:34:44 0:08:44 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} 2
fail 6027900 2021-04-08 04:32:27 2021-04-08 04:33:30 2021-04-08 05:42:59 1:09:29 0:56:45 0:12:44 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
Failure Reason:

"2021-04-08T05:05:33.287759+0000 mds.b (mds.4279) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027901 2021-04-08 04:32:27 2021-04-08 04:33:30 2021-04-08 04:58:06 0:24:36 0:15:09 0:09:27 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} 2
fail 6027902 2021-04-08 04:32:28 2021-04-08 04:33:31 2021-04-08 05:12:08 0:38:37 0:22:44 0:15:53 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
Failure Reason:

"2021-04-08T05:04:31.504201+0000 mds.a (mds.4294) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027903 2021-04-08 04:32:29 2021-04-08 04:33:31 2021-04-08 05:02:55 0:29:24 0:18:25 0:10:59 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2
pass 6027904 2021-04-08 04:32:29 2021-04-08 04:33:32 2021-04-08 05:00:42 0:27:10 0:18:32 0:08:38 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
pass 6027905 2021-04-08 04:32:30 2021-04-08 04:33:33 2021-04-08 05:15:00 0:41:27 0:26:49 0:14:38 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics} 2
pass 6027906 2021-04-08 04:32:31 2021-04-08 04:33:33 2021-04-08 05:08:56 0:35:23 0:22:05 0:13:18 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} 2
fail 6027907 2021-04-08 04:32:31 2021-04-08 04:33:34 2021-04-08 05:10:56 0:37:22 0:23:21 0:14:01 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
Failure Reason:

"2021-04-08T05:02:36.526982+0000 mds.b (mds.4307) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027908 2021-04-08 04:32:32 2021-04-08 04:33:34 2021-04-08 05:10:58 0:37:24 0:24:07 0:13:17 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} 2
fail 6027909 2021-04-08 04:32:33 2021-04-08 04:33:35 2021-04-08 04:59:24 0:25:49 0:16:25 0:09:24 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
Failure Reason:

"2021-04-08T04:52:24.838778+0000 mds.b (mds.4276) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027910 2021-04-08 04:32:34 2021-04-08 04:33:35 2021-04-08 05:13:19 0:39:44 0:27:12 0:12:32 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc} 2
pass 6027911 2021-04-08 04:32:34 2021-04-08 04:33:36 2021-04-08 05:13:15 0:39:39 0:26:19 0:13:20 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
pass 6027912 2021-04-08 04:32:35 2021-04-08 04:33:36 2021-04-08 05:04:55 0:31:19 0:22:08 0:09:11 smithi master rhel 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} 2
fail 6027913 2021-04-08 04:32:36 2021-04-08 04:33:37 2021-04-08 05:14:56 0:41:19 0:31:41 0:09:38 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
Failure Reason:

"2021-04-08T05:01:05.757658+0000 mds.a (mds.4287) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027914 2021-04-08 04:32:37 2021-04-08 04:33:37 2021-04-08 04:59:38 0:26:01 0:17:28 0:08:33 smithi master rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6027915 2021-04-08 04:32:37 2021-04-08 04:33:38 2021-04-08 05:07:39 0:34:01 0:21:33 0:12:28 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable} 2
pass 6027916 2021-04-08 04:32:38 2021-04-08 04:33:38 2021-04-08 05:10:07 0:36:29 0:23:47 0:12:42 smithi master ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 6027917 2021-04-08 04:32:39 2021-04-08 04:33:39 2021-04-08 10:26:42 5:53:03 5:43:50 0:09:13 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

"2021-04-08T06:08:58.719422+0000 mds.b (mds.2) 1 : cluster [WRN] client.4812 isn't responding to mclientcaps(revoke), ino 0x30000000dda pending pAsLsXsFscr issued pAsLsXsFsxcrwb, sent 300.004522 seconds ago" in cluster log

fail 6027918 2021-04-08 04:32:40 2021-04-08 04:33:39 2021-04-08 05:11:02 0:37:23 0:21:36 0:15:47 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 6027919 2021-04-08 04:32:40 2021-04-08 04:33:40 2021-04-08 05:26:35 0:52:55 0:42:44 0:10:11 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} 2
pass 6027920 2021-04-08 04:32:41 2021-04-08 04:33:40 2021-04-08 05:11:12 0:37:32 0:24:55 0:12:37 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
pass 6027921 2021-04-08 04:32:42 2021-04-08 04:33:41 2021-04-08 05:00:31 0:26:50 0:16:36 0:10:14 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} 2
fail 6027922 2021-04-08 04:32:43 2021-04-08 04:33:41 2021-04-08 05:16:55 0:43:14 0:16:12 0:27:02 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
Failure Reason:

"2021-04-08T05:09:50.277415+0000 mds.a (mds.4296) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027923 2021-04-08 04:32:44 2021-04-08 04:53:08 2021-04-08 05:29:39 0:36:31 0:23:10 0:13:21 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
pass 6027924 2021-04-08 04:32:44 2021-04-08 04:56:39 2021-04-08 06:33:46 1:37:07 1:25:30 0:11:37 smithi master centos 8.3 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 6027925 2021-04-08 04:32:45 2021-04-08 04:56:40 2021-04-08 05:19:40 0:23:00 0:09:31 0:13:29 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} 4
fail 6027926 2021-04-08 04:32:46 2021-04-08 04:58:15 2021-04-08 05:20:49 0:22:34 0:11:42 0:10:52 smithi master ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} 2
Failure Reason:

Test failure: test_join_fs_standby_replay (tasks.cephfs.test_failover.TestClusterAffinity)

pass 6027927 2021-04-08 04:32:47 2021-04-08 04:58:55 2021-04-08 05:28:50 0:29:55 0:18:20 0:11:35 smithi master fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 6027928 2021-04-08 04:32:47 2021-04-08 04:59:26 2021-04-08 06:13:32 1:14:06 1:01:56 0:12:10 smithi master ubuntu 20.04 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/lockdep} 2
fail 6027929 2021-04-08 04:32:48 2021-04-08 04:59:46 2021-04-08 05:23:38 0:23:52 0:16:45 0:07:07 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
Failure Reason:

"2021-04-08T05:16:44.080000+0000 mds.c (mds.4307) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027930 2021-04-08 04:32:49 2021-04-08 05:00:37 2021-04-08 05:22:35 0:21:58 0:12:19 0:09:39 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
pass 6027931 2021-04-08 04:32:49 2021-04-08 05:00:47 2021-04-08 05:25:39 0:24:52 0:12:41 0:12:11 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota} 2
pass 6027932 2021-04-08 04:32:50 2021-04-08 05:00:48 2021-04-08 06:06:52 1:06:04 0:53:02 0:13:02 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
pass 6027933 2021-04-08 04:32:51 2021-04-08 05:03:05 2021-04-08 06:04:51 1:01:46 0:55:36 0:06:10 smithi master rhel 8.3 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 6027934 2021-04-08 04:32:52 2021-04-08 05:03:16 2021-04-08 06:22:53 1:19:37 1:09:01 0:10:36 smithi master centos 8.3 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
pass 6027935 2021-04-08 04:32:52 2021-04-08 05:03:16 2021-04-08 05:27:03 0:23:47 0:17:12 0:06:35 smithi master rhel 8.3 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}} 2
pass 6027936 2021-04-08 04:32:54 2021-04-08 05:04:07 2021-04-08 05:32:36 0:28:29 0:21:53 0:06:36 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
fail 6027937 2021-04-08 04:32:54 2021-04-08 05:04:58 2021-04-08 05:52:58 0:48:00 0:38:32 0:09:28 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
Failure Reason:

"2021-04-08T05:23:21.492013+0000 mds.f (mds.4319) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027938 2021-04-08 04:32:55 2021-04-08 05:04:59 2021-04-08 05:39:19 0:34:20 0:21:44 0:12:36 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub} 2
fail 6027939 2021-04-08 04:32:56 2021-04-08 05:07:47 2021-04-08 05:32:45 0:24:58 0:13:46 0:11:12 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
Failure Reason:

"2021-04-08T05:24:53.972931+0000 mds.d (mds.4299) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027940 2021-04-08 04:32:57 2021-04-08 05:07:47 2021-04-08 05:30:36 0:22:49 0:14:52 0:07:57 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
pass 6027941 2021-04-08 04:32:57 2021-04-08 05:08:57 2021-04-08 06:19:36 1:10:39 1:02:41 0:07:58 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
pass 6027942 2021-04-08 04:32:58 2021-04-08 05:10:08 2021-04-08 05:38:56 0:28:48 0:16:51 0:11:57 smithi master centos 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} 2
pass 6027943 2021-04-08 04:32:59 2021-04-08 05:10:09 2021-04-08 05:33:55 0:23:46 0:16:30 0:07:16 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} 2
fail 6027944 2021-04-08 04:33:00 2021-04-08 05:11:00 2021-04-08 06:19:30 1:08:30 0:57:32 0:10:58 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
Failure Reason:

"2021-04-08T05:30:56.344894+0000 mds.c (mds.4298) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027945 2021-04-08 04:33:00 2021-04-08 05:11:01 2021-04-08 07:10:57 1:59:56 1:50:16 0:09:40 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
fail 6027946 2021-04-08 04:33:01 2021-04-08 05:11:01 2021-04-08 05:34:35 0:23:34 0:14:56 0:08:38 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
Failure Reason:

"2021-04-08T05:28:09.257324+0000 mds.d (mds.4257) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027947 2021-04-08 04:33:02 2021-04-08 05:11:02 2021-04-08 05:34:37 0:23:35 0:17:32 0:06:03 smithi master rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 6027948 2021-04-08 04:33:03 2021-04-08 05:11:13 2021-04-08 05:36:37 0:25:24 0:19:11 0:06:13 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} 2
pass 6027949 2021-04-08 04:33:03 2021-04-08 05:11:13 2021-04-08 05:30:35 0:19:22 0:12:09 0:07:13 smithi master rhel 8.3 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb} 2
pass 6027950 2021-04-08 04:33:04 2021-04-08 05:11:14 2021-04-08 05:34:45 0:23:31 0:15:48 0:07:43 smithi master rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
pass 6027951 2021-04-08 04:33:05 2021-04-08 05:11:54 2021-04-08 05:41:49 0:29:55 0:17:38 0:12:17 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
pass 6027952 2021-04-08 04:33:06 2021-04-08 05:12:15 2021-04-08 05:48:36 0:36:21 0:26:36 0:09:45 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
fail 6027953 2021-04-08 04:33:06 2021-04-08 05:13:05 2021-04-08 05:44:01 0:30:56 0:23:34 0:07:22 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
Failure Reason:

"2021-04-08T05:29:49.195529+0000 mds.a (mds.4293) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027954 2021-04-08 04:33:07 2021-04-08 05:13:06 2021-04-08 05:46:12 0:33:06 0:23:02 0:10:04 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
fail 6027955 2021-04-08 04:33:08 2021-04-08 05:13:16 2021-04-08 05:40:47 0:27:31 0:16:27 0:11:04 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
Failure Reason:

"2021-04-08T05:32:56.951051+0000 mds.b (mds.4288) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027956 2021-04-08 04:33:09 2021-04-08 05:13:27 2021-04-08 05:48:40 0:35:13 0:23:00 0:12:13 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots} 2
pass 6027957 2021-04-08 04:33:10 2021-04-08 05:13:27 2021-04-08 05:32:35 0:19:08 0:13:45 0:05:23 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
pass 6027958 2021-04-08 04:33:10 2021-04-08 05:13:48 2021-04-08 05:46:11 0:32:23 0:22:37 0:09:46 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
fail 6027959 2021-04-08 04:33:11 2021-04-08 05:14:59 2021-04-08 06:28:52 1:13:53 1:06:40 0:07:13 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
Failure Reason:

"2021-04-08T05:32:33.633699+0000 mds.a (mds.4293) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027960 2021-04-08 04:33:14 2021-04-08 05:14:59 2021-04-08 05:51:25 0:36:26 0:25:24 0:11:02 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays} 2
pass 6027961 2021-04-08 04:33:14 2021-04-08 05:15:10 2021-04-08 05:48:02 0:32:52 0:19:49 0:13:03 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}} 2
fail 6027962 2021-04-08 04:33:15 2021-04-08 05:16:32 2021-04-08 05:40:02 0:23:30 0:17:11 0:06:19 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
Failure Reason:

"2021-04-08T05:33:34.297409+0000 mds.b (mds.4315) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6027963 2021-04-08 04:33:16 2021-04-08 05:17:03 2021-04-08 05:43:12 0:26:09 0:14:30 0:11:39 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
pass 6027964 2021-04-08 04:33:17 2021-04-08 05:17:03 2021-04-08 05:42:01 0:24:58 0:14:39 0:10:19 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
fail 6027965 2021-04-08 04:33:18 2021-04-08 05:17:04 2021-04-08 05:36:51 0:19:47 0:08:58 0:10:49 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration} 2
Failure Reason:

Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration)

pass 6027966 2021-04-08 04:33:19 2021-04-08 05:17:26 2021-04-08 06:11:20 0:53:54 0:43:13 0:10:41 smithi master ubuntu 20.04 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 6027967 2021-04-08 04:33:19 2021-04-08 05:17:26 2021-04-08 05:52:48 0:35:22 0:19:37 0:15:45 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} 5
pass 6027968 2021-04-08 04:33:20 2021-04-08 05:19:08 2021-04-08 05:48:16 0:29:08 0:21:41 0:07:27 smithi master rhel 8.3 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} 2
pass 6027969 2021-04-08 04:33:21 2021-04-08 05:19:19 2021-04-08 05:43:15 0:23:56 0:12:49 0:11:07 smithi master ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} 2
pass 6027970 2021-04-08 04:33:22 2021-04-08 05:19:29 2021-04-08 05:49:19 0:29:50 0:19:15 0:10:35 smithi master fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} 3
pass 6027971 2021-04-08 04:33:22 2021-04-08 05:19:50 2021-04-08 07:03:56 1:44:06 1:34:51 0:09:15 smithi master ubuntu 20.04 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/valgrind} 2
fail 6027972 2021-04-08 04:33:23 2021-04-08 05:19:51 2021-04-08 05:47:07 0:27:16 0:14:46 0:12:30 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
Failure Reason:

"2021-04-08T05:40:25.728020+0000 mds.a (mds.4248) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

fail 6027973 2021-04-08 04:33:24 2021-04-08 05:20:55 2021-04-08 05:43:59 0:23:04 0:16:56 0:06:08 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
Failure Reason:

"2021-04-08T05:37:32.840376+0000 mds.c (mds.4301) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027974 2021-04-08 04:33:25 2021-04-08 05:21:05 2021-04-08 08:41:40 3:20:35 3:12:02 0:08:33 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
pass 6027975 2021-04-08 04:33:26 2021-04-08 05:22:36 2021-04-08 05:44:36 0:22:00 0:13:45 0:08:15 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay} 2
pass 6027976 2021-04-08 04:33:26 2021-04-08 05:23:07 2021-04-08 06:19:30 0:56:23 0:49:46 0:06:37 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
pass 6027977 2021-04-08 04:33:27 2021-04-08 05:23:48 2021-04-08 06:54:55 1:31:07 1:18:42 0:12:25 smithi master centos 8.3 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 6027978 2021-04-08 04:33:28 2021-04-08 05:25:40 2021-04-08 05:52:45 0:27:05 0:14:43 0:12:22 smithi master centos 8.3 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
pass 6027979 2021-04-08 04:33:29 2021-04-08 05:26:41 2021-04-08 06:04:26 0:37:45 0:23:47 0:13:58 smithi master centos 8.3 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}} 2
pass 6027980 2021-04-08 04:33:30 2021-04-08 05:27:12 2021-04-08 06:13:30 0:46:18 0:39:31 0:06:47 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} 2
fail 6027981 2021-04-08 04:33:30 2021-04-08 05:27:43 2021-04-08 06:06:05 0:38:22 0:27:07 0:11:15 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
Failure Reason:

"2021-04-08T05:47:26.823566+0000 mds.c (mds.4310) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027982 2021-04-08 04:33:31 2021-04-08 05:28:55 2021-04-08 05:50:49 0:21:54 0:14:54 0:07:00 smithi master rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6027983 2021-04-08 04:33:32 2021-04-08 05:29:46 2021-04-08 05:56:03 0:26:17 0:13:07 0:13:10 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota} 2
pass 6027984 2021-04-08 04:33:33 2021-04-08 05:30:37 2021-04-08 05:51:40 0:21:03 0:14:18 0:06:45 smithi master rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6027985 2021-04-08 04:33:33 2021-04-08 05:30:37 2021-04-08 06:13:44 0:43:07 0:31:23 0:11:44 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} 2
fail 6027986 2021-04-08 04:33:34 2021-04-08 05:32:38 2021-04-08 05:58:16 0:25:38 0:15:36 0:10:02 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
Failure Reason:

"2021-04-08T05:49:49.417514+0000 mds.b (mds.4309) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027987 2021-04-08 04:33:35 2021-04-08 05:32:39 2021-04-08 06:24:07 0:51:28 0:39:28 0:12:00 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
pass 6027988 2021-04-08 04:33:36 2021-04-08 05:32:50 2021-04-08 05:55:30 0:22:40 0:11:33 0:11:07 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2
pass 6027989 2021-04-08 04:33:37 2021-04-08 05:34:01 2021-04-08 06:02:04 0:28:03 0:14:29 0:13:34 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} 2
fail 6027990 2021-04-08 04:33:37 2021-04-08 05:34:41 2021-04-08 05:59:36 0:24:55 0:17:43 0:07:12 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
Failure Reason:

"2021-04-08T05:51:37.944549+0000 mds.c (mds.4310) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027991 2021-04-08 04:33:38 2021-04-08 05:34:42 2021-04-08 06:04:04 0:29:22 0:19:16 0:10:06 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} 2
fail 6027992 2021-04-08 04:33:39 2021-04-08 05:34:52 2021-04-08 06:01:36 0:26:44 0:15:36 0:11:08 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
Failure Reason:

"2021-04-08T05:54:44.048978+0000 mds.b (mds.4303) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

fail 6027993 2021-04-08 04:33:40 2021-04-08 05:36:43 2021-04-08 06:12:27 0:35:44 0:25:59 0:09:45 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} 2
Failure Reason:

Test failure: test_multiple_path_r (tasks.cephfs.test_admin.TestSubCmdFsAuthorize)

pass 6027994 2021-04-08 04:33:41 2021-04-08 05:36:54 2021-04-08 06:02:04 0:25:10 0:15:57 0:09:13 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} 2
pass 6027995 2021-04-08 04:33:41 2021-04-08 05:39:05 2021-04-08 06:21:20 0:42:15 0:32:54 0:09:21 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
fail 6027996 2021-04-08 04:33:42 2021-04-08 05:39:26 2021-04-08 06:03:20 0:23:54 0:12:01 0:11:53 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
Failure Reason:

"2021-04-08T05:56:55.834128+0000 mds.a (mds.4301) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6027997 2021-04-08 04:33:43 2021-04-08 05:40:06 2021-04-08 06:56:08 1:16:02 1:09:38 0:06:24 smithi master rhel 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} 2
pass 6027998 2021-04-08 04:33:44 2021-04-08 05:40:57 2021-04-08 06:01:19 0:20:22 0:13:21 0:07:01 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool} 2
fail 6027999 2021-04-08 04:33:44 2021-04-08 05:41:58 2021-04-08 06:05:30 0:23:32 0:17:17 0:06:15 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
Failure Reason:

"2021-04-08T05:59:01.912636+0000 mds.a (mds.4275) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

fail 6028000 2021-04-08 04:33:45 2021-04-08 05:42:09 2021-04-08 09:18:18 3:36:09 3:25:49 0:10:20 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

"2021-04-08T06:45:56.196574+0000 mds.c (mds.0) 1 : cluster [WRN] client.4677 isn't responding to mclientcaps(revoke), ino 0x10000002be9 pending pAsLsXsFc issued pAsLsXsFcb, sent 300.005292 seconds ago" in cluster log

pass 6028001 2021-04-08 04:33:46 2021-04-08 05:42:09 2021-04-08 06:34:54 0:52:45 0:40:36 0:12:09 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
pass 6028002 2021-04-08 04:33:47 2021-04-08 05:43:00 2021-04-08 06:12:52 0:29:52 0:22:19 0:07:33 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} 2
pass 6028003 2021-04-08 04:33:47 2021-04-08 05:43:21 2021-04-08 06:15:31 0:32:10 0:21:43 0:10:27 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} 2
fail 6028004 2021-04-08 04:33:48 2021-04-08 05:43:22 2021-04-08 06:09:31 0:26:09 0:15:44 0:10:25 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
Failure Reason:

"2021-04-08T06:00:54.777794+0000 mds.e (mds.4291) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

fail 6028005 2021-04-08 04:33:49 2021-04-08 05:44:03 2021-04-08 06:07:20 0:23:17 0:13:26 0:09:51 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
Failure Reason:

"2021-04-08T06:00:24.475394+0000 mds.e (mds.4300) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028006 2021-04-08 04:33:49 2021-04-08 05:44:03 2021-04-08 06:14:06 0:30:03 0:20:14 0:09:49 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
pass 6028007 2021-04-08 04:33:50 2021-04-08 05:44:44 2021-04-08 06:06:27 0:21:43 0:14:36 0:07:07 smithi master rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6028008 2021-04-08 04:33:51 2021-04-08 05:45:04 2021-04-08 06:11:20 0:26:16 0:12:50 0:13:26 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} 2
pass 6028009 2021-04-08 04:33:52 2021-04-08 05:46:12 2021-04-08 06:09:32 0:23:20 0:12:18 0:11:02 smithi master ubuntu 20.04 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs} 2
pass 6028010 2021-04-08 04:33:52 2021-04-08 05:46:13 2021-04-08 07:42:09 1:55:56 1:49:38 0:06:18 smithi master rhel 8.3 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 6028011 2021-04-08 04:33:53 2021-04-08 05:47:03 2021-04-08 06:19:32 0:32:29 0:18:56 0:13:33 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} 4
fail 6028012 2021-04-08 04:33:54 2021-04-08 05:47:14 2021-04-08 06:15:59 0:28:45 0:15:08 0:13:37 smithi master centos 8.3 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} 2
Failure Reason:

Test failure: test_join_fs_standby_replay (tasks.cephfs.test_failover.TestClusterAffinity)

pass 6028013 2021-04-08 04:33:55 2021-04-08 05:48:05 2021-04-08 06:09:20 0:21:15 0:10:52 0:10:23 smithi master centos 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6028014 2021-04-08 04:33:55 2021-04-08 05:48:25 2021-04-08 06:26:28 0:38:03 0:27:21 0:10:42 smithi master fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
pass 6028015 2021-04-08 04:33:56 2021-04-08 05:48:46 2021-04-08 07:02:56 1:14:10 1:06:12 0:07:58 smithi master rhel 8.3 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/lockdep} 2
pass 6028016 2021-04-08 04:33:57 2021-04-08 05:49:27 2021-04-08 06:12:04 0:22:37 0:15:22 0:07:15 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
pass 6028017 2021-04-08 04:33:57 2021-04-08 05:51:00 2021-04-08 06:11:20 0:20:20 0:13:33 0:06:47 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
fail 6028018 2021-04-08 04:33:58 2021-04-08 05:51:31 2021-04-08 06:40:53 0:49:22 0:38:49 0:10:33 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
Failure Reason:

"2021-04-08T06:10:40.440393+0000 mds.d (mds.4236) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028019 2021-04-08 04:33:59 2021-04-08 05:51:42 2021-04-08 06:20:27 0:28:45 0:16:12 0:12:33 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
fail 6028020 2021-04-08 04:34:00 2021-04-08 05:52:53 2021-04-08 06:18:27 0:25:34 0:15:32 0:10:02 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
Failure Reason:

"2021-04-08T06:10:21.404312+0000 mds.a (mds.4304) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028021 2021-04-08 04:34:00 2021-04-08 05:52:53 2021-04-08 06:13:57 0:21:04 0:11:08 0:09:56 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} 2
pass 6028022 2021-04-08 04:34:01 2021-04-08 05:52:54 2021-04-08 06:24:05 0:31:11 0:23:34 0:07:37 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
pass 6028023 2021-04-08 04:34:02 2021-04-08 05:53:04 2021-04-08 06:20:54 0:27:50 0:15:28 0:12:22 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
pass 6028024 2021-04-08 04:34:03 2021-04-08 05:55:40 2021-04-08 07:05:57 1:10:17 0:58:17 0:12:00 smithi master centos 8.3 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 6028025 2021-04-08 04:34:03 2021-04-08 05:56:16 2021-04-08 06:29:12 0:32:56 0:24:14 0:08:42 smithi master rhel 8.3 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
fail 6028026 2021-04-08 04:34:04 2021-04-08 05:58:18 2021-04-08 06:54:45 0:56:27 0:42:33 0:13:54 smithi master centos 8.3 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} 2
Failure Reason:

Test failure: test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes), test_subvolume_evict_client (tasks.cephfs.test_volumes.TestSubvolumes)

fail 6028027 2021-04-08 04:34:05 2021-04-08 05:59:17 2021-04-08 07:40:51 1:41:34 1:34:36 0:06:58 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
Failure Reason:

"2021-04-08T06:16:08.489323+0000 mds.a (mds.4311) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028028 2021-04-08 04:34:05 2021-04-08 05:59:39 2021-04-08 06:20:48 0:21:09 0:09:17 0:11:52 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush} 2
pass 6028029 2021-04-08 04:34:06 2021-04-08 06:01:30 2021-04-08 06:24:26 0:22:56 0:16:12 0:06:44 smithi master rhel 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}} 2
fail 6028030 2021-04-08 04:34:08 2021-04-08 06:01:40 2021-04-08 06:29:48 0:28:08 0:16:03 0:12:05 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
Failure Reason:

"2021-04-08T06:21:42.966410+0000 mds.b (mds.4309) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028031 2021-04-08 04:34:08 2021-04-08 06:02:26 2021-04-08 09:26:18 3:23:52 3:12:33 0:11:19 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
pass 6028032 2021-04-08 04:34:09 2021-04-08 06:02:27 2021-04-08 06:28:45 0:26:18 0:16:07 0:10:11 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
pass 6028033 2021-04-08 04:34:10 2021-04-08 06:03:29 2021-04-08 06:29:45 0:26:16 0:18:58 0:07:18 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} 2
fail 6028034 2021-04-08 04:34:11 2021-04-08 06:04:10 2021-04-08 06:29:46 0:25:36 0:14:05 0:11:31 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
Failure Reason:

"2021-04-08T06:21:54.076895+0000 mds.c (mds.4301) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028035 2021-04-08 04:34:11 2021-04-08 06:04:31 2021-04-08 06:56:06 0:51:35 0:45:25 0:06:10 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
fail 6028036 2021-04-08 04:34:12 2021-04-08 06:05:02 2021-04-08 06:30:39 0:25:37 0:17:39 0:07:58 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
Failure Reason:

"2021-04-08T06:22:39.072663+0000 mds.c (mds.4307) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028037 2021-04-08 04:34:13 2021-04-08 06:05:32 2021-04-08 06:31:04 0:25:32 0:12:22 0:13:10 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} 2
pass 6028038 2021-04-08 04:34:13 2021-04-08 06:06:13 2021-04-08 06:41:49 0:35:36 0:24:53 0:10:43 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
pass 6028039 2021-04-08 04:34:14 2021-04-08 06:06:34 2021-04-08 06:31:58 0:25:24 0:13:50 0:11:34 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
pass 6028040 2021-04-08 04:34:15 2021-04-08 06:06:54 2021-04-08 06:28:35 0:21:41 0:12:29 0:09:12 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
fail 6028041 2021-04-08 04:34:16 2021-04-08 06:07:25 2021-04-08 06:42:36 0:35:11 0:24:07 0:11:04 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
Failure Reason:

"2021-04-08T06:27:41.252220+0000 mds.d (mds.4251) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028042 2021-04-08 04:34:16 2021-04-08 06:09:26 2021-04-08 06:37:01 0:27:35 0:18:02 0:09:33 smithi master ubuntu 20.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 6028043 2021-04-08 04:34:17 2021-04-08 06:09:37 2021-04-08 06:48:59 0:39:22 0:29:15 0:10:07 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} 2
pass 6028044 2021-04-08 04:34:18 2021-04-08 06:09:38 2021-04-08 06:32:40 0:23:02 0:12:40 0:10:22 smithi master centos 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
fail 6028045 2021-04-08 04:34:19 2021-04-08 06:09:38 2021-04-08 06:36:51 0:27:13 0:13:41 0:13:32 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
Failure Reason:

"2021-04-08T06:30:03.121965+0000 mds.c (mds.4306) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028046 2021-04-08 04:34:19 2021-04-08 06:11:29 2021-04-08 06:49:09 0:37:40 0:27:23 0:10:17 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}} 2
pass 6028047 2021-04-08 04:34:20 2021-04-08 06:11:30 2021-04-08 06:39:45 0:28:15 0:20:55 0:07:20 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
pass 6028048 2021-04-08 04:34:21 2021-04-08 06:12:10 2021-04-08 06:39:46 0:27:36 0:21:41 0:05:55 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage} 2
pass 6028049 2021-04-08 04:34:21 2021-04-08 06:12:31 2021-04-08 06:34:21 0:21:50 0:15:03 0:06:47 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
fail 6028050 2021-04-08 04:34:22 2021-04-08 06:13:02 2021-04-08 06:39:03 0:26:01 0:14:17 0:11:44 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
Failure Reason:

"2021-04-08T06:32:14.392409+0000 mds.b (mds.4309) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028051 2021-04-08 04:34:23 2021-04-08 06:13:33 2021-04-08 07:05:06 0:51:33 0:37:22 0:14:11 smithi master centos 8.3 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 6028052 2021-04-08 04:34:24 2021-04-08 06:13:44 2021-04-08 06:37:46 0:24:02 0:09:43 0:14:19 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} 5
pass 6028053 2021-04-08 04:34:24 2021-04-08 06:14:05 2021-04-08 06:51:47 0:37:42 0:24:10 0:13:32 smithi master centos 8.3 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} 2
fail 6028054 2021-04-08 04:34:25 2021-04-08 06:14:16 2021-04-08 07:32:01 1:17:45 1:09:10 0:08:35 smithi master rhel 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} 2
Failure Reason:

Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi104 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9ff5aa9ab67a69334226e0146d5a4abfed082420 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/snaps/snaptest-git-ceph.sh'

pass 6028055 2021-04-08 04:34:26 2021-04-08 06:15:37 2021-04-08 06:50:05 0:34:28 0:19:03 0:15:25 smithi master fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 6028056 2021-04-08 04:34:26 2021-04-08 06:18:30 2021-04-08 09:00:54 2:42:24 2:32:14 0:10:10 smithi master rhel 8.3 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/valgrind} 2
fail 6028057 2021-04-08 04:34:27 2021-04-08 06:18:31 2021-04-08 06:44:20 0:25:49 0:15:28 0:10:21 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
Failure Reason:

timeout expired in wait_until_healthy

pass 6028058 2021-04-08 04:34:28 2021-04-08 06:19:32 2021-04-08 06:52:44 0:33:12 0:26:47 0:06:25 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} 2
pass 6028059 2021-04-08 04:34:29 2021-04-08 06:19:33 2021-04-08 07:35:59 1:16:26 1:04:49 0:11:37 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
fail 6028060 2021-04-08 04:34:29 2021-04-08 06:19:34 2021-04-08 07:46:02 1:26:28 1:18:07 0:08:21 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
Failure Reason:

Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi065 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9ff5aa9ab67a69334226e0146d5a4abfed082420 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh'

fail 6028061 2021-04-08 04:34:30 2021-04-08 06:19:35 2021-04-08 07:40:01 1:20:26 1:08:38 0:11:48 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi039 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9ff5aa9ab67a69334226e0146d5a4abfed082420 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh'

pass 6028062 2021-04-08 04:34:31 2021-04-08 06:19:45 2021-04-08 07:36:09 1:16:24 1:05:38 0:10:46 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} 2
pass 6028063 2021-04-08 04:34:32 2021-04-08 06:20:37 2021-04-08 07:22:07 1:01:30 0:48:46 0:12:44 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports} 2
fail 6028064 2021-04-08 04:34:32 2021-04-08 06:20:57 2021-04-08 06:46:37 0:25:40 0:17:34 0:08:06 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
Failure Reason:

"2021-04-08T06:38:11.288628+0000 mds.b (mds.4301) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028065 2021-04-08 04:34:33 2021-04-08 06:21:28 2021-04-08 06:55:09 0:33:41 0:23:35 0:10:06 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} 2
pass 6028066 2021-04-08 04:34:34 2021-04-08 06:21:29 2021-04-08 07:17:56 0:56:27 0:43:18 0:13:09 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
pass 6028067 2021-04-08 04:34:34 2021-04-08 06:24:10 2021-04-08 06:50:05 0:25:55 0:15:03 0:10:52 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} 2
fail 6028068 2021-04-08 04:34:35 2021-04-08 06:24:10 2021-04-08 07:32:07 1:07:57 0:57:40 0:10:17 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
Failure Reason:

"2021-04-08T06:43:18.163304+0000 mds.d (mds.4263) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028069 2021-04-08 04:34:36 2021-04-08 06:24:11 2021-04-08 07:54:02 1:29:51 1:20:47 0:09:04 smithi master ubuntu 20.04 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 6028070 2021-04-08 04:34:37 2021-04-08 06:24:31 2021-04-08 08:02:03 1:37:32 1:25:47 0:11:45 smithi master centos 8.3 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
pass 6028071 2021-04-08 04:34:37 2021-04-08 06:26:32 2021-04-08 07:15:59 0:49:27 0:37:43 0:11:44 smithi master ubuntu 20.04 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} 2
pass 6028072 2021-04-08 04:34:38 2021-04-08 06:27:56 2021-04-08 06:50:05 0:22:09 0:11:53 0:10:16 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2
fail 6028073 2021-04-08 04:34:39 2021-04-08 06:28:37 2021-04-08 06:54:05 0:25:28 0:17:34 0:07:54 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
Failure Reason:

"2021-04-08T06:46:01.461664+0000 mds.b (mds.4300) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028074 2021-04-08 04:34:40 2021-04-08 06:28:47 2021-04-08 06:52:08 0:23:21 0:16:25 0:06:56 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} 2
pass 6028075 2021-04-08 04:34:40 2021-04-08 06:28:58 2021-04-08 06:50:05 0:21:07 0:11:44 0:09:23 smithi master centos 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6028076 2021-04-08 04:34:41 2021-04-08 06:28:58 2021-04-08 06:54:13 0:25:15 0:15:56 0:09:19 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment} 2
pass 6028077 2021-04-08 04:34:42 2021-04-08 06:29:19 2021-04-08 06:50:21 0:21:02 0:10:29 0:10:33 smithi master centos 8.3 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python} 2
pass 6028078 2021-04-08 04:34:43 2021-04-08 06:29:49 2021-04-08 06:50:48 0:20:59 0:14:59 0:06:00 smithi master rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 6028079 2021-04-08 04:34:43 2021-04-08 06:29:50 2021-04-08 06:54:57 0:25:07 0:18:28 0:06:39 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress}} 3
pass 6028080 2021-04-08 04:34:44 2021-04-08 06:29:51 2021-04-08 06:55:48 0:25:57 0:15:20 0:10:37 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} 2
pass 6028081 2021-04-08 04:34:45 2021-04-08 06:30:41 2021-04-08 07:06:24 0:35:43 0:25:08 0:10:35 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx}} 3
fail 6028082 2021-04-08 04:34:46 2021-04-08 06:31:12 2021-04-08 06:57:21 0:26:09 0:15:33 0:10:36 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester}} 3
Failure Reason:

"2021-04-08T06:48:55.032900+0000 mds.a (mds.4290) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028083 2021-04-08 04:34:46 2021-04-08 06:32:03 2021-04-08 07:00:06 0:28:03 0:21:12 0:06:51 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} 2
pass 6028084 2021-04-08 04:34:47 2021-04-08 06:32:44 2021-04-08 07:06:58 0:34:14 0:20:08 0:14:06 smithi master centos 8.3 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 6028085 2021-04-08 04:34:48 2021-04-08 06:33:55 2021-04-08 07:05:56 0:32:01 0:20:16 0:11:45 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc}} 3
pass 6028086 2021-04-08 04:34:48 2021-04-08 06:34:25 2021-04-08 09:00:54 2:26:29 2:17:28 0:09:01 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
fail 6028087 2021-04-08 04:34:49 2021-04-08 06:34:56 2021-04-08 07:52:23 1:17:27 1:08:38 0:08:49 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen}} 3
Failure Reason:

"2021-04-08T06:52:52.978341+0000 mds.c (mds.4310) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028088 2021-04-08 04:34:50 2021-04-08 06:36:57 2021-04-08 07:00:06 0:23:09 0:11:47 0:11:22 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} 2
pass 6028089 2021-04-08 04:34:51 2021-04-08 06:37:07 2021-04-08 07:48:51 1:11:44 1:01:21 0:10:23 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} 2
fail 6028090 2021-04-08 04:34:51 2021-04-08 06:37:48 2021-04-08 07:02:12 0:24:24 0:15:35 0:08:49 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone}} 3
Failure Reason:

"2021-04-08T06:55:17.860179+0000 mds.e (mds.4312) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028091 2021-04-08 04:34:52 2021-04-08 06:37:49 2021-04-08 07:02:53 0:25:04 0:14:26 0:10:38 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd}} 3
fail 6028092 2021-04-08 04:34:53 2021-04-08 06:39:09 2021-04-08 07:05:11 0:26:02 0:16:10 0:09:52 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 2
Failure Reason:

Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull)

pass 6028093 2021-04-08 04:34:54 2021-04-08 06:39:50 2021-04-08 07:08:54 0:29:04 0:23:11 0:05:53 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
pass 6028094 2021-04-08 04:34:54 2021-04-08 06:39:51 2021-04-08 08:18:04 1:38:13 1:27:40 0:10:33 smithi master ubuntu 20.04 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 6028095 2021-04-08 04:34:55 2021-04-08 06:39:51 2021-04-08 07:07:20 0:27:29 0:12:14 0:15:15 smithi master ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} 4
fail 6028096 2021-04-08 04:34:56 2021-04-08 06:41:52 2021-04-08 07:06:06 0:24:14 0:13:44 0:10:30 smithi master ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} 2
Failure Reason:

Test failure: test_join_fs_standby_replay (tasks.cephfs.test_failover.TestClusterAffinity)

pass 6028097 2021-04-08 04:34:57 2021-04-08 06:42:43 2021-04-08 07:12:06 0:29:23 0:19:05 0:10:18 smithi master fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/pacific}} 3
pass 6028098 2021-04-08 04:34:57 2021-04-08 06:43:03 2021-04-08 08:23:07 1:40:04 1:28:45 0:11:19 smithi master centos 8.3 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/lockdep} 2
fail 6028099 2021-04-08 04:34:58 2021-04-08 06:44:24 2021-04-08 07:11:58 0:27:34 0:13:35 0:13:59 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io}} 3
Failure Reason:

"2021-04-08T07:03:50.943982+0000 mds.d (mds.4302) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028100 2021-04-08 04:34:59 2021-04-08 06:46:45 2021-04-08 07:09:56 0:23:11 0:13:14 0:09:57 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
fail 6028101 2021-04-08 04:34:59 2021-04-08 06:46:45 2021-04-08 07:12:52 0:26:07 0:17:14 0:08:53 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc}} 3
Failure Reason:

"2021-04-08T07:06:26.718239+0000 mds.a (mds.4276) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028102 2021-04-08 04:35:00 2021-04-08 06:49:15 2021-04-08 07:09:59 0:20:44 0:08:55 0:11:49 smithi master ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} 2
pass 6028103 2021-04-08 04:35:01 2021-04-08 06:50:06 2021-04-08 07:17:59 0:27:53 0:17:21 0:10:32 smithi master ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
pass 6028104 2021-04-08 04:35:02 2021-04-08 06:50:07 2021-04-08 07:35:47 0:45:40 0:34:40 0:11:00 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build}} 3
fail 6028105 2021-04-08 04:35:02 2021-04-08 06:50:07 2021-04-08 07:31:47 0:41:40 0:32:10 0:09:30 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench}} 3
Failure Reason:

"2021-04-08T07:08:16.825998+0000 mds.d (mds.4263) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028106 2021-04-08 04:35:03 2021-04-08 06:50:08 2021-04-08 07:13:16 0:23:08 0:12:47 0:10:21 smithi master centos 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
pass 6028107 2021-04-08 04:35:04 2021-04-08 06:50:08 2021-04-08 07:17:23 0:27:15 0:20:16 0:06:59 smithi master rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 6028108 2021-04-08 04:35:05 2021-04-08 06:50:29 2021-04-08 07:16:25 0:25:56 0:18:59 0:06:57 smithi master rhel 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics} 2
pass 6028109 2021-04-08 04:35:05 2021-04-08 06:50:50 2021-04-08 07:13:00 0:22:10 0:15:27 0:06:43 smithi master rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
fail 6028110 2021-04-08 04:35:06 2021-04-08 06:51:51 2021-04-08 07:18:07 0:26:16 0:13:29 0:12:47 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench}} 3
Failure Reason:

"2021-04-08T07:10:03.300345+0000 mds.a (mds.4290) 1 : cluster [ERR] error reading sessionmap 'mds2_sessionmap' -2 ((2) No such file or directory)" in cluster log

pass 6028111 2021-04-08 04:35:07 2021-04-08 06:52:52 2021-04-08 07:21:23 0:28:31 0:16:14 0:12:17 smithi master ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag_enable multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} 2
pass 6028112 2021-04-08 04:35:08 2021-04-08 06:54:13 2021-04-08 07:57:23 1:03:10 0:56:40 0:06:30 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb}} 3
pass 6028113 2021-04-08 04:35:08 2021-04-08 06:54:24 2021-04-08 07:28:01 0:33:37 0:20:21 0:13:16 smithi master centos 8.3 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc} 2
dead 6028114 2021-04-08 04:35:09 2021-04-08 06:54:54 2021-04-08 17:06:51 10:11:57 smithi master rhel 8.3 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
fail 6028115 2021-04-08 04:35:10 2021-04-08 06:55:05 2021-04-08 07:22:00 0:26:55 0:15:45 0:11:10 smithi master centos 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats}} 3
Failure Reason:

"2021-04-08T07:14:00.578103+0000 mds.f (mds.4307) 1 : cluster [ERR] error reading table object 'mds2_inotable' -2 ((2) No such file or directory)" in cluster log

pass 6028116 2021-04-08 04:35:11 2021-04-08 06:55:05 2021-04-08 08:11:01 1:15:56 1:09:03 0:06:53 smithi master rhel 8.3 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} 2