Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6894987 2022-06-23 16:13:59 2022-06-23 18:09:39 2022-06-23 18:26:48 0:17:09 0:11:01 0:06:08 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/fragment} 2
pass 6894988 2022-06-23 16:14:01 2022-06-23 18:09:40 2022-06-23 18:31:41 0:22:01 0:14:32 0:07:29 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/journal-repair} 2
pass 6894989 2022-06-23 16:14:02 2022-06-23 18:10:30 2022-06-23 18:29:24 0:18:54 0:08:28 0:10:26 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/libcephfs_python} 2
pass 6894990 2022-06-23 16:14:03 2022-06-23 18:10:41 2022-06-23 18:34:43 0:24:02 0:13:13 0:10:49 smithi main ubuntu 18.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_fsstress} 2
pass 6894991 2022-06-23 16:14:05 2022-06-23 18:11:22 2022-06-23 19:01:08 0:49:46 0:40:07 0:09:39 smithi main ubuntu 18.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/failover} 2
pass 6894992 2022-06-23 16:14:06 2022-06-23 18:11:42 2022-06-23 18:30:55 0:19:13 0:09:40 0:09:33 smithi main ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_misc} 2
pass 6894993 2022-06-23 16:14:07 2022-06-23 18:12:03 2022-06-23 19:34:55 1:22:52 1:12:58 0:09:54 smithi main ubuntu 18.04 fs/snaps/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/snaptests} 2
pass 6894994 2022-06-23 16:14:09 2022-06-23 18:13:23 2022-06-23 18:28:29 0:15:06 0:08:12 0:06:54 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/mds-flush} 2
pass 6894995 2022-06-23 16:14:10 2022-06-23 18:13:24 2022-06-23 18:40:33 0:27:09 0:18:18 0:08:51 smithi main centos 8.stream fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_misc_test_o_trunc} 2
pass 6894996 2022-06-23 16:14:11 2022-06-23 18:15:25 2022-06-23 18:38:51 0:23:26 0:17:30 0:05:56 smithi main rhel 8.3 fs/thrash/{begin ceph-thrash/mon clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6894997 2022-06-23 16:14:13 2022-06-23 18:15:35 2022-06-23 18:47:04 0:31:29 0:19:10 0:12:19 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/mds-full} 2
pass 6894998 2022-06-23 16:14:14 2022-06-23 18:16:06 2022-06-23 18:46:13 0:30:07 0:19:49 0:10:18 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} 5
pass 6894999 2022-06-23 16:14:15 2022-06-23 18:16:27 2022-06-23 18:31:48 0:15:21 0:07:38 0:07:43 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/mds_creation_retry} 2
pass 6895000 2022-06-23 16:14:17 2022-06-23 18:16:37 2022-06-23 18:38:28 0:21:51 0:12:43 0:09:08 smithi main ubuntu 18.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
pass 6895001 2022-06-23 16:14:18 2022-06-23 18:16:58 2022-06-23 19:11:36 0:54:38 0:46:45 0:07:53 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/valgrind} 2
pass 6895002 2022-06-23 16:14:20 2022-06-23 18:18:29 2022-06-23 18:34:13 0:15:44 0:09:12 0:06:32 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/openfiletable} 2
fail 6895003 2022-06-23 16:14:22 2022-06-23 18:19:19 2022-06-23 18:34:07 0:14:48 0:03:42 0:11:06 smithi main fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895004 2022-06-23 16:14:23 2022-06-23 18:20:20 2022-06-23 18:44:13 0:23:53 0:12:47 0:11:06 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_norstats} 2
pass 6895005 2022-06-23 16:14:24 2022-06-23 18:20:20 2022-06-23 18:39:38 0:19:18 0:09:10 0:10:08 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/pool-perm} 2
pass 6895006 2022-06-23 16:14:25 2022-06-23 18:20:21 2022-06-23 18:39:54 0:19:33 0:09:21 0:10:12 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/quota} 2
pass 6895007 2022-06-23 16:14:27 2022-06-23 18:20:31 2022-06-23 18:42:36 0:22:05 0:10:25 0:11:40 smithi main ubuntu 18.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_pjd} 2
pass 6895008 2022-06-23 16:14:28 2022-06-23 18:20:52 2022-06-23 18:44:15 0:23:23 0:16:29 0:06:54 smithi main rhel 8.3 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6895009 2022-06-23 16:14:29 2022-06-23 18:21:22 2022-06-23 18:42:46 0:21:24 0:12:02 0:09:22 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/sessionmap/{sessionmap}} 2
pass 6895010 2022-06-23 16:14:30 2022-06-23 18:21:23 2022-06-23 18:53:38 0:32:15 0:21:11 0:11:04 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/strays} 2
pass 6895011 2022-06-23 16:14:32 2022-06-23 18:22:14 2022-06-23 18:48:03 0:25:49 0:16:25 0:09:24 smithi main ubuntu 20.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_blogbench} 2
pass 6895012 2022-06-23 16:14:33 2022-06-23 18:22:35 2022-06-23 18:48:51 0:26:16 0:15:03 0:11:13 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/test_journal_migration} 2
pass 6895013 2022-06-23 16:14:34 2022-06-23 18:23:15 2022-06-23 18:54:40 0:31:25 0:23:29 0:07:56 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/volume-client/{py/2 task/test/{test}}} 2
pass 6895014 2022-06-23 16:14:35 2022-06-23 18:23:26 2022-06-23 19:56:29 1:33:03 1:26:10 0:06:53 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/volumes} 2
pass 6895015 2022-06-23 16:14:37 2022-06-23 18:23:26 2022-06-23 19:26:15 1:02:49 0:54:07 0:08:42 smithi main rhel 8.3 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_dbench} 2
pass 6895016 2022-06-23 16:14:38 2022-06-23 18:24:27 2022-06-23 18:54:04 0:29:37 0:23:20 0:06:17 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/volume-client/{py/3 task/test/{test}}} 2
pass 6895017 2022-06-23 16:14:39 2022-06-23 18:25:18 2022-06-23 18:42:52 0:17:34 0:07:56 0:09:38 smithi main ubuntu 18.04 fs/thrash/{begin ceph-thrash/mds clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_trivial_sync} 2
pass 6895018 2022-06-23 16:14:40 2022-06-23 18:25:38 2022-06-23 18:44:11 0:18:33 0:11:37 0:06:56 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895019 2022-06-23 16:14:42 2022-06-23 18:25:39 2022-06-23 18:49:35 0:23:56 0:16:36 0:07:20 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/acls-fuse-client} 2
fail 6895020 2022-06-23 16:14:43 2022-06-23 18:26:39 2022-06-23 18:43:59 0:17:20 0:07:55 0:09:25 smithi main fs/bugs/client_trim_caps/{begin clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i22073} 1
Failure Reason:

Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_ino_release_cb'

dead 6895021 2022-06-23 16:14:44 2022-06-23 18:26:40 2022-06-24 06:36:50 12:10:10 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} 4
Failure Reason:

hit max job timeout

pass 6895022 2022-06-23 16:14:45 2022-06-23 18:27:41 2022-06-23 19:14:47 0:47:06 0:40:27 0:06:39 smithi main centos 8.stream fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/failover} 2
pass 6895023 2022-06-23 16:14:47 2022-06-23 18:27:41 2022-06-23 18:48:03 0:20:22 0:10:13 0:10:09 smithi main ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_misc} 2
pass 6895024 2022-06-23 16:14:48 2022-06-23 18:28:32 2022-06-23 19:49:01 1:20:29 1:10:56 0:09:33 smithi main ubuntu 18.04 fs/snaps/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/snaptests} 2
pass 6895025 2022-06-23 16:14:49 2022-06-23 18:28:43 2022-06-23 18:54:00 0:25:17 0:19:21 0:05:56 smithi main centos 8.stream fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
fail 6895026 2022-06-23 16:14:50 2022-06-23 18:28:53 2022-06-23 18:42:47 0:13:54 0:03:53 0:10:01 smithi main fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-compat_client/mimic}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895027 2022-06-23 16:14:52 2022-06-23 18:28:54 2022-06-23 19:19:54 0:51:00 0:44:54 0:06:06 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/lockdep} 2
pass 6895028 2022-06-23 16:14:53 2022-06-23 18:28:55 2022-06-23 18:54:29 0:25:34 0:16:23 0:09:11 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/admin} 2
pass 6895029 2022-06-23 16:14:54 2022-06-23 18:28:55 2022-06-23 19:06:30 0:37:35 0:28:58 0:08:37 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_ffsb} 2
pass 6895030 2022-06-23 16:14:56 2022-06-23 18:29:06 2022-06-23 18:48:38 0:19:32 0:09:26 0:10:06 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/alternate-pool} 2
pass 6895031 2022-06-23 16:14:57 2022-06-23 18:29:17 2022-06-23 18:54:28 0:25:11 0:18:39 0:06:32 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/asok_dump_tree} 2
pass 6895032 2022-06-23 16:14:58 2022-06-23 18:29:27 2022-06-23 18:54:07 0:24:40 0:16:07 0:08:33 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/auto-repair} 2
pass 6895033 2022-06-23 16:14:59 2022-06-23 18:29:38 2022-06-23 18:45:30 0:15:52 0:08:17 0:07:35 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/backtrace} 2
pass 6895034 2022-06-23 16:15:01 2022-06-23 18:30:59 2022-06-23 18:52:53 0:21:54 0:12:42 0:09:12 smithi main ubuntu 20.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895035 2022-06-23 16:15:02 2022-06-23 18:31:29 2022-06-23 18:47:11 0:15:42 0:08:26 0:07:16 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cap-flush} 2
pass 6895036 2022-06-23 16:15:04 2022-06-23 18:31:50 2022-06-23 18:51:28 0:19:38 0:10:14 0:09:24 smithi main ubuntu 18.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_pjd} 2
pass 6895037 2022-06-23 16:15:05 2022-06-23 18:31:50 2022-06-23 18:52:06 0:20:16 0:10:00 0:10:16 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_pjd} 2
pass 6895038 2022-06-23 16:15:07 2022-06-23 18:32:01 2022-06-23 19:09:31 0:37:30 0:28:24 0:09:06 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cephfs-shell} 2
pass 6895039 2022-06-23 16:15:08 2022-06-23 18:32:02 2022-06-23 18:53:47 0:21:45 0:14:22 0:07:23 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cephfs_scrub_tests} 2
pass 6895040 2022-06-23 16:15:09 2022-06-23 18:32:23 2022-06-23 19:51:55 1:19:32 1:07:08 0:12:24 smithi main ubuntu 18.04 fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-verify} ubuntu_18.04} 2
pass 6895041 2022-06-23 16:15:11 2022-06-23 18:34:14 2022-06-23 19:11:37 0:37:23 0:28:33 0:08:50 smithi main ubuntu 20.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_fsx} 2
pass 6895042 2022-06-23 16:15:12 2022-06-23 18:34:14 2022-06-23 18:57:14 0:23:00 0:16:07 0:06:53 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_quota} 2
pass 6895043 2022-06-23 16:15:14 2022-06-23 18:34:15 2022-06-23 19:23:32 0:49:17 0:42:19 0:06:58 smithi main centos 8.stream fs/thrash/{begin ceph-thrash/mon clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_snaptests} 2
pass 6895044 2022-06-23 16:15:15 2022-06-23 18:34:35 2022-06-23 19:28:00 0:53:25 0:43:31 0:09:54 smithi main ubuntu 20.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
pass 6895045 2022-06-23 16:15:17 2022-06-23 18:34:36 2022-06-23 20:42:06 2:07:30 2:01:25 0:06:05 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress validater/valgrind} 2
pass 6895046 2022-06-23 16:15:18 2022-06-23 18:34:36 2022-06-23 18:57:44 0:23:08 0:16:13 0:06:55 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/client-limits} 2
pass 6895047 2022-06-23 16:15:20 2022-06-23 18:34:47 2022-06-23 18:55:11 0:20:24 0:08:05 0:12:19 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} 5
pass 6895048 2022-06-23 16:15:22 2022-06-23 18:36:58 2022-06-23 18:59:26 0:22:28 0:13:44 0:08:44 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/client-readahad} 2
pass 6895049 2022-06-23 16:15:24 2022-06-23 18:38:29 2022-06-23 19:14:13 0:35:44 0:28:59 0:06:45 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/client-recovery} 2
pass 6895050 2022-06-23 16:15:25 2022-06-23 18:39:00 2022-06-23 18:58:45 0:19:45 0:11:28 0:08:17 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895051 2022-06-23 16:15:27 2022-06-23 18:39:41 2022-06-23 19:27:15 0:47:34 0:39:36 0:07:58 smithi main centos 8.stream fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/failover} 2
pass 6895052 2022-06-23 16:15:29 2022-06-23 18:39:52 2022-06-23 18:59:47 0:19:55 0:09:20 0:10:35 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_misc} 2
pass 6895053 2022-06-23 16:15:30 2022-06-23 18:39:52 2022-06-23 19:43:15 1:03:23 0:55:50 0:07:33 smithi main centos 8.stream fs/snaps/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/snaptests} 2
pass 6895054 2022-06-23 16:15:32 2022-06-23 18:40:03 2022-06-23 19:00:17 0:20:14 0:10:29 0:09:45 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_fsync} 2
pass 6895055 2022-06-23 16:15:34 2022-06-23 18:40:34 2022-06-23 19:03:46 0:23:12 0:15:44 0:07:28 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/damage} 2
pass 6895056 2022-06-23 16:15:36 2022-06-23 18:40:35 2022-06-23 19:11:44 0:31:09 0:20:31 0:10:38 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/data-scan} 2
pass 6895057 2022-06-23 16:15:38 2022-06-23 18:42:26 2022-06-23 19:05:58 0:23:32 0:17:06 0:06:26 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/forward-scrub} 2
pass 6895058 2022-06-23 16:15:40 2022-06-23 18:42:37 2022-06-23 19:18:13 0:35:36 0:27:00 0:08:36 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_iogen} 2
pass 6895059 2022-06-23 16:15:42 2022-06-23 18:42:47 2022-06-23 19:04:20 0:21:33 0:10:48 0:10:45 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/fragment} 2
pass 6895060 2022-06-23 16:15:43 2022-06-23 18:42:57 2022-06-23 19:04:08 0:21:11 0:14:04 0:07:07 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/journal-repair} 2
fail 6895061 2022-06-23 16:15:45 2022-06-23 18:42:58 2022-06-23 18:57:40 0:14:42 0:03:18 0:11:24 smithi main fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895062 2022-06-23 16:15:47 2022-06-23 18:44:19 2022-06-23 19:02:08 0:17:49 0:07:59 0:09:50 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/libcephfs_python} 2
pass 6895063 2022-06-23 16:15:49 2022-06-23 18:44:19 2022-06-23 19:09:02 0:24:43 0:18:46 0:05:57 smithi main rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6895064 2022-06-23 16:15:51 2022-06-23 18:44:20 2022-06-23 19:04:39 0:20:19 0:10:09 0:10:10 smithi main ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_pjd} 2
pass 6895065 2022-06-23 16:15:53 2022-06-23 18:45:30 2022-06-23 19:34:52 0:49:22 0:39:47 0:09:35 smithi main ubuntu 20.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
pass 6895066 2022-06-23 16:15:56 2022-06-23 18:45:31 2022-06-23 19:36:05 0:50:34 0:44:49 0:05:45 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/lockdep} 2
pass 6895067 2022-06-23 16:15:58 2022-06-23 18:45:31 2022-06-23 19:04:00 0:18:29 0:08:15 0:10:14 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/mds-flush} 2
pass 6895068 2022-06-23 16:16:00 2022-06-23 18:46:22 2022-06-23 19:20:08 0:33:46 0:22:32 0:11:14 smithi main ubuntu 18.04 fs/thrash/{begin ceph-thrash/mds clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895069 2022-06-23 16:16:02 2022-06-23 18:46:22 2022-06-23 19:18:30 0:32:08 0:24:10 0:07:58 smithi main rhel 8.3 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_iozone} 2
pass 6895070 2022-06-23 16:16:04 2022-06-23 18:47:13 2022-06-23 19:21:45 0:34:32 0:26:26 0:08:06 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/mds-full} 2
pass 6895071 2022-06-23 16:16:06 2022-06-23 18:47:13 2022-06-23 19:09:43 0:22:30 0:10:46 0:11:44 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/mdtest} 4
pass 6895072 2022-06-23 16:16:08 2022-06-23 18:48:14 2022-06-23 19:06:08 0:17:54 0:08:34 0:09:20 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/mds_creation_retry} 2
pass 6895073 2022-06-23 16:16:11 2022-06-23 18:48:45 2022-06-23 19:08:08 0:19:23 0:09:22 0:10:01 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/openfiletable} 2
pass 6895074 2022-06-23 16:16:13 2022-06-23 18:48:45 2022-06-23 19:11:32 0:22:47 0:13:15 0:09:32 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_pjd} 2
pass 6895075 2022-06-23 16:16:15 2022-06-23 18:48:46 2022-06-23 19:04:18 0:15:32 0:08:37 0:06:55 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/pool-perm} 2
pass 6895076 2022-06-23 16:16:17 2022-06-23 19:12:30 965 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/quota} 2
pass 6895077 2022-06-23 16:16:19 2022-06-23 18:49:37 2022-06-23 19:14:43 0:25:06 0:17:49 0:07:17 smithi main rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895078 2022-06-23 16:16:21 2022-06-23 18:49:47 2022-06-23 19:41:07 0:51:20 0:40:50 0:10:30 smithi main ubuntu 18.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/failover} 2
pass 6895079 2022-06-23 16:16:24 2022-06-23 18:51:38 2022-06-23 19:13:52 0:22:14 0:11:38 0:10:36 smithi main ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_misc} 2
pass 6895080 2022-06-23 16:16:26 2022-06-23 18:52:09 2022-06-23 19:48:07 0:55:58 0:48:18 0:07:40 smithi main rhel 8.3 fs/snaps/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/snaptests} 2
pass 6895081 2022-06-23 16:16:28 2022-06-23 18:52:59 2022-06-23 19:12:36 0:19:37 0:11:43 0:07:54 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/sessionmap/{sessionmap}} 2
pass 6895082 2022-06-23 16:16:30 2022-06-23 18:53:40 2022-06-23 19:21:07 0:27:27 0:20:51 0:06:36 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/strays} 2
pass 6895083 2022-06-23 16:16:32 2022-06-23 18:53:50 2022-06-23 19:16:38 0:22:48 0:14:38 0:08:10 smithi main rhel 8.3 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_truncate_delay} 2
fail 6895084 2022-06-23 16:16:34 2022-06-23 18:54:11 2022-06-23 19:07:35 0:13:24 0:03:11 0:10:13 smithi main fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895085 2022-06-23 16:16:37 2022-06-23 18:54:11 2022-06-23 19:19:38 0:25:27 0:16:07 0:09:20 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/test_journal_migration} 2
pass 6895086 2022-06-23 16:16:39 2022-06-23 18:54:12 2022-06-23 19:15:43 0:21:31 0:14:30 0:07:01 smithi main centos 8.stream fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
pass 6895087 2022-06-23 16:16:41 2022-06-23 18:54:32 2022-06-23 20:51:45 1:57:13 1:50:11 0:07:02 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress validater/valgrind} 2
pass 6895088 2022-06-23 16:16:44 2022-06-23 18:54:33 2022-06-23 19:29:59 0:35:26 0:27:54 0:07:32 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/volume-client/{py/2 task/test/{test}}} 2
pass 6895089 2022-06-23 16:16:46 2022-06-23 18:54:43 2022-06-23 20:34:41 1:39:58 1:29:22 0:10:36 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/volumes} 2
pass 6895090 2022-06-23 16:16:48 2022-06-23 18:55:14 2022-06-23 19:12:59 0:17:45 0:10:12 0:07:33 smithi main centos 8.stream fs/thrash/{begin ceph-thrash/mon clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6895091 2022-06-23 16:16:50 2022-06-23 18:55:14 2022-06-23 19:14:43 0:19:29 0:08:01 0:11:28 smithi main ubuntu 20.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_trivial_sync} 2
pass 6895092 2022-06-23 16:16:53 2022-06-23 19:02:17 2022-06-23 19:35:19 0:33:02 0:22:42 0:10:20 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/volume-client/{py/3 task/test/{test}}} 2
pass 6895093 2022-06-23 16:16:55 2022-06-23 19:03:48 2022-06-23 19:25:27 0:21:39 0:15:40 0:05:59 smithi main rhel 8.3 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_suites_pjd} 2
fail 6895094 2022-06-23 16:16:57 2022-06-23 19:04:09 2022-06-23 19:19:29 0:15:20 0:07:41 0:07:39 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/acls-fuse-client} 2
Failure Reason:

Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)

dead 6895095 2022-06-23 16:16:59 2022-06-23 19:04:09 2022-06-24 07:13:27 12:09:18 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} 5
Failure Reason:

hit max job timeout

pass 6895096 2022-06-23 16:17:01 2022-06-23 19:04:30 2022-06-23 19:19:45 0:15:15 0:09:07 0:06:08 smithi main centos 8.stream fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6895097 2022-06-23 16:17:03 2022-06-23 19:04:40 2022-06-23 19:30:45 0:26:05 0:16:28 0:09:37 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/admin} 2
pass 6895098 2022-06-23 16:17:06 2022-06-23 19:05:21 2022-06-23 19:25:48 0:20:27 0:08:49 0:11:38 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/alternate-pool} 2
pass 6895099 2022-06-23 16:17:08 2022-06-23 19:06:01 2022-06-23 19:25:40 0:19:39 0:10:26 0:09:13 smithi main ubuntu 20.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/libcephfs_interface_tests} 2
pass 6895100 2022-06-23 16:17:10 2022-06-23 19:06:12 2022-06-23 19:33:54 0:27:42 0:17:39 0:10:03 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/asok_dump_tree} 2
pass 6895101 2022-06-23 16:17:12 2022-06-23 19:06:32 2022-06-23 19:24:56 0:18:24 0:08:40 0:09:44 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/auto-repair} 2
fail 6895102 2022-06-23 16:17:15 2022-06-23 19:07:43 2022-06-23 19:21:30 0:13:47 0:03:13 0:10:34 smithi main fs/upgrade/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-compat_client/mimic}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895103 2022-06-23 16:17:17 2022-06-23 19:26:25 456 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/backtrace} 2
pass 6895104 2022-06-23 16:17:19 2022-06-23 19:09:04 2022-06-23 20:46:31 1:37:27 1:30:07 0:07:20 smithi main rhel 8.3 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_kernel_untar_build} 2
pass 6895105 2022-06-23 16:17:22 2022-06-23 19:09:35 2022-06-23 19:27:11 0:17:36 0:07:59 0:09:37 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cap-flush} 2
pass 6895106 2022-06-23 16:17:24 2022-06-23 19:09:45 2022-06-23 19:28:56 0:19:11 0:13:08 0:06:03 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_fsstress} 2
pass 6895107 2022-06-23 16:17:26 2022-06-23 19:09:46 2022-06-23 20:00:43 0:50:57 0:39:44 0:11:13 smithi main ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/failover} 2
pass 6895108 2022-06-23 16:17:28 2022-06-23 19:11:37 2022-06-23 19:29:20 0:17:43 0:08:50 0:08:53 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_misc} 2
pass 6895109 2022-06-23 16:17:31 2022-06-23 19:11:47 2022-06-23 20:17:08 1:05:21 0:55:22 0:09:59 smithi main ubuntu 20.04 fs/snaps/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/snaptests} 2
pass 6895110 2022-06-23 16:17:33 2022-06-23 19:11:47 2022-06-23 19:37:13 0:25:26 0:16:53 0:08:33 smithi main ubuntu 18.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
pass 6895111 2022-06-23 16:17:35 2022-06-23 19:11:48 2022-06-23 20:01:39 0:49:51 0:43:00 0:06:51 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench validater/lockdep} 2
pass 6895112 2022-06-23 16:17:37 2022-06-23 19:12:38 2022-06-23 19:50:05 0:37:27 0:27:54 0:09:33 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cephfs-shell} 2
pass 6895113 2022-06-23 16:17:40 2022-06-23 19:12:39 2022-06-23 19:34:52 0:22:13 0:13:57 0:08:16 smithi main centos 8.stream fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cephfs_scrub_tests} 2
pass 6895114 2022-06-23 16:17:42 2022-06-23 19:13:09 2022-06-23 19:35:16 0:22:07 0:14:52 0:07:15 smithi main rhel 8.3 fs/thrash/{begin ceph-thrash/mds clusters/1-mds-1-client-coloc conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/cfuse_workunit_trivial_sync} 2
pass 6895115 2022-06-23 16:17:44 2022-06-23 19:14:00 2022-06-23 19:33:56 0:19:56 0:09:03 0:10:53 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_quota} 2
pass 6895116 2022-06-23 16:17:46 2022-06-23 19:14:20 2022-06-23 20:02:14 0:47:54 0:39:08 0:08:46 smithi main ubuntu 18.04 fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_misc} 2
pass 6895117 2022-06-23 16:17:48 2022-06-23 19:14:51 2022-06-23 19:43:50 0:28:59 0:22:19 0:06:40 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/client-limits} 2
pass 6895118 2022-06-23 16:17:50 2022-06-23 19:14:51 2022-06-23 19:33:36 0:18:45 0:07:16 0:11:29 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file} 4
pass 6895119 2022-06-23 16:17:52 2022-06-23 19:15:52 2022-06-23 19:35:33 0:19:41 0:07:33 0:12:08 smithi main ubuntu 20.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/client-readahad} 2
pass 6895120 2022-06-23 16:17:54 2022-06-23 19:16:43 2022-06-23 19:59:14 0:42:31 0:34:37 0:07:54 smithi main rhel 8.3 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{rhel_8} tasks/client-recovery} 2
pass 6895121 2022-06-23 16:17:56 2022-06-23 19:17:53 2022-06-23 19:33:09 0:15:16 0:09:26 0:05:50 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_suites_pjd} 2
pass 6895122 2022-06-23 16:17:58 2022-06-23 19:18:14 2022-06-23 19:38:14 0:20:00 0:09:15 0:10:45 smithi main ubuntu 18.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_pjd} 2
pass 6895123 2022-06-23 16:18:00 2022-06-23 19:18:35 2022-06-23 19:44:45 0:26:10 0:17:38 0:08:32 smithi main centos 8.stream fs/basic_workload/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_misc_test_o_trunc} 2
pass 6895124 2022-06-23 16:18:03 2022-06-23 19:19:35 2022-06-23 19:45:14 0:25:39 0:16:00 0:09:39 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/damage} 2
fail 6895125 2022-06-23 16:18:05 2022-06-23 19:19:46 2022-06-23 19:33:23 0:13:37 0:03:07 0:10:30 smithi main fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-mimic 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic

pass 6895126 2022-06-23 16:18:07 2022-06-23 19:19:56 2022-06-23 19:52:02 0:32:06 0:21:27 0:10:39 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/data-scan} 2
pass 6895127 2022-06-23 16:18:09 2022-06-23 19:20:17 2022-06-23 19:40:45 0:20:28 0:10:38 0:09:50 smithi main ubuntu 18.04 fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/forward-scrub} 2
pass 6895128 2022-06-23 16:18:11 2022-06-23 19:20:57 2022-06-23 20:10:57 0:50:00 0:40:09 0:09:51 smithi main ubuntu 18.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_18.04} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
fail 6895129 2022-06-23 16:18:14 2022-06-23 19:21:18 2022-06-23 21:16:28 1:55:10 1:49:17 0:05:53 smithi main centos 8.stream fs/verify/{begin centos_latest clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress validater/valgrind} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds