Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7386691 2023-09-02 01:04:21 2023-09-02 01:04:21 2023-09-02 01:31:04 0:26:43 0:11:53 0:14:50 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} 2
Failure Reason:

"2023-09-02T01:25:15.652527+0000 mon.a (mon.0) 252 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386692 2023-09-02 01:04:22 2023-09-02 01:04:22 2023-09-02 01:56:41 0:52:19 0:40:38 0:11:41 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} 3
fail 7386693 2023-09-02 01:04:22 2023-09-02 01:04:23 2023-09-02 01:12:45 0:08:22 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} 2
Failure Reason:

Host key for server 'smithi093.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJ5SpGprLkXEA4auuXrNcnMBac44pPGe4erf2G6Uwhcu', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCyWN5NG66e3qSeb2+/2lGsi6FR+CJkXb+M5878MAaf/4juQUYRmOw6KCztWtgqxQXWPVOHa5j3iye+kTE+UfrguBhYaeqk1ZWpDfjIl5aHuJrbd7EISz3E8pAsuJQR5JCqruIWjygpWZyOeschjwptrzqPh65NrI1gNe9EDSUbJ+t+9GQRBt6vm6iSGs5V6i6XWRd5rBsfB2gQLf6hVr7nHAN/hJlwa6eikkm9hYn0TIYnMGQn8ybQcTPSe52m5GQzGgcgr2IzMZXf2puUWl4QzfFwm+awmhMxM4tnPuLHhs0RnBx+nIQxWSmjWvEr7I0o2PLdlN8FKuRKdmFPBzEWTVbH2MYhzCVyihgBpWVjLfJWOS7vA9OHCXS4BoyKSpqRgUvobLKObgHsMJCrpju/WU/fWgQ6ZbefUR3FJQd9K0lMfWrQ0/mFGvGMmrhBaDJZ46q9SmU46hBuAajOHQn+Nab1PzWPB29lhP6duwYOoKQi/TOp/KuKEJV1vJqCpDk='

pass 7386694 2023-09-02 01:04:23 2023-09-02 01:04:23 2023-09-02 01:53:01 0:48:38 0:34:20 0:14:18 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} 3
fail 7386695 2023-09-02 01:04:24 2023-09-02 01:04:24 2023-09-02 01:29:28 0:25:04 0:15:04 0:10:00 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} 2
Failure Reason:

Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)

fail 7386696 2023-09-02 01:04:25 2023-09-02 01:04:25 2023-09-02 01:26:45 0:22:20 0:09:56 0:12:24 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} 2
Failure Reason:

Command failed on smithi124 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

pass 7386697 2023-09-02 01:04:26 2023-09-02 01:04:26 2023-09-02 01:36:16 0:31:50 0:14:30 0:17:20 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
fail 7386698 2023-09-02 01:04:26 2023-09-02 01:04:26 2023-09-02 01:16:29 0:12:03 smithi main ubuntu 22.04 fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
Failure Reason:

Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIHfjna5+y2c8z/g/+Btmghy7JaWrgXmOqW2SBi0PYgqT', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCgcCFxb25c7XA8ZxMeIhkFGuyXxuNZ0ReGJSsrq/tSZB6ylb5ScYDncrOgCG/s7v4Sd2KqrcaWjzpAkgXLaz6bU/GnhRYKdJoqBtjfRH10Om9vreZTnBxmHxtDJVfdbCOEOzWMwNsq3v2G0KyCZDsQgmHz2/oDsPgkxPuSKbn7DN+UB+3ZrV00PRO62Xq3QP41v0/wR83jIgLdKNT2o/NPLJHgtUhDf818SnnP95Ed/E8/k0kGW2EywKnjG8qO4jK89pQih9JSW7+g29a4Dt+xsboNw+sefD373hjB+IC6x5anVUQfF5OpA2QOhr3xcBSWnQq77K38qCBtmD7VprNhq5YPTwX6pPWsiq+w36esK/uzf8J+0C0EmdCUaUZw45gLbxqiHPas3DaO90DmwMIUj72QYCC83cypXANOTCbfhy1XN6yHKWJTL2PdULPYEZMasZIaSGsqGhfzUeNGx6+PifFX9pRUfakeFyniBgon3hKvsL6nBsEp+bszJOpRuI8='

fail 7386699 2023-09-02 01:04:27 2023-09-02 01:04:27 2023-09-02 01:27:50 0:23:23 0:11:38 0:11:45 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Command failed on smithi042 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386700 2023-09-02 01:04:28 2023-09-02 01:04:28 2023-09-02 01:23:50 0:19:22 0:10:28 0:08:54 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

"2023-09-02T01:16:51.445844+0000 mon.a (mon.0) 186 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386701 2023-09-02 01:04:29 2023-09-02 01:04:29 2023-09-02 01:59:21 0:54:52 0:40:17 0:14:35 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} 3
fail 7386702 2023-09-02 01:04:29 2023-09-02 01:04:29 2023-09-02 01:18:03 0:13:34 smithi main ubuntu 22.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} 2
Failure Reason:

Host key for server 'smithi173.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJ2QgIwzcZ9y5sisDbqg8o8/xnSxz13wof56Prs3QeEn', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCr5QSOhkX++BSdoGfZtWvcn2YTacWQ3sfpRf6mL7WKm+g6JepXcWIdbFhmEQ0Wutmb3PFxFSG2qtqUrg8T3aJGByOJRmHTgap/tX1Zl2PsBsIpwknqUTXge7JIoj0OwJ02qf4BNGu3I6SWU9ZK3aTOiCTkQGCzSeOVn5y0RqzJma5jUKW2rvpzSFDuBLWrAeMnqWTjLrV9wF4OQi0xL1x0mqwRbSgP34qWF7Ei2s7s4RH/vu/1RZnV7fiy6+LwBjlF17rRnii3apYtipFE09XJlw+AlQ15GBnDDQMEYDASoDyBOcSza/k0J4AbeHOiJuXrmvVdX2OD/2XFCFIDkmUFXX1B7uy88UqgzOVLx+0r00hT+d3909HMakwSMvIjPVTAt/BWfbsWM39EZVPK7M7waLijtsfpesM9j26BOeQfZjrwExe5PPu3WB6uo2j03M6La0POW9HIrDkqey4UD0l+nn6ZyqHMbFroymX4CZ6Uf91VpHdQvkiUuXQj3z+trFc='

fail 7386703 2023-09-02 01:04:30 2023-09-02 01:04:30 2023-09-02 01:17:13 0:12:43 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} 2
Failure Reason:

Host key for server 'smithi097.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIImUrwqDLKVvSGsEWfds752ApEoo4UucmgKJ+jzAhKtX', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQD0bdzCebIPvnj2DJYPXZG7oeitjm3x1jJXR4IifxxY9TqvHX6bc+Ao8x2kd39cif9jOJFHxCe24qewXEELaqD29r2hKRNSASCZB77ne8lDsfNgMZ4oaKd9pQr3h5bNqTXp7Tm92cilhFWfkavEZVGLAW0BsdjqQJlj5/fQ0jaIrJYZCpqdqQI2WcGFI2NeHSbmSK39pR5y7nxTMiOZmywAvFXMDEf8Ywuh/jjvtl0l//8QK8tXWpaITtvseLBLaDkvw5VICF1C+5x2wkJmxFEAXAm3xyz3vVGXu4BtHh8EeMF3p+2b0IzTNuGlhX6jKSEjLSvenqDkHzKsazwX3vcl4pAucmoztk30Fibx+rT5yjX/hcljnf9y4kQxYrurh7QO/mwH9yuG62gsCwPL8uF4CQJlk4HcwYuGpchwQfAIZZz0jsACF9R2Nd0s995u8d/wlCAqFPCp4pCH99kURMmXX/nwJWHgGqTnh3WGA9MTe3mouGdHs9Dvw+Ju6K5F2SE='

dead 7386704 2023-09-02 01:04:31 2023-09-02 01:04:31 2023-09-02 13:16:37 12:12:06 smithi main centos 9.stream fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} 3
Failure Reason:

hit max job timeout

fail 7386705 2023-09-02 01:04:31 2023-09-02 01:04:32 2023-09-02 01:19:33 0:15:01 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 5
Failure Reason:

Host key for server 'smithi141.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIL1z7o1wmqyT3ZgCd38P3timJ1j+waW/CzJRFL8/bK2d', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCF0pcjt6Dlks6Eb4dTpNdaCeSy2fnp2O16ENDjXII4kq5gnTY3L5Y8HvYCG7I/XTJAdI89bomkCAqTocubX+c+p0NGA69W9qm46wdzjr7GerLG1BIuALUtkFMDRwZhOkQ2mNq1736NU6N22mjQJoH8Kxulw5VdLJl8J4TJBBQRwV1TeVmyd29/9s/gOagTANSpWbrEYaueafBYdQcWwkwh4xSUewpiPaB13MHB2Eab4LvM2kMxAmosuRMYRD9QGQ4yPs0DETxpNDGkD4mITa4F1VUkigJUYYxgKM/9TpfQ6JK0jkbewG+nkuQWOZ3irhiQUhmEKAQnwCZTh0ERfB5MQ4JFZb/NNWU+mla3jRRzdwZHjwL6bt4R539GGZtAvk/AyMf8Pk7/pkWxnmxMKUxPZO9b8RMiHUC0u7FbcIOBsxJSE3ruJ+SI7vYbSuZYPOeC4Rwx0WD0gAgCVnYZndUXhTG/K4K7Fzv4yirLobo8gZIIHwZG8/v4mU2/4dYhiLc='

dead 7386706 2023-09-02 01:04:32 2023-09-02 01:04:32 2023-09-02 13:13:51 12:09:19 smithi main rhel 8.6 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

hit max job timeout

pass 7386707 2023-09-02 01:04:33 2023-09-02 01:04:33 2023-09-02 03:24:48 2:20:15 2:10:55 0:09:20 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
fail 7386708 2023-09-02 01:04:34 2023-09-02 01:04:34 2023-09-02 01:26:52 0:22:18 0:11:39 0:10:39 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

Command failed on smithi007 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

pass 7386709 2023-09-02 01:04:34 2023-09-02 01:04:34 2023-09-02 01:43:43 0:39:09 0:28:37 0:10:32 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} 2
fail 7386710 2023-09-02 01:04:35 2023-09-02 01:04:35 2023-09-02 01:30:56 0:26:21 0:18:18 0:08:03 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7386711 2023-09-02 01:04:36 2023-09-02 01:04:36 2023-09-02 01:25:01 0:20:25 0:07:44 0:12:41 smithi main centos 9.stream fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} 2
Failure Reason:

Command failed (workunit test fs/test_python.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c085c84adafd662335e941b0b7b9c406c85078a9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh'

fail 7386712 2023-09-02 01:04:37 2023-09-02 01:04:37 2023-09-02 01:17:52 0:13:15 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} 2
Failure Reason:

Host key for server 'smithi183.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPd3z/6y2UmX8a/bgkTLh9vRureYBg2xL6FqdZfDaj27', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCdhzxUo3cXBZyYSVBmhDfRqZsH7OmF+k7JA9qjkPRxbU+Y91JtKEMvp8T6TEurnGNh+x4gocKEvod4xwobMvw8vhyuqOrGDl0ZfHiAjQDGjkys9exp5s0y4wNCAPtnSlyGDGXDIL+Jge2IHUb4p7UIdCsHgLdPOofubTxYhgNdG/RoFGxe6j8UbppZkUtaF/sbuRa7c3/oW8O39CpP1HsKUjzvQiE5KlcDcT697ev0FLUsPqGXNflktf8EHvU+3QgDUNCefW6IoOSJG2IeGTZRtPvlG/LxtUOBUg1r2Nii2v3qgpgaR8FbgPUTnEljiqgR23cGP5CZAYs3NIs0C0qXWOXcehsbqg5rgJBH/6Mx7GiTWa8WMyt5sr8wuyda7e+kxDdOsIPFLC/gKLMwrLchOa09jIgaF1bAeFQq3Jp+jYGu8TptbmdhmbllAeK2wVIXA/dGGloqMagYMW+ToGlz6IKEpsW/XOQIwc8ZIdoawVUOBG3taBDzd6jV/oSwBA8='

fail 7386713 2023-09-02 01:04:37 2023-09-02 01:04:37 2023-09-02 01:53:06 0:48:29 0:30:09 0:18:20 smithi main ubuntu 20.04 fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} 2
Failure Reason:

saw valgrind issues

fail 7386714 2023-09-02 01:04:38 2023-09-02 01:04:38 2023-09-02 01:32:47 0:28:09 0:10:55 0:17:14 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Command failed on smithi123 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386715 2023-09-02 01:04:39 2023-09-02 01:04:39 2023-09-02 01:17:42 0:13:03 smithi main ubuntu 22.04 fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
Failure Reason:

Host key for server 'smithi149.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDd6duO11mRVyqhuzhxlpV+PTlHsf8mDTFEH40EmZ15+', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC1PMUnG76RsAnlEz5oatc0uGC5Pw+3KrnPFp3PnRIhz6t2OYfzHltrwRgr7kawR/H0417pzi91vxReguaLYB9nsMUqSVTHICan9Sb74J//CXjvlGuy+z1v9jftPds5xsb/JBnKZR65xNynM4Pm4MAH0Z9eXmNB0N7SYkkGcbY4nbIt8SytZHcmwxURfjGAWNnsd+DxgR66q5Yfyh3h4R5yI45VgpP2A6fcUGCD8h4jU55rysgMJxyIvt2dEfrNrOuNv4AjAL4uf8N8SX7lcDXwysu2+KuGy6AwFwLJXruxolzavlZga2hdPsDYxzcrm6KW6X2vHDdjWpbihkDRzVVqwpUx5gNqRVv1WcXrxMixQ6MAXZNIa2Wydp/50jgv7K0cu1giFY61j4IHZZ+Srvy6HNi7UEZzg317RSJpQ/u/ctP7xEfF02vI7JW4kl4SCSupMjMWskgG4T2pB0qs0r6/o09IpsvXnzerGkMIuBKjAokmyD/bQbEyQ/d2s6fFWfE='

fail 7386716 2023-09-02 01:04:40 2023-09-02 01:04:40 2023-09-02 01:32:20 0:27:40 0:11:57 0:15:43 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} 2
Failure Reason:

"2023-09-02T01:26:22.463484+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386717 2023-09-02 01:04:40 2023-09-02 01:04:40 2023-09-02 01:18:40 0:14:00 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 4
Failure Reason:

Host key for server 'smithi184.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPd/VI4W+lOLvjJmfW0bBHjSKVEWJXhbZyxBR00rgUwL', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCfr6fuG41jS6TYteu9WpDiK7ulUs3gib2JrJqSVwDXcp0N43qLRJprGK+sdVcwUq98Tg3aDzFTCT3+P70y0xMfT0CHc+75DuSBedhjOc5/mG3lgZPAHTztdU5nbyZbtArMkxXemE1kWMGbp5GPUPV8CHjnftBvzCDjcB2Z41Lsc4E5tITEde91wHUrEhJX6CljkT3PNYirfiZYSgnT3buY+7KvBsw5ZeX+3ROxo3nZNvuKl8o2CmDuvketi/9JGCId3JvsBJXZMUbba61XMOmBc1x85YlXQMrCJzJcVmOXhFxbUepFXvN34xTlMh0fP5EHwFSzhB/mKLRNRHMLfZHDiTW3+mN8h4qdJmEFDMNhPvF77MPl0OJ/zXO/PjttF9VtJH3VCeMu79Ra5lKLEazUBM+QJ8aWQLBtTUk4QzVQy8X7VUJ31zuWyPEFgtcCNGChym3/8Nwh0YDUrQrW6BI6Q4o2tbT99WPWniUNuwhmKUvlUrYHCz/o/PmnkB28rZM='

fail 7386718 2023-09-02 01:04:41 2023-09-02 01:04:41 2023-09-02 02:32:20 1:27:39 1:12:50 0:14:49 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

"2023-09-02T01:25:03.673451+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386719 2023-09-02 01:04:42 2023-09-02 01:04:42 2023-09-02 01:17:29 0:12:47 smithi main ubuntu 22.04 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

Host key for server 'smithi077.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIPMHYNG1eseoLyP3f2NP8BKIAKkSxgQ7Z/SQuh4oOwuk', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDLgF3XXo7lgtOtQn2ulSeeu+jntzJWYpqw6mZ0DiyLIr49GqZHB8Fe8COVF4npq51pZBI/orf8yecLqZWaJHB2152VGKE0zeMT+dCpCIKcRskWJWnw+SzWDIPDOmSYLvFw+mswnC6MEbWFHdaRc31Bm3wSfdyRCJWc3oWFQjfEhPxzenSse+EULN2m87tWyDupmkK8f8dyZLjYGsaaDFBFKT/xzeImyQ9wnosOVMgZOBxZABW5Onlfvm0AlMxQJ1cx/o/59XJf1s+By05W6uw7zf6bDEqsKVsLSRy8gQT50wlhsnsBpooLlKXjSBKIcZZQRAivak8JZVXfeZXZbqGlIUJGd5HQyQkQvGuTdoVN1CO8mZ2dPnd6ysLPyHUgGrOjzGievwVfYmJfIJhG4pTp8W0OE/Xglv7Oj2kfgczZMwKu4C+0DvDTLw49Q/YmW9dXe+/0Cf84DaM0tAVkQjgkMMc6KRNbp+6EYRNNW9RUa0FDHsmwPDRuOHkb3CUIc88='

pass 7386720 2023-09-02 01:04:43 2023-09-02 01:04:43 2023-09-02 02:12:38 1:07:55 0:51:07 0:16:48 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} 3
dead 7386721 2023-09-02 01:04:43 2023-09-02 01:04:44 2023-09-02 13:25:54 12:21:10 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} 2
Failure Reason:

hit max job timeout

fail 7386722 2023-09-02 01:04:44 2023-09-02 01:04:44 2023-09-02 01:29:49 0:25:05 0:11:39 0:13:26 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Command failed on smithi006 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386723 2023-09-02 01:04:45 2023-09-02 01:04:45 2023-09-02 01:29:58 0:25:13 0:11:17 0:13:56 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

"2023-09-02T01:21:34.524230+0000 mon.a (mon.0) 149 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386724 2023-09-02 01:04:46 2023-09-02 01:04:46 2023-09-02 01:29:42 0:24:56 0:11:39 0:13:17 smithi main centos 9.stream fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

"2023-09-02T01:21:44.384789+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386725 2023-09-02 01:04:47 2023-09-02 01:04:47 2023-09-02 01:34:53 0:30:06 0:17:44 0:12:22 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} 2
Failure Reason:

Command failed (workunit test fs/quota/quota.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c085c84adafd662335e941b0b7b9c406c85078a9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh'

pass 7386726 2023-09-02 01:04:47 2023-09-02 01:04:47 2023-09-02 02:06:49 1:02:02 0:45:04 0:16:58 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}} 3
fail 7386727 2023-09-02 01:04:48 2023-09-02 01:04:48 2023-09-02 01:19:40 0:14:52 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} 2
Failure Reason:

Host key for server 'smithi144.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAICscwU18doVcjsD8alpnsyedzuCDTvDGIcKH4YiZTYka', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC0QePstQJ5rzFc9uN+Z4u9iOaiTSiNh5579frJCtuik0UickLwGb7bl8JH+PpncZI7StT25IdfU0hSiAYssJaNq3ru5apyajvphEGEcqRIRZd3ApgN+OXPDjvTSThSSSMQjYi4zFop8hVE1ZIq4/A7Ea5sI3nW09Nu5HzpVeBA2wpyvBjvw6QxljHmxaB6kiDU0BLKb7lUHoFy0t7uvH+7/kg1efdTEnnX8rj8KTaCz2JXZfhPNnwIzbG9+DmZROkLQdTLMGZWvSkdBHb9w8eiAr0FHUN5WVcyk4F2QjaEHbJuVv8mb56qJqJ3Mh8TbFZa13lVl3heoJBKVp4g/UF41hpWmCACH62vZJUNMj7NZDvUUixIR3g4iovVFgMWC+O7odhxFw9rMpwLdPJZko6k9GplHh/v0YFHk+id57mMMIYgJdy0yvxm5g7otvGQfNuDxPmFLCocZCcXxZ22MEzFI2Jboihzp/zmpp2TKBCbLRRjaMfV3MkCHHNIUae7pmk='

fail 7386728 2023-09-02 01:04:49 2023-09-02 01:04:49 2023-09-02 01:24:39 0:19:50 0:08:02 0:11:48 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} 2
Failure Reason:

"2023-09-02T01:20:42.616929+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386729 2023-09-02 01:04:50 2023-09-02 01:04:50 2023-09-02 01:32:20 0:27:30 0:11:59 0:15:31 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

Command failed on smithi008 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

pass 7386730 2023-09-02 01:04:50 2023-09-02 01:04:50 2023-09-02 02:08:05 1:03:15 0:51:17 0:11:58 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} 3
fail 7386731 2023-09-02 01:04:51 2023-09-02 01:04:51 2023-09-02 01:47:14 0:42:23 0:24:33 0:17:50 smithi main ubuntu 22.04 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
Failure Reason:

Command failed (workunit test kernel_untar_build.sh) on smithi170 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c085c84adafd662335e941b0b7b9c406c85078a9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

fail 7386732 2023-09-02 01:04:52 2023-09-02 01:04:52 2023-09-02 01:30:03 0:25:11 0:17:16 0:07:55 smithi main centos 9.stream fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
Failure Reason:

"2023-09-02T01:17:26.072592+0000 mon.a (mon.0) 150 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386733 2023-09-02 01:04:53 2023-09-02 01:04:53 2023-09-02 01:35:42 0:30:49 0:17:12 0:13:37 smithi main ubuntu 20.04 fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
fail 7386734 2023-09-02 01:04:53 2023-09-02 01:04:53 2023-09-02 01:20:55 0:16:02 0:07:36 0:08:26 smithi main centos 9.stream fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} 1
Failure Reason:

"2023-09-02T01:15:30.824655+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386735 2023-09-02 01:04:54 2023-09-02 01:04:54 2023-09-02 01:15:50 0:10:56 smithi main ubuntu 22.04 fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} 1
Failure Reason:

Host key for server 'smithi110.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIBs3fimkTYa6hxggLrpNA5PsopQlseyRtaWUvl9qOE/s', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDAcsTNnRHZrk388jboeM/fF7p3AXlOiYYoC21Y8X14RBVdsueYLKhN0QA7QGp4BBBP6JXB4eDO78BRwSo6ap6L4bgIPEfD4jTUdMNJ2vxPyd/RmS2NzxPnEryRwDIUS4V5EPzvfqHF+SpBYhrTv9AB2MuVpQTWNAMAkmEoWCWenaQHSoRvGQFgWjFY4IaC6U1FMQ9eLRuAut3PMnxbJxT1iUKb9qw09+C0tlEtZEaejMikIZVLQDVmRe6p0BQ+bHpoXJ+a/BghWEXXYBVgkfN+ot61EDN3evYbIxJH/yuejf4SZC3tXUJmCAaAASiR75cWXQGBnvmijS5DQRY6o81fxxeiF2WIqh+S1E0wJ1IH6Q26CgOuPrJKgYvrZyAR4mFK84o3Ej0iM4VLt7CeX2zXvltw499/rUQu3WM74XbJpv0U/aHbR/F6dEG4jxihTiifwF7+wBCnbPKAYBMBbb4c5hra/2CboZDfp8hS78DMCTv3KS1VWfJgrn+DxamfzpM='

fail 7386736 2023-09-02 01:04:55 2023-09-02 01:04:55 2023-09-02 01:19:04 0:14:09 smithi main ubuntu 22.04 fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} 2
Failure Reason:

Host key for server 'smithi152.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAID4/dYjNimwXoGxr5J0uSU3pfcTHf9kClNusASo+fzgA', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCW2xf8sc/z9FeroTpjtq1uFyfhzXb/EkPjLV3qzdHov5zPlzpHano9xd2XSSeGoBHDfeTJ6QWIS0WBohzWuILCGIuMVWN66z94tL3FlUHoAW6t51EE8KBBJD4V/oqWISEm7Ej0i/WspNJ/kXW3nfhgDY49TcZmP7nNSre5f+aRiVU7Bbkbl75thoPqcPJrsFv3Hc4qaqeuq3I6fshGfC+ppjV0shARCfOuAISib2YSJkLtg4onohKQSmUU0zQbnTo1BFAalKEOg+s5EXCIBBO8tdWMiEPoFL4ra5P0gN43fGZ9z0IBj9jV2pN3niM9O4zDO0Wet0Ofyi9xwpKLovoaDZbDdLdMfXuVI2uZ3tOuAeEvsRvc0twTzytIEvHGcftn6JhPMcUb5Ye9RT7l5ROPpgPP8aWAx7dsof8UTKSARCy/7lLJdJL+ls8R5Ni05CGVRzZUUdUFtIHbGKTXeUghZXXn5xHRvYMW7aGsPS59X9lAE8hTXnRofIkaX7o353E='

fail 7386737 2023-09-02 01:04:56 2023-09-02 01:04:56 2023-09-02 01:17:41 0:12:45 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 5
Failure Reason:

Host key for server 'smithi046.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAID+OQ5CVMJL3iHHEAa/jxQAgt/2KdYYzYy2KkAPAQhW0', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDv63Rn8WNUo8iI27vteuDXMryU4QH9ckGcPDFhTn00peQO0MbHwpF9IE+HySKsKTNUXpPfsZOaoGASfSTIUuaQKMbpVE8SbkBNSRqjp+HHrusGVInnFfdLalnDp50xPxbKWnuYuM+Rq/6UvEP+dvwEC8XoO2TZSvBp+lIsoWwoZWcpm5qZU4IidXLCY4kUf0BSly+qt2eQCBTH79UlmaOvG5ANnvA4OTCPvGQN1MZGJon7V3MFI0p4s3pSpZYes95GFWApLETLFca4KfGfNGMQ5SKt+2eqU2O9hBpwZzYt/aRhyDZrk6HjcKTPWi4tfRgRbbR+iRWGB354ZWRBo/adW9NKVuAnjvQKS0lcb0636WzH3EhIHg6aLvRjJy62d5YzjM0r23g4YOy7vU/6UNj7oHlDgpdjl/8mrbwPJmwg0LZh7Xwsyb1j9ivTNUZ7Rozj3PF7ETSud6wEYCFxx2RoB8Pwnm5EXZwZbw4amFKyXDGY35rWUjKX5lb2Rv9BObM='

dead 7386738 2023-09-02 01:04:56 2023-09-02 01:04:56 2023-09-02 13:15:47 12:10:51 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

hit max job timeout

fail 7386739 2023-09-02 01:04:57 2023-09-02 01:04:57 2023-09-02 01:27:55 0:22:58 0:11:01 0:11:57 smithi main centos 9.stream fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

"2023-09-02T01:21:42.800702+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386740 2023-09-02 01:04:58 2023-09-02 01:04:58 2023-09-02 01:19:22 0:14:24 smithi main ubuntu 22.04 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

Host key for server 'smithi088.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIN1TsfUbicrUG9DyfeQ88+tz3SBWlSCS5XggOx3Qkn1f', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDEARstn4P5i4DzlVnbubfEVC06kksZLPIvYa4b02Orm6MQWuMaqtoKOk/hbIDmWyM6xeRtNb0gdi64qcnmpwV4Wj1Zw+h+AQoP7oI0jaHIg8L8i0rpBojfkOblK52QV1umih/15rFzc/+xFn7JnxbyUiuZn2G5n4VMgpMEsmJV5K/XONYnt8nCnenSGXntdX5xfgJrlhIa+sD61MmXrm4ePteHy9MsKw9geuid+tpnJ10eI7jo6gS/wsfoWM9JTzjAxK1h7zBF3qFDutnnznfTPaKvipY+rJRB9pLWyWB/dtka+eAzIeTMiGAJ65dWiOFyS8Al0YBFg1xnVaEy6Fl9YNZE9bfdInHbvbSQmd052Du2ri+//KFxS/s+YT+IDt7CZRHta76uc1D9+HanwchT7dQxq2P5tGVE6414xmoafEpAIj8fbX6CyNEF6GQaFOi+77yZ63wOwgmSUTuCF/bRlkjoTHYPYFsoXxqrVA4d7mJ2JNVLAQWrdYycFwHOI4s='

fail 7386741 2023-09-02 01:04:59 2023-09-02 01:04:59 2023-09-02 01:18:12 0:13:13 smithi main ubuntu 22.04 fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/fstop} 1
Failure Reason:

Host key for server 'smithi187.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIIu+EkX9Td/A36+3DC6YwFQ/PUBVPfW8g/x0R3WiGgMg', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC47xu4iNjNpGFatkGQPGBBIjBXrw+Oh9DRfpK3rzdDWFfw3FSLwFh3LlkNqcoBpW2+g/XKd6mP69GWvLbaOZVE3tGP52ClttnfMWhScy42k/pWWXpP4gZSWhRr1RjArx3Nr3uJfUQz+3wMevtkz1sMl4MGjM+Yryx3RjtALbbCdKxM1tCpYf8qr528u7X2rER8OQeTZvWsPIXmbOOgh0IGMy1wvzDkyITMiouAAtBaQgwh3FaBk1hO72/Cd2vvSEDA6H0x7smq4LBMdyl1Th7aOyqEkLQh/6nJ+TejCC/yGYEYWjco4W6kIBRzMOzvLHpZ4p36b+Qbc6ZExArokaMiBRc0i4JDyLIN1FCrLYekqeti/0u7ls3dXcrsbcYVLnNgzNk2GbDR0JL4axTpVwHX4qp/310h/Scs6Lrm0eOSCFWO0BUs8Zh1smSUe5fLGlJd0N/TieqNZBFFOqrDFDpHJm+VVINT/AZwvKhFOu0fK7A2ljXtadDCXko3tHU0+RE='

fail 7386742 2023-09-02 01:04:59 2023-09-02 01:04:59 2023-09-02 03:18:07 2:13:08 2:01:26 0:11:42 smithi main centos 9.stream fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} 1
Failure Reason:

"2023-09-02T01:25:02.068372+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386743 2023-09-02 01:05:00 2023-09-02 01:05:00 2023-09-02 01:28:00 0:23:00 0:10:54 0:12:06 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Command failed on smithi078 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

pass 7386744 2023-09-02 01:05:01 2023-09-02 01:05:01 2023-09-02 01:56:01 0:51:00 0:38:03 0:12:57 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} 3
fail 7386745 2023-09-02 01:05:02 2023-09-02 01:05:02 2023-09-02 01:39:41 0:34:39 0:19:05 0:15:34 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} 2
Failure Reason:

"2023-09-02T01:26:26.657009+0000 mon.a (mon.0) 157 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386746 2023-09-02 01:05:02 2023-09-02 01:05:02 2023-09-02 03:38:25 2:33:23 2:17:06 0:16:17 smithi main centos 9.stream fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-iozone}} 3
Failure Reason:

"2023-09-02T01:27:03.771489+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386747 2023-09-02 01:05:03 2023-09-02 01:05:03 2023-09-02 01:25:09 0:20:06 0:09:21 0:10:45 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
fail 7386748 2023-09-02 01:05:04 2023-09-02 01:05:04 2023-09-02 01:36:56 0:31:52 0:11:22 0:20:30 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Command failed on smithi059 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386749 2023-09-02 01:05:05 2023-09-02 01:15:56 2023-09-02 09:08:31 7:52:35 7:45:27 0:07:08 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} 2
Failure Reason:

"2023-09-02T01:27:28.139699+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386750 2023-09-02 01:05:05 2023-09-02 01:16:36 2023-09-02 01:57:15 0:40:39 0:26:55 0:13:44 smithi main ubuntu 20.04 fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} 2
Failure Reason:

saw valgrind issues

fail 7386751 2023-09-02 01:05:06 2023-09-02 01:17:17 2023-09-02 01:25:27 0:08:10 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 4
Failure Reason:

Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIC7lIic8ZLn28Eu79yvAjlVrY5egNkr39QTuwRxYMphH', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCsKeH+pfAgQseJeYALNyr2ZUrUZYF5bSsyhVbYpHMgBHNHtyCv22M6+pOBtfwBEpBOOfxS4GuEJGatSFGNmC07YuCuQIRD85zRzXad7m9JCJVcj6JBiWwUl5QDOOmqocR1drWTiGEilsx0F3wFnj8jupxlk3R3H+w6hmzsnvEFKRHEpJGho2px/kRxIeGFHpcs96bmQ8ymhBqVDCTwVTxUpfBawyeWJyt24ecRX1GyjwOPcDNwUDuORMkgHWTpiKAXKbMJBdDJ1uiKfhef2Mj9gA255KbOt0Eym2bX8krU+d2FiTdZto+7IqtRsrY6I3FnN2t5PdWCmJcl/QRDmcCXGvXscj3AgdqySICzCiEzk60a4NPt7uELc2mmKNJVwZADcIsAQonovgGblD/0JshKVJBTuJ4sVLbif+Ee/usLmYFHTla+T48Ja3uvTYpIR3JsiCXVOq9q/dyd7u0m9co1sb3NN4Ynhvft2I7lRPjIXRLEeH9DKL3EJ7S/aNS9oBs='

pass 7386752 2023-09-02 01:05:07 2023-09-02 01:17:47 2023-09-02 02:38:45 1:20:58 1:15:16 0:05:42 smithi main rhel 8.6 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
fail 7386753 2023-09-02 01:05:07 2023-09-02 01:17:48 2023-09-02 01:40:48 0:23:00 0:12:45 0:10:15 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} 2
Failure Reason:

Command failed on smithi046 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386754 2023-09-02 01:05:08 2023-09-02 01:17:48 2023-09-02 02:13:25 0:55:37 0:48:13 0:07:24 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} 2
Failure Reason:

Test failure: test_export_pin_many (tasks.cephfs.test_exports.TestExportPin)

fail 7386755 2023-09-02 01:05:09 2023-09-02 01:17:59 2023-09-02 02:07:08 0:49:09 0:42:53 0:06:16 smithi main centos 9.stream fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
Failure Reason:

"2023-09-02T01:28:07.439805+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386756 2023-09-02 01:05:10 2023-09-02 01:18:09 2023-09-02 01:40:38 0:22:29 0:11:23 0:11:06 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

Command failed on smithi019 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386757 2023-09-02 01:05:10 2023-09-02 01:18:50 2023-09-02 01:26:19 0:07:29 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} 2
Failure Reason:

Host key for server 'smithi181.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIK1KyS3zIEFHbrpbjdQQy8eGUdMJ06f7lfyv43wkt2Fb', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCURBCz4YaXieURDkEHkLUIngSDnCFQjnniF2D+NNeyxDKTsGQk5UUqnsJbKGe1ikRhC8sAe6b9hTZCLcx1+pVgI1ZWSoYFzBiJ0rSjLvhJEji7kjnmdeVjvhWhiLofAmbJZFL9OcBYvt86lvkFukLYjJ1w5BCVWHNodqj3xULpZnfyUw67312CHcAlfpLQ14gRRjbFcDUTeuI/ZZMOd3rZCBB0j5oT5W9ECYNfWaeD0W1ssHQ9+XcYJt8flB/m+zRrvq4106yr5aRrgLhM2qk6eSPJWlqbxPWFlPT8yLffTMJu7SdNBr+WvAqGi4hG1Rm6s7dT1HDBQ/hvwYafqd7abKpfTgsbtqIffa5NdkhMDx5dGynfA8MXLxPOqXWKOyC83FAoTl097U2gJ3CcyJddtP9+F6dakzUgMeG4bYfEfbzDHEzYTY+kOxgEvAw1vq0JQ07jgXWK+UUbysmRHbvnOV1r7qtG/FoxqfbWLPewhHFm+AE0icz9iQncRnK/aRs='

pass 7386758 2023-09-02 01:05:11 2023-09-02 01:18:50 2023-09-02 01:42:11 0:23:21 0:14:08 0:09:13 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
fail 7386759 2023-09-02 01:05:12 2023-09-02 01:19:10 2023-09-02 01:37:00 0:17:50 0:09:46 0:08:04 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

"2023-09-02T01:30:22.776913+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386760 2023-09-02 01:05:12 2023-09-02 01:19:31 2023-09-02 01:37:19 0:17:48 0:10:36 0:07:12 smithi main centos 9.stream fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

"2023-09-02T01:30:33.749407+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386761 2023-09-02 01:05:13 2023-09-02 01:19:41 2023-09-02 02:56:52 1:37:11 1:30:46 0:06:25 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} 3
fail 7386762 2023-09-02 01:05:14 2023-09-02 01:19:42 2023-09-02 01:40:42 0:21:00 0:11:02 0:09:58 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Command failed on smithi079 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386763 2023-09-02 01:05:14 2023-09-02 01:19:42 2023-09-02 01:28:37 0:08:55 smithi main ubuntu 22.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
Failure Reason:

Host key for server 'smithi119.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIB4mkPz6WW7wmyPyep1QmctB5/QRuydQ5rfxL5DiyV6g', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCcY/ZMXh1sm488nIXOJq+3dBWeDvSeZ14C9bSmSMyOCDAX29qFMz+2m9D97j8bGlz4brif5CJLPtLA+vBK6/yzhffZJb4oT1Y+Vo06gKURdOYDYyQA48aQ98dHM1isas73oolyguyQdD+Irtrak1HyUvIlzw9zplT74pOJwuPrsWB91ksaV4WNAJMKK8rvTzv2RjuNV2Yh0LYePV0jNLi4XeChF4pTxaKD3SqXsJKlmK6UrVT4G3vrZa4sd+0iqhJKsGEFSg858aiFmSrzhmiJkXhtgeAnGTKoVZVrIYpJXjdJkfBoHwune2MXtCd69RFIbnIYlC8IA4jzEMS10T6QQayS7jf7c42manMyVSuw3okrdDtKvm5z1/y9DkQF3tGTXL2AgJYE0r5qvNEXx/aYJDJwNPgRWN66MS5x83aMu640rmzTmvf/fItSxdyoeJn4mEn3d85XyVrppBKxQL28RlJ4zPORyKW76jsmgSfTClJ5mqtO8D0p1igUY6Lu2Mk='

fail 7386764 2023-09-02 01:05:15 2023-09-02 01:21:03 2023-09-02 01:31:32 0:10:29 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} 2
Failure Reason:

Host key for server 'smithi155.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAICIqMpbUL3JGF4AHPexGGQnBxFvGIA+PaOLyflaBSrgs', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC3IVVQraQRAvogAPiZq3+iwMptfsPaUoNiLyW/73d9sqxDJgAeW0yVfU2phOCHGrG8wDIYUrs6FMmvT0cvYeFsR/hgups1bHYeE4w61Xwqs7Iox+AZEYdOzT5o06QGYhgBLiQvEbp5Iko4/aW18iQqXdwgaoX3NJDjZclcfEEduAg76vG0RqlLnHG7osP3EMTC9hnZYgRpAVEER88cghuSGO+jDYCI0mkkuY+2iecWcVkVDllvxVwVa+WUm3FSRHxArL2bFh1l8VsjduH12w/BG7QX1t93TdmmU0iq4PFVWlyegJ9B9M8R0ogV29HG3AszEkRsWQNvVrAFZwJ+pOxp6av3A3pZpkGqN8oKiAuQ9Ee45o6AM9tZozTlzk6lGm8sOtV8MM1st2xMcufH0hlWZGLk0TtmWVBQQ5d77T/lVtIcF4W3PV7bDNIaCIgf8BJfo14M00ZzcPtrf418lgLzyI0Ylp6BbxLoE8liU/Au/uiB5321JLzxdPCivjHFXkk='

pass 7386765 2023-09-02 01:05:16 2023-09-02 01:23:54 2023-09-02 02:08:14 0:44:20 0:37:40 0:06:40 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} 3
pass 7386766 2023-09-02 01:05:17 2023-09-02 01:25:04 2023-09-02 01:48:18 0:23:14 0:17:26 0:05:48 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} 2
fail 7386767 2023-09-02 01:05:17 2023-09-02 01:25:15 2023-09-02 01:33:15 0:08:00 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 5
Failure Reason:

Host key for server 'smithi121.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIN16Ld9sZ1KqNlrOpDGrk7Lkx4pe0eIMTVrgcguDmQau', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCvxnC8HTx2f+WtGzPoV5FFdJMelgAMhvDf8sabyGCSJpWkteb9CKgUIpqvjEYrcaiiJ44xjCCNL51wW1XkvxKKcRDfKeK8Z6dvlMZbvU6BTfWqUDFIfj8Ufm/uWm3FIs5cbXzB5M6YQYALicHaNITAU9XnNX+ootgdb2OY8RXH6MUfq5cOAxrT9HBbjPYXW/SJUS1v8Etq6YSNjLrH8XOIiBjyL8M0pjMyb5UFfgf82m1BB0puxRLONhZB9uNMVcbHiP64WV7uwMiIrGSwtgLxNtww54KgfJL34d1wzXe91PqlYkiY65lrkLalpK4VvfjKzACqqEVbVLy6/3wT/E68XqnjnU6mfiJ4XV32waD44mfzmaLwnk0JcIz7caO3ertSvkIPaNSXX8qbuMSWffexHlxEarYcN/gedhxQNcYF2nMCyAMuxvDS/pKNCNN+FliXzkXFThaJYFJRfZ65XcFFOLnokCeEkJ0E0Nis6U1XHL4q4bRjaigrZAu5k95Tmsc='

dead 7386768 2023-09-02 01:05:18 2023-09-02 01:25:35 2023-09-02 13:35:22 12:09:47 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

hit max job timeout

dead 7386769 2023-09-02 01:05:19 2023-09-02 01:26:26 2023-09-02 01:46:05 0:19:39 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} 3
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

fail 7386770 2023-09-02 01:05:19 2023-09-02 01:26:56 2023-09-02 02:12:23 0:45:27 0:32:29 0:12:58 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} 2
Failure Reason:

"2023-09-02T01:51:23.043050+0000 mon.a (mon.0) 232 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386771 2023-09-02 01:05:20 2023-09-02 01:26:56 2023-09-02 01:49:16 0:22:20 0:10:41 0:11:39 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

Command failed on smithi078 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386772 2023-09-02 01:05:21 2023-09-02 01:28:07 2023-09-02 01:47:21 0:19:14 0:12:20 0:06:54 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} 2
Failure Reason:

"2023-09-02T01:38:33.325917+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386773 2023-09-02 01:05:21 2023-09-02 01:28:07 2023-09-02 02:22:37 0:54:30 0:46:22 0:08:08 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} 3
fail 7386774 2023-09-02 01:05:22 2023-09-02 01:29:38 2023-09-02 01:46:29 0:16:51 0:09:57 0:06:54 smithi main centos 9.stream fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
Failure Reason:

"2023-09-02T01:39:33.508581+0000 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386775 2023-09-02 01:05:23 2023-09-02 01:29:48 2023-09-02 01:53:48 0:24:00 0:16:18 0:07:42 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} 2
fail 7386776 2023-09-02 01:05:23 2023-09-02 01:30:09 2023-09-02 02:21:33 0:51:24 0:41:25 0:09:59 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

fail 7386777 2023-09-02 01:05:24 2023-09-02 01:30:09 2023-09-02 01:52:09 0:22:00 0:09:49 0:12:11 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} 2
Failure Reason:

"2023-09-02T01:47:09.281343+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386778 2023-09-02 01:05:25 2023-09-02 01:31:00 2023-09-02 01:39:57 0:08:57 smithi main ubuntu 22.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
Failure Reason:

Host key for server 'smithi018.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIHC8w76tIocNhdPexjs2ANzNo7GtzsO43y0c6avVY/dQ', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCg6XY8VbOOuhPvS0GtXX8P6lQhaImOFxrjL3MFvZy7dxXXKbZGoMKF10vh2FtK1e6NUXnwGuNI6GdoZdKrDRFAShBV9tKM50RDG2v2hFM3q2GxxM4BLD5Rb3uvdL6oxO15SIoNRNZPH5cZsKt1/kpawhZa1WEW/0A/EJtGQLRy0neUJAy2B8LQ9nssEXJRUy6SazmjDls9bADMhCNDxZFJlZXa2KJcmVPsVv4wkq/Pzf1S9NyzI9t+k9Bgr9lLbUdHhddTQTkA/vLIrb7Vfouyl+i85IxWx3kyEDRLGa5EwYc3q6hEZ1A7LLf29+b6KFawS2f20yCEUYqnqWxxRWYp+gmp6m0+BLh7y0q1W5smIWckRpKw3E1pqGbBdyOwcOWa7Y2FxtnyKyV2Ylx+SSPHTNJsSamsesVJsM2pLVY5+TV4P+u769C4dcq84uKbfH3RvCJJc3ET1dqniLsEZZFQ0i08VEyZkpPMJ917TYABlGuZSu3QAPpPLw7Z/n5/jyE='

fail 7386779 2023-09-02 01:05:26 2023-09-02 01:31:10 2023-09-02 01:52:50 0:21:40 0:14:40 0:07:00 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} 2
Failure Reason:

Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)

fail 7386780 2023-09-02 01:05:26 2023-09-02 01:31:41 2023-09-02 01:51:17 0:19:36 0:10:26 0:09:10 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

Command failed on smithi081 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386781 2023-09-02 01:05:27 2023-09-02 01:32:21 2023-09-02 02:26:31 0:54:10 0:41:47 0:12:23 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

fail 7386782 2023-09-02 01:05:28 2023-09-02 01:32:52 2023-09-02 01:53:37 0:20:45 0:10:56 0:09:49 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} 2
Failure Reason:

Command failed on smithi008 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"

fail 7386783 2023-09-02 01:05:28 2023-09-02 01:32:52 2023-09-02 01:41:03 0:08:11 smithi main ubuntu 22.04 fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-dbench}} 3
Failure Reason:

Host key for server 'smithi149.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAINIdCgHQ2nH3lZl9ZbfCuhSotDyNNW7ra0i6G1jb0I25', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCZc7ISI9fnHl0DohWhcEz3dYUZxAvKV/hUj5k/YhasC02kWJEuLqcks1zFyHxmI3i1Ij/ahpevREmdY6pXlsFe7AcBr8ctlZL39TeF4t9ETv6plCUN4VL+amqLHazDV8t4HNw1e/cUoctoNHtwWZ4P2PUvx545DACpcvMzq36qQwQkLEIX2wUrngeXelA3GfzTJrmzYD7YSzXHFFajaWbyYMMCrie2yr7gSTIFLpGp5nTdAqZyRJSAkql0FgXiTULKLF9apWOuIGSddDlCPje+UEfANBtwgXmZJI8hg1vQMn9ivzfjQPWG+Z/lVIjtLz73LEgO/jSQJW6wpxfalNJJWra0SgnHISJZozN/U0ZI5zZk6eQMPS96zEafGtU5gf49h020fXxPtDfgtBva6ouLaKDn7JxQfjEChx3i514UrzELLUCfiZxnC0De7LKHK9+oLny3/fZDNiaiT00kPY7SflEeO4YTumltIb4wD0vHt5t8CWsZ0rbDGO/zbf+7dmM='

fail 7386784 2023-09-02 01:05:29 2023-09-02 01:33:22 2023-09-02 02:10:09 0:36:47 0:26:10 0:10:37 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} 2
Failure Reason:

"2023-09-02T01:48:52.748633+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

pass 7386785 2023-09-02 01:05:30 2023-09-02 01:33:23 2023-09-02 02:27:03 0:53:40 0:40:44 0:12:56 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} 3
fail 7386786 2023-09-02 01:05:30 2023-09-02 01:35:44 2023-09-02 02:20:58 0:45:14 0:32:10 0:13:04 smithi main ubuntu 22.04 fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{test}} 2
Failure Reason:

"2023-09-02T01:58:14.930322+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386787 2023-09-02 01:05:31 2023-09-02 01:36:24 2023-09-02 01:45:49 0:09:25 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 4
Failure Reason:

Host key for server 'smithi114.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIK5p6LrQe30wfff0x8diOanKdjYqjcVGEW2LQyLTohNK', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDiTc4rcTiS+e9Ie0cWOQm0W8ap+L+GTGj4hWnfIOY9SvIJbIzKeoFSPFLxIpJ1iWxRuaPa+wzUi/7M5ClwC/Ehe76xzQhEARRcK+84Ws5+CDdzDHL/OynFrAonkiTqIFEsGZB0Je0CIbmc8BRSADRBYBWMuzVceRbQl4g8yjdj9NN9uX5M5GmX3BuzqCki5mVe7YbkntN8iSQHY25lnZ/QwQpLWb1G9XUMv0dt38upoATRe/zStvMdrUCuySFO5XhkG3H2upclIbPDM2FYIBs3x8aUil9VYzi5Jyl9Y4uBAjKFgCdJSTuihgtkSEUops/7xTZ1+V55OZ9oIf0C1d1V99vZ1q88/0FMRIBPuAnOQbx6BowBbaquPJGz6VkYRDfCqTHbeQA+OtfFDQM2R+5QCm3klKw/sOt974CpjYDfN9o8ivUQn4p9efqWUCVhFTwyY71kK/vzEHx7wr9M6re414NqvRW22AiaZ7hiXRHfNLPkLW/RQ2Zoe+vx7Xxclfk='

fail 7386788 2023-09-02 01:05:32 2023-09-02 01:37:25 2023-09-02 02:53:16 1:15:51 1:06:22 0:09:29 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

"2023-09-02T01:50:58.183742+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386789 2023-09-02 01:05:33 2023-09-02 01:39:45 2023-09-02 02:08:09 0:28:24 0:19:52 0:08:32 smithi main centos 9.stream fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7386790 2023-09-02 01:05:33 2023-09-02 01:40:06 2023-09-02 02:55:35 1:15:29 1:08:40 0:06:49 smithi main centos 9.stream fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

"2023-09-02T01:50:33.098467+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log

fail 7386791 2023-09-02 01:05:34 2023-09-02 01:40:46 2023-09-02 02:01:46 0:21:00 0:11:07 0:09:53 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Command failed on smithi038 with status 22: "sudo ceph --cluster ceph config set client 'client mount timeout' 600"