Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7385172 2023-08-31 04:14:06 2023-08-31 04:15:24 2023-08-31 04:55:11 0:39:47 0:33:44 0:06:03 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} 2
fail 7385173 2023-08-31 04:14:07 2023-08-31 04:15:24 2023-08-31 04:26:11 0:10:47 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 5
Failure Reason:

Host key for server 'smithi007.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAILI5IDdmsK7DiYkPO2xt6krYDMlhff9KEIsBwGCY8gTy', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQClqaGGtSGYtT85qVYs0GoYEWIPtEdhImwP1ZkKJH0DlfXlC7YsHbLqmXvFPI2FrRjPQHxkRqJtm2y19eVXmekTnGBhHeX3jM7+93/M6Rtm9febQSVx8tqpE1sDWUrPz61CukDy5h8Il4YNrmafnVIIFMofzdaaTGhjHYnUvZBXk2x8WYxR7YiwD+v4psTk2zCqhnBE8U6eiB74kVqIbeWnl7aoblUBKtjLsWKibek83T7Q8MEiDQ83QVrQsnxLqm4TcSRB4RZqzgo8vAJvgZsDV7yaZr+p5xZEzUB3eQn3KkdgylbVPzgPzyNeFBZS2Hx9K63rAm7lJRNUMK2Q0G2R/KAz+en1yQHv7Ivx2xofhWkfCR106Q3w8u/FzVbz+I5e4eQwddQ9GUBggUsHgoE7ZdwfIwd2aimzGbMtW1fIcRtHwxykZo3oc6LOZQiClCuItCkDLWObi1siZF6dPvvTG3MD/ArumtiBuf5iDJNtwEey6rRctLWN3gkScX5S8x0='

dead 7385174 2023-08-31 04:14:08 2023-08-31 04:15:25 2023-08-31 16:30:16 12:14:51 smithi main ubuntu 20.04 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

hit max job timeout

pass 7385175 2023-08-31 04:14:08 2023-08-31 04:15:25 2023-08-31 05:29:41 1:14:16 1:02:08 0:12:08 smithi main rhel 8.6 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7385176 2023-08-31 04:14:09 2023-08-31 04:15:26 2023-08-31 05:27:04 1:11:38 0:56:33 0:15:05 smithi main centos 8.stream fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} 2
pass 7385177 2023-08-31 04:14:09 2023-08-31 04:15:26 2023-08-31 04:53:11 0:37:45 0:24:03 0:13:42 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} 2
pass 7385178 2023-08-31 04:14:10 2023-08-31 04:15:26 2023-08-31 04:41:33 0:26:07 0:18:09 0:07:58 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
fail 7385179 2023-08-31 04:14:11 2023-08-31 04:15:27 2023-08-31 05:04:05 0:48:38 0:30:51 0:17:47 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi002 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 845dcdf0-47b9-11ee-9ab3-7b867c8bd7da -e sha1=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

fail 7385180 2023-08-31 04:14:11 2023-08-31 04:15:27 2023-08-31 05:23:19 1:07:52 0:57:16 0:10:36 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

pass 7385181 2023-08-31 04:14:12 2023-08-31 04:15:27 2023-08-31 04:51:39 0:36:12 0:16:03 0:20:09 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} 2
pass 7385182 2023-08-31 04:14:13 2023-08-31 04:15:28 2023-08-31 05:01:07 0:45:39 0:26:45 0:18:54 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
fail 7385183 2023-08-31 04:14:13 2023-08-31 04:15:28 2023-08-31 04:24:04 0:08:36 smithi main ubuntu 22.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} 2
Failure Reason:

Host key for server 'smithi120.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIEWxiYwAk99dir0SZ4SV3trSavmnSfDTyES5S0/TyqGS', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC8f0ixOi4IK/rkG4l2ibUj52hnr7XnuS5Iwkab6LiM+lN6ydLuaUJl8cvHL+O2acV/WY1SxTYXcbdodeF+V3pXA79UTLxHZpN2qISYXiZgo7FbVBKDK4d3exNEgo3NMz+ESmSr65EFuWFCLWDbay9gw5oxCJRxw66ZX0b/I7vNqLXkm5sdiZ49bahpd/U7FDfcCZr1toYa6PZ+lmW0G2Vz5mly/6mIoi06F2KLh245+bvDI58HFUOGuiCq62aXSH6/y43DAS+itKk4SXpBPByoM8NEpUAFfVB9RdEM7UBmOVfRX7KT9KrDDHopn3xz0poH/AI4xyO6qV4dy14McHIxVAjMudtXmzDg0M/8eArCUAp7eRVarW0C0uE49q1ZsfGMUM/KH9HTFGefhUHhF/D1SujohjW2kok065MhmJ5L/2ihxdMTAHDGPWE2GtmB73+q6dKViFX3R9kdzS1UNReOgXH7eWfx1OHlJhGYjd+XrmSfG8n90t/JYMCWNJh69/M='

fail 7385184 2023-08-31 04:14:14 2023-08-31 04:15:29 2023-08-31 04:27:05 0:11:36 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
fail 7385185 2023-08-31 04:14:15 2023-08-31 04:15:29 2023-08-31 04:26:09 0:10:40 smithi main ubuntu 22.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGto/ZuiSf5zYW7IWXyglMQTdiuejEQgPZQiwpYImYm0', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC4gH5EqxCKEbjYtCBQ3QdugWolwl67ZaJj1r9Leb7+lDE2ABXPpk/0IMFJyyAAGP82ER5zI5P74bhU7L2Aww0somXtDjW65dwlQ+37YYsp2PjVAnOQhjpV3CNs4xRhzfHDRlS95ruQCF7W/R5PnHkAEcCSSBvPXVTvCi4X2HBFJb5fwoHDkEmaKCVB7gKWHeRqZjdG2LstHJcaArBMapOapwE8W6UsfeR1y/p/HtpvMuogPwq7+dlbqgNxs/f/4qkumEIw2mavipwIjRqkpYa1DdJgLk12Pndd5ao4aeIUfaWn9QolLLL4HudUgxeElmRKOVZVNBMH2t7QU10FLNyIiKu+xTMeAT+MAhGC44fTHcwy/YVPkcr6tkAi2X0nuTABf6jwxJ1Nv7ESq//kPuRxxOEXkeQ4xqysx+vAH+1/+VZ5d37B9/9ugCx0IfaL33ptw4Qybwibnl42dmdHMsiQkbQ7aEWyiPlA59eMl+hrypv8F4TdGrocOKzlXEMUxck='

pass 7385186 2023-08-31 04:14:15 2023-08-31 04:15:29 2023-08-31 04:45:33 0:30:04 0:18:07 0:11:57 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} 2
fail 7385187 2023-08-31 04:14:16 2023-08-31 04:15:30 2023-08-31 04:27:33 0:12:03 smithi main ubuntu 22.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
Failure Reason:

Host key for server 'smithi192.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDJSd76+WUbxYHLYmPzMH1iZU6wee8C/hKGFHsfssqR1', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDT5HQN8shKnfP9CRirbpSO7Yg7lHKUWCwhbdj3/5fa7mGjBvKnZ7mCC819S8XtNgRVyPM4YGdOGjDaU4GWZUBRx1YiU21/eaEVFY09Hewor4nXq0LruV+Zuqmv/MH44co7iW/hjRAfuWuUrlOCRxvZqAINqGsg4jNJUc3WQt7drMTE79Pufa13vIPyEwtb9WfI+9J05Xl9gGaWCRZUGi+wGg9LX9z8tiXeot+srICjhW/t7wCf/q2CVbFpiC6iMme54DEzkEN1fFatlHeyT6bEnU4dPyrS+nOFTpGHrkh4PXneuDlczBn3yMB2xyHAuag2bbpkwxWtmYhgXbRaKf7+LF2eqBiB5lZb/FroXKnzZQjCcPz9H0BizIBQvavdg5Z9dEGpqb6b8Vnzogp0x1YSBL/uDmyulXy+Gx06rjnslT4n7VaGBrqL4v6idQeXMV14zi2Jp0BHV7LZL4VWS1nUoNnudG9QYej2SX2HPiGoBT4bJJYIV0WiWtlKGZfajXc='

pass 7385188 2023-08-31 04:14:17 2023-08-31 04:15:30 2023-08-31 05:31:49 1:16:19 0:58:16 0:18:03 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} 3
fail 7385189 2023-08-31 04:14:17 2023-08-31 04:15:30 2023-08-31 04:28:21 0:12:51 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} 2
Failure Reason:

Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDr3qu7PsxM5Q0McOotidl7cQAmmhfn0jSUtTtS+ZBhx', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC9TDkdgyatvec0zkLdxmroxpM2K4siFDOakpIeAtfexUp77Pto8EVsEJ0rlvraYOImZB/cw0CpsAl1TkxN6Um9ecWsIKPfAhBJ+W7Mcz8YGGPXwpjdZ9dH7gRKtx07O3ERuRfLsUZmg1Ucq7cx3Mzjg9r+E1zSXTVX7ar6c396J61/SjPviPkkGrnxzS7j05dimRtGWTgUN4z4KHn9MoXbW37KlVCGEtU5D3W5+zjvLLTEvmfKVBC3Hfrhj0mmWM3sCPUsXhzdaooT1vPsCDfe9oc4irQTJVyprT3O+1Vnc7XPwB+fqKMBdnJLdOgNDYiz8rIVg9l/lwBJBkFe801Z9vZSzH9Tb0mwZ7w5Jx4kPe/M4bkqqLZrMfYCFRTNoN+YLKO+lXjlZ+75iIBi/A/PtM1kJraJZ2vDKtks0YtajMPUu9ZVPP7OVJyKDYTiUEtqkPRAmlVrH8QGaYWMVdkU/mhNgBrXCOi8DXLexpMv/5lQa0lUIGV+jyn8xhVzX90='

pass 7385190 2023-08-31 04:14:18 2023-08-31 04:15:31 2023-08-31 05:11:21 0:55:50 0:44:23 0:11:27 smithi main rhel 8.6 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 7385191 2023-08-31 04:14:19 2023-08-31 04:15:31 2023-08-31 04:54:19 0:38:48 0:28:41 0:10:07 smithi main rhel 8.6 fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
fail 7385192 2023-08-31 04:14:19 2023-08-31 04:15:31 2023-08-31 04:27:37 0:12:06 smithi main ubuntu 22.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} 2
Failure Reason:

Host key for server 'smithi069.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJHzVwJtwOGNmYmc4cb5BAliXmf908LorFNQ2BahMSrU', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC6pGZ44gzeBmrg9IoZRT7I8vafhfwzIqluEew2GgqtfKwHGpdAniOR9M/s6AzybTSlbW2oWzV7ot7xvB083c/ir7ySn+SztqHZAukogJHre2rzKDANkfahNiCpbawFyWnuomNQVNWOa7kbZTpCnBfgsurpgBU1oN2ee12kuLB0PrB9xdSxZacPyjJ87QfBozeytFSJNZxsTO96IhpVzhfVuL3CByXa+cgPGVuAX118DYZhMCepoCAIvLXDTLJgCWdrvbk9kijGTZaYcteR3RymPJsXRhLepUYuKONvqHW+CLDCHfKApVb/1JD3Hh6n0AHmcy5miIHxPvPId0pUCfh9L1rJP31GR+WrwSDNxUty42tCsU8NCu43DTkO1U6i9k6+N/zBxEVeseSMrXmwKzEewfbnENHpryIGApxiuwHLFn7MIHKksyiD9UtwMR0D7ua2c/rnWcMBUZhghpVMH10B6vHlEFdhNlzWNTBhTN7zxp1am/zlrIxd/OYGU3757lU='

fail 7385193 2023-08-31 04:14:20 2023-08-31 04:15:32 2023-08-31 04:51:27 0:35:55 0:18:43 0:17:12 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} 2
Failure Reason:

Command failed (workunit test fs/quota/quota.sh) on smithi178 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh'

pass 7385194 2023-08-31 04:14:21 2023-08-31 04:15:32 2023-08-31 04:38:30 0:22:58 0:14:24 0:08:34 smithi main rhel 8.6 fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} 2
pass 7385195 2023-08-31 04:14:21 2023-08-31 04:15:32 2023-08-31 05:02:21 0:46:49 0:37:29 0:09:20 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7385196 2023-08-31 04:14:22 2023-08-31 04:15:33 2023-08-31 04:54:02 0:38:29 0:20:49 0:17:40 smithi main centos 8.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
pass 7385197 2023-08-31 04:14:23 2023-08-31 04:15:33 2023-08-31 04:48:23 0:32:50 0:19:22 0:13:28 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} 2
pass 7385198 2023-08-31 04:14:23 2023-08-31 04:15:33 2023-08-31 04:59:41 0:44:08 0:26:50 0:17:18 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
fail 7385199 2023-08-31 04:14:24 2023-08-31 04:15:34 2023-08-31 05:24:39 1:09:05 0:58:50 0:10:15 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

pass 7385200 2023-08-31 04:14:25 2023-08-31 04:15:34 2023-08-31 05:46:02 1:30:28 1:19:44 0:10:44 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} 2
pass 7385201 2023-08-31 04:14:25 2023-08-31 04:15:34 2023-08-31 04:47:17 0:31:43 0:23:58 0:07:45 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 7385202 2023-08-31 04:14:26 2023-08-31 04:15:35 2023-08-31 04:52:07 0:36:32 0:24:26 0:12:06 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 7385203 2023-08-31 04:14:27 2023-08-31 04:15:35 2023-08-31 04:48:12 0:32:37 0:18:13 0:14:24 smithi main centos 9.stream fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} 1
pass 7385204 2023-08-31 04:14:27 2023-08-31 04:15:36 2023-08-31 05:20:02 1:04:26 0:51:30 0:12:56 smithi main centos 8.stream fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host} 2
pass 7385205 2023-08-31 04:14:28 2023-08-31 04:15:36 2023-08-31 04:52:25 0:36:49 0:24:28 0:12:21 smithi main ubuntu 20.04 fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} 1
pass 7385206 2023-08-31 04:14:29 2023-08-31 04:15:36 2023-08-31 04:50:10 0:34:34 0:17:18 0:17:16 smithi main ubuntu 20.04 fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} 2
fail 7385207 2023-08-31 04:14:29 2023-08-31 04:15:37 2023-08-31 04:23:47 0:08:10 smithi main ubuntu 22.04 fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} 1
Failure Reason:

Host key for server 'smithi061.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIIWBkwc+yO1E0RoNt9EiVcgf5ZtQJNbHPwPdJ0QQ/ROe', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDo2Fxj25ZnUTW3kbg8g79YHEZr9iRRVwuxBdzm7KOlCz48N4dXOP7hrJepLgIk3g0qexF5FXs8j+5hrB2TLJI3YqpbLnffYsnLSMsZt1f3HjWKSd+nYZRk/cRKFsTeULglvbB2Xj5XGy455+wk+DVVAhO3RWPhmphFGtcO6swz3cUt0+BfSOt7RmYKfiZQc13G7DoMGlMchzJn1Ua9W30/7N8NkT0X3EJTCZFhuhXiGqLrvr/qXfGKYHRxN3A+CEhYFdh/N7dvyID+zW8x1VLDY0HMrnlJ82ffHHf9R6ob6MisQ4ZzWhGJDKgODkdXehR5KqGdoUh6KJoFRNAS6QnnXk1bbCjOJRdU+xnoutnkbxpuDT2RPCXbK9EYe0uO6nMMavNMhFneWh0be6k8GwV2L7YuHx6ujR0+l68DB7xo3iHMPrU0XozdkYMiPbBIfJX/OIFhyG93juu6N/XenWVQzyfuNSo8rf8XGl6XbQvCQh1ibnq+Ld+z3TVoYxXT4q0='

pass 7385208 2023-08-31 04:14:30 2023-08-31 04:15:37 2023-08-31 05:03:37 0:48:00 0:33:24 0:14:36 smithi main rhel 8.6 fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit} 1
dead 7385209 2023-08-31 04:14:31 2023-08-31 04:15:37 2023-08-31 05:19:44 1:04:07 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 4
Failure Reason:

Error reimaging machines: Expected smithi102's OS to be ubuntu 22.04 but found centos 9

fail 7385210 2023-08-31 04:14:31 2023-08-31 04:15:38 2023-08-31 05:25:29 1:09:51 0:55:10 0:14:41 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

Test failure: test_shutdown_killpoint_SHUTDOWN_LOGCAP (tasks.cephfs.test_failover.TestShutdownKillpoints)

fail 7385211 2023-08-31 04:14:32 2023-08-31 04:15:38 2023-08-31 04:27:52 0:12:14 smithi main ubuntu 22.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

Host key for server 'smithi133.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIESRorzCiDnoJh+zmjqviY410eOCwNmQYkalpzpNDi1y', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDdM2fFsf7jHpdWxj7HaXoSL+VJS9hhl1y9m5EAlFrSkQL9sySuZbsXxglLxHA5Z4BwOdm02BtKOtNr6y9mKQSFKRTNfHsCuRqDys4yteHpMOwDlbBXGo6R1AmXKdJ92lgqpc2295urqUAtcyqnZaAybhCibbImmrsz7VnL5Q97nvVt636tibAsATZVdZhfoNTO5xG7I/mJSC1ntpLGKHWk/B7WS6fPy3vBzdudwuKvWTWmt09NIHQe4MZvKbYm//EkLbQZaMc+NDYGDbUtUEJm0l2OkML1dNxRkLiqn1dOhpW+0d+A4P0kbM/I+mcnKMf769Qn22PKUFEXtvR7BwOpb0/QyMWrKiZnKnJ/4qksKUnwa1NqkQGvfcxNIpCQa+7a07qtyM93+x2zz2dqScYB8Y69McNPXkXhh7FXfo//cQcU4zLv+rGKyEead++Z+iUE+QtLI62F81zbAokzOSuuzgZz0HEJjPO0w6nklwiY+/3SyWX9yphT0gTsOCdiiCU='

pass 7385212 2023-08-31 04:14:33 2023-08-31 04:15:38 2023-08-31 05:25:39 1:10:01 0:53:48 0:16:13 smithi main ubuntu 20.04 fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} 2
fail 7385213 2023-08-31 04:14:33 2023-08-31 04:15:39 2023-08-31 04:26:22 0:10:43 smithi main ubuntu 22.04 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

Host key for server 'smithi162.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIG/gOXQ1R3iT1BuFr28hJltxcNUrze/0G0H/T6gNBs31', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCxfTd/JI1SiU+qKNx+DNvd2B7RHUqo/xEYzLxQBivuQnnY+BBpESC2sWkuJ3Fjdlz8pqSpu7615uigCN3jjyYWp4BTA7rkOJwltMVNx9wxivO9+Rytvjxnvn1XLF6wJ2uFBBw3WkLsgiYSZTJuEwAhbot8gyMO26f0ZiBAdSVhrTtaKee5rpdugiz34PsezQW4bEwyRCDum4t/MI0dENPHfooJbnnxZHq+zJ5JeJbdTLcBSaLGEd3N/SYal70A/zJmNijooDzNAr0QTz99Kh8PKiE3uKvY+ZAkDm95lDXjvywMZwanOABbCI+GWipSDkhw6+qWATq8l7x/grP3GrITanIfhx/b+BBmzkR+GYTfYiL/zT7HTRgJ+WjopJO6hILPuVyKQ06iH7CEOmVwq9nbnnIGM/6hqo2qmybw+/Fzrz6zX0OaK4XM6pgutbp8S/CGUDkJoUGg6s6Ht2WGEmLKuQbm49d/uoHn7x0wQOC84vEdUh8jCZVOJKGMMpTGzzE='

pass 7385214 2023-08-31 04:14:34 2023-08-31 04:15:39 2023-08-31 04:50:04 0:34:25 0:22:36 0:11:49 smithi main rhel 8.6 fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/fstop} 1
fail 7385215 2023-08-31 04:14:35 2023-08-31 04:15:39 2023-08-31 04:23:16 0:07:37 smithi main centos 9.stream fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} 1
pass 7385216 2023-08-31 04:14:35 2023-08-31 04:15:40 2023-08-31 05:03:13 0:47:33 0:32:46 0:14:47 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
fail 7385217 2023-08-31 04:14:36 2023-08-31 04:15:40 2023-08-31 04:26:35 0:10:55 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} 2
pass 7385218 2023-08-31 04:14:37 2023-08-31 04:15:40 2023-08-31 04:49:25 0:33:45 0:23:33 0:10:12 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
pass 7385219 2023-08-31 04:14:37 2023-08-31 04:15:41 2023-08-31 05:17:13 1:01:32 0:43:48 0:17:44 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} 3
pass 7385220 2023-08-31 04:14:38 2023-08-31 04:15:41 2023-08-31 04:50:00 0:34:19 0:17:32 0:16:47 smithi main centos 8.stream fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} 1
pass 7385221 2023-08-31 04:14:39 2023-08-31 04:15:42 2023-08-31 04:54:36 0:38:54 0:27:25 0:11:29 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} 2
pass 7385222 2023-08-31 04:14:40 2023-08-31 04:15:42 2023-08-31 04:52:06 0:36:24 0:22:17 0:14:07 smithi main ubuntu 20.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} 2
pass 7385223 2023-08-31 04:14:40 2023-08-31 04:15:43 2023-08-31 06:16:43 2:01:00 1:43:02 0:17:58 smithi main centos 8.stream fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} 2
pass 7385224 2023-08-31 04:14:41 2023-08-31 04:23:24 2023-08-31 04:53:24 0:30:00 0:17:42 0:12:18 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} 2
pass 7385225 2023-08-31 04:14:42 2023-08-31 04:24:15 2023-08-31 04:50:56 0:26:41 0:17:49 0:08:52 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} 2
fail 7385226 2023-08-31 04:14:43 2023-08-31 04:26:15 2023-08-31 04:33:08 0:06:53 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
fail 7385227 2023-08-31 04:14:43 2023-08-31 04:26:16 2023-08-31 04:33:11 0:06:55 smithi main centos 9.stream fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-iozone}} 3
fail 7385228 2023-08-31 04:14:44 2023-08-31 04:26:16 2023-08-31 04:33:20 0:07:04 smithi main centos 9.stream fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} 2
dead 7385229 2023-08-31 04:14:45 2023-08-31 04:26:27 2023-08-31 16:45:37 12:19:10 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} 3
Failure Reason:

hit max job timeout

pass 7385230 2023-08-31 04:14:45 2023-08-31 04:26:37 2023-08-31 04:58:08 0:31:31 0:20:50 0:10:41 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} 2
pass 7385231 2023-08-31 04:14:46 2023-08-31 04:27:07 2023-08-31 05:37:53 1:10:46 0:59:48 0:10:58 smithi main ubuntu 20.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
pass 7385232 2023-08-31 04:14:47 2023-08-31 04:27:38 2023-08-31 04:56:49 0:29:11 0:19:41 0:09:30 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} 2
fail 7385233 2023-08-31 04:14:47 2023-08-31 04:27:48 2023-08-31 04:35:24 0:07:36 smithi main ubuntu 22.04 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
Failure Reason:

Host key for server 'smithi116.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIBRtT8TPe7RpW0r7w1xG/VETHN7ewJrO1gCQOcieDaMz', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDX6qm8WbSfLV7dOW3zhbxPQAD2TLCRW2+urzscGQixJnjUfOYb0HsI5Kfpv1iHsbKmB/j/RnJoSHplvvh+/6gAhekCMZYukboUt6yEzpP2zfW4mxb6pdElLKOiAb2E8oOt93AURinQDir9IPmdtukzZZz277+yI6YgHqjuUcP+zJnQi/P1gDDZtYDp+FKF7hl4bPhO5ZcT+EYjYzO5Sys5pztJOyHgf8npyznqmvmCCRA773emc7CVshToCxOgfzvuRknZ1OSUZXzYYV7ql+PLp3YCCd+2p7u53SpZnAlRpRcWt1MmgZAFEF4qGbtwff3dcrlIYhk4hZXt0C976muBm60WEdomDc6Z++OVBdK6fYfAMwaX9CReSacDMqkYsw8Y3miTgKz0HuavLYkOxtJr2JeLxatQaJWmpkdB4Toe87lm7AKfhmxzRaxni5rGNIZySTxgpWrAS92UwGH3U5EyC4yP78hYdc4+/qTifMycAti1eHV0GeLEX8C7ptBSVe0='

fail 7385234 2023-08-31 04:14:48 2023-08-31 04:27:59 2023-08-31 04:35:28 0:07:29 smithi main centos 9.stream fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
pass 7385235 2023-08-31 04:14:49 2023-08-31 04:28:29 2023-08-31 05:10:18 0:41:49 0:26:08 0:15:41 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 7385236 2023-08-31 04:14:50 2023-08-31 04:33:20 2023-08-31 05:03:53 0:30:33 0:24:41 0:05:52 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} 2
fail 7385237 2023-08-31 04:14:50 2023-08-31 04:33:21 2023-08-31 04:40:16 0:06:55 smithi main centos 9.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} 2
pass 7385238 2023-08-31 04:14:51 2023-08-31 04:33:22 2023-08-31 05:30:44 0:57:22 0:45:56 0:11:26 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} 3
pass 7385239 2023-08-31 04:14:52 2023-08-31 04:36:34 2023-08-31 05:09:57 0:33:23 0:22:01 0:11:22 smithi main rhel 8.6 fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7385240 2023-08-31 04:14:52 2023-08-31 04:38:35 2023-08-31 05:13:35 0:35:00 0:22:32 0:12:28 smithi main rhel 8.6 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 7385241 2023-08-31 04:14:53 2023-08-31 04:40:26 2023-08-31 04:48:38 0:08:12 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} 2
pass 7385242 2023-08-31 04:14:54 2023-08-31 04:41:36 2023-08-31 05:13:28 0:31:52 0:20:15 0:11:37 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
pass 7385243 2023-08-31 04:14:54 2023-08-31 04:45:37 2023-08-31 05:58:20 1:12:43 1:00:59 0:11:44 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7385244 2023-08-31 04:14:55 2023-08-31 04:47:18 2023-08-31 04:56:08 0:08:50 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} 2
Failure Reason:

Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIEGnhMsu1PHgy8kA3OzX/Dp6EjCQxSGQzBDFPXwaTNhH', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCzDP6d6w4KyPW7BV7u79hTm3YVMLPf49hDcIvmT/t4qSA4j00YwaziQbAND0gCT6GIhlMdRfz67ae+pjI5rtDjKWHUH1pez5pbZxmapz9dVY57dbZ6cD7a26PWhFiDAqrWoTOoxsmIThg3KYx4ld59FbSTTpst70DYLp3i5EBi8pR/SC2RmkJlxDTvKcffeinjp471yBkWH6DJLcQZ2mJdQamBh86VllNQ8lnxVFy0zD7zoS+eigYaXKlRQZzfLMDH33R7qOB0s1V7zObj7gcILIcLScERkqRLLX+hD/xoO7FqBTsFR23JPgIG9QXZWdlg5gbV9Gon207BL13isjJi+bmOgMXIlacTSRNBmwS6mef9v2kj9SYuPiC7xvpU2Ae1dLgIkQyJNH0XDYw4zljuc/lj5NExaJT889H0TsUUT9vS7I4lplqq5sY/CeqQzgcBxWfZ0GxzvwLL9dVQbj1IrFzjgGFtWbfdbSq2ZXIzRKFDEWM0ss14iBiwY+hskj8='

fail 7385245 2023-08-31 04:14:56 2023-08-31 04:48:28 2023-08-31 04:57:49 0:09:21 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 5
Failure Reason:

Host key for server 'smithi122.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIHAqVdKkJ9o2fCvdKV7mz2buULtRgUy3yWLY/LAFC2Pj', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCSSRjU8TIqFBon+Br3/pPd7v0//LQHiAM/X0mPAaO+X4H5GyXSJMT2nRuciQ0kucFt66VQZf+RABmuJTAJY6cxVKc86Ww1w15/Ni4/WND2Uawi/cVeQTT2idPrGngktHvEu5Z0W7U1B2KBXJZTzs8DgVWS7aJtrYT5lSx7cNAWEs/7UyAAWKDZuG0Iv2H0BeImRxPQ9hT0daWG/ITwI3B2WvpLgBCLnfxay9pwuoNdS1jdVAKp48D7a12845vFQumNCYuwZeVM2+gM5al1mefbRCBZsQXdRa14fO2lIZGHo186LYl6EZDT01QPJEX9ggcUSNMQI2TVSxAu8GZO616jnWNsPpS7Dk4paRL1eKaN+zS6l7DBDB6qQ0Gn3Vc1+pDxYjN57K3jLgRfT229XPVyUA/o72rrYV+ksYjaAZ0ncKH/zjmykV+uSw8FOYMpJWqmw/jU40vhi9FcymJ0uXZAs76DmXnQiuLr4HI9ulSfNj5+b+GgyZNjAsR5wULX+0E='

dead 7385246 2023-08-31 04:14:56 2023-08-31 04:49:29 2023-08-31 16:59:22 12:09:53 smithi main rhel 8.6 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

hit max job timeout

pass 7385247 2023-08-31 04:14:57 2023-08-31 04:50:09 2023-08-31 05:53:52 1:03:43 0:56:27 0:07:16 smithi main rhel 8.6 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7385248 2023-08-31 04:14:58 2023-08-31 04:50:20 2023-08-31 05:32:59 0:42:39 0:35:14 0:07:25 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} 3
dead 7385249 2023-08-31 04:14:59 2023-08-31 04:51:30 2023-08-31 05:04:49 0:13:19 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} 2
Failure Reason:

Error reimaging machines: Timeout opening channel.

pass 7385250 2023-08-31 04:14:59 2023-08-31 04:51:41 2023-08-31 05:45:43 0:54:02 0:42:38 0:11:24 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} 2
pass 7385251 2023-08-31 04:15:00 2023-08-31 04:52:11 2023-08-31 05:25:30 0:33:19 0:26:20 0:06:59 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} 2
pass 7385252 2023-08-31 04:15:01 2023-08-31 04:52:11 2023-08-31 05:48:23 0:56:12 0:42:53 0:13:19 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
fail 7385253 2023-08-31 04:15:01 2023-08-31 04:53:12 2023-08-31 05:01:23 0:08:11 smithi main ubuntu 22.04 fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} 2
Failure Reason:

Host key for server 'smithi120.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIKgI5vtdS4UnDziNQD8TkAglKcR9oio2JLBvf4DqXM0z', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDRGeIyuxylBJD9tcQBnAkSkkFluyeeRp5ASkUv7GeKOUPmcb43WvVImUWkFIUxeknSEAMjfLN0NY8OBbKeHXI68zMbqLqdBc1WaDsSc34BAsE6JV7I6/JU/kvKf6W7NL9tJMDo0l4RXxq2CbsZAwRFcbyYA59mAfVgT2lujl33fgdFtzYGd/Y5aghX2wifyL8e3XnlM4QDN/23By6buaEQDR7jDOElVDZJiICpHdNO6dT4mt7c6TSaE/Cj/YYJkMCmf9droGZwVmzAitm3CLuqBsKS4F2mERX652MXaSKS46QIwWojheNXypotCwCfhK6DT7qtufHHR50mA5PbYww/SonKcFqXr7HQUQPFzo2A2StKDWYHcMr7eXCcKnqnT79+btXsTnPlt6aqL6nC3Kgl35hhCaTKzcV7HjxMaeLh6Z0XSP9PsMVnWbURK5K1h3IZkNQ0/6ttFyERGyfHurLFPtI1Q1H8Kl/ltzJCZe5aaHmTDI5Ye/72PYZaojRVPRc='

pass 7385254 2023-08-31 04:15:02 2023-08-31 04:53:32 2023-08-31 05:25:10 0:31:38 0:20:47 0:10:51 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
pass 7385255 2023-08-31 04:15:03 2023-08-31 04:54:03 2023-08-31 05:59:20 1:05:17 0:54:48 0:10:29 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} 2
dead 7385256 2023-08-31 04:15:03 2023-08-31 04:54:23 2023-08-31 17:04:41 12:10:18 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} 3
Failure Reason:

hit max job timeout

pass 7385257 2023-08-31 04:15:04 2023-08-31 04:54:44 2023-08-31 05:30:50 0:36:06 0:24:26 0:11:40 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} 2
pass 7385258 2023-08-31 04:15:05 2023-08-31 04:55:14 2023-08-31 06:11:28 1:16:14 1:05:34 0:10:40 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} 2
pass 7385259 2023-08-31 04:15:06 2023-08-31 04:56:15 2023-08-31 06:11:07 1:14:52 1:04:17 0:10:35 smithi main ubuntu 20.04 fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/lockdep} 2
pass 7385260 2023-08-31 04:15:06 2023-08-31 04:56:55 2023-08-31 05:27:35 0:30:40 0:18:35 0:12:05 smithi main ubuntu 22.04 fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 7385261 2023-08-31 04:15:07 2023-08-31 04:57:56 2023-08-31 05:59:08 1:01:12 0:16:46 0:44:26 smithi main centos 8.stream fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} 2
pass 7385262 2023-08-31 04:15:08 2023-08-31 04:57:56 2023-08-31 05:28:21 0:30:25 0:19:23 0:11:02 smithi main ubuntu 20.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
pass 7385263 2023-08-31 04:15:08 2023-08-31 04:58:16 2023-08-31 05:25:44 0:27:28 0:19:04 0:08:24 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} 2
pass 7385264 2023-08-31 04:15:09 2023-08-31 04:59:47 2023-08-31 05:32:17 0:32:30 0:20:34 0:11:56 smithi main ubuntu 20.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} 2
pass 7385265 2023-08-31 04:15:10 2023-08-31 04:59:47 2023-08-31 06:02:04 1:02:17 0:24:13 0:38:04 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} 2
dead 7385266 2023-08-31 04:15:10 2023-08-31 05:01:08 2023-08-31 17:11:33 12:10:25 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} 3
Failure Reason:

hit max job timeout

pass 7385267 2023-08-31 04:15:11 2023-08-31 05:01:28 2023-08-31 05:29:04 0:27:36 0:20:13 0:07:23 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
pass 7385268 2023-08-31 04:15:12 2023-08-31 05:02:29 2023-08-31 06:08:41 1:06:12 0:30:34 0:35:38 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
pass 7385269 2023-08-31 04:15:12 2023-08-31 05:03:19 2023-08-31 05:57:11 0:53:52 0:46:01 0:07:51 smithi main rhel 8.6 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 7385270 2023-08-31 04:15:13 2023-08-31 05:04:00 2023-08-31 06:12:10 1:08:10 0:56:43 0:11:27 smithi main ubuntu 20.04 fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
pass 7385271 2023-08-31 04:15:14 2023-08-31 05:04:10 2023-08-31 05:41:07 0:36:57 0:24:32 0:12:25 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} 2
pass 7385272 2023-08-31 04:15:14 2023-08-31 05:05:01 2023-08-31 07:14:47 2:09:46 1:33:45 0:36:01 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} 2
pass 7385273 2023-08-31 04:15:15 2023-08-31 05:07:31 2023-08-31 07:00:54 1:53:23 1:38:42 0:14:41 smithi main ubuntu 20.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} 2
pass 7385274 2023-08-31 04:15:16 2023-08-31 05:10:02 2023-08-31 05:31:30 0:21:28 0:13:58 0:07:30 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} 2
fail 7385275 2023-08-31 04:15:16 2023-08-31 05:10:23 2023-08-31 05:58:33 0:48:10 0:17:17 0:30:53 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi188 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b843fdb6-47c2-11ee-9ab3-7b867c8bd7da -- ceph mon dump -f json'

fail 7385276 2023-08-31 04:15:17 2023-08-31 05:11:23 2023-08-31 05:22:27 0:11:04 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 4
Failure Reason:

Host key for server 'smithi061.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDSlkMeyz/Pz2dEbYVyqEDw5I3zeVdmnJMSheATYlMly', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDEg7kBn/M4kVYHr1II9MFwPTaLHBqJ/NmkOXrTAlvb/+dt2SPNQfDjFtc9YIZhGQ65hX/mkYyrz/0qsDXZD8WCoEeew7iXcIBgbKfywG5KdZtzybXh/PuAnC7z4mBZ60jzFmvYV9mqiLtoCQ5VnmsjF7KBXBKVMs70GxDTgZnggnXvkykqPkPejgiQEoWe0tU6KBRJaLUMkDBEbFLRZrm8EX9CUTw8TMvEMmFmO76+WJV2v4RjpjTkM9D93KuGHAi0JN5zXF+Ltmgb8ReRamfrMil9WZjRU+HvJv2jJbza9Arv+nBci+1o1XJhShEIKY3BsakrhidmXB3GDBdiDtJM7carGpTMKnIcKKMGNUtlYEUPHUM5Fgo4KYsrfg+dHVRhtahsWAASsNut1jtARVHng8W+JKUdwN2gEkfSZOiaJ863WiaMzxm76x1AVKWWa3lrCR/PHTBW1ufohw5kgQduWlv+6uPCabDCi4BpA2q0wznAJDFGCU2px+S0O1kd1R0='

fail 7385277 2023-08-31 04:15:18 2023-08-31 05:13:44 2023-08-31 05:24:15 0:10:31 smithi main centos 9.stream fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
fail 7385278 2023-08-31 04:15:18 2023-08-31 05:17:15 2023-08-31 05:25:16 0:08:01 smithi main ubuntu 22.04 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

Host key for server 'smithi107.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIIbiozTo03j+EaRigqEJ8yovHWlISj6A4KDbC14W0TOk', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDVF7R9JcNdpGqSqoH4U51k+O2lRwVSVwDPnPv5IuveffEiPSh415qvofIssqyiTnVElF5SUWhe5VFf8aU7fB5QDnD/XE03m/CiQoM8fbookZRuXBdyNSxI0z/Ra096Uwd0EgTmAg6AO4E9CAQeywVYwt91YoWHY8KK0gfZ7JnRU5I2OMhlP97xoQBzCXoEp8eWz7dij5702dAVe37WCm0AXOOYQKBe//+myOIaZnEQfi0iLm5Ur7PnkJdHzQJ30RHSx9BmfxCJL1iIhXXUXtp5Pnz1R8cuAwgIpHxouVtkPdWBIwbxCdumGBvtZByd+mKNi5WtdAUdePeo8/vCjrKSWeJOEGTfLCdj1CB4D75s9HCxY4AOW3j6z0BFGXbk4yjVWMJragpLcRW8Xg63cOxkbUvgtV1svi04HSpMtQZ1mwGFoZQS+BoTfk88tgmkKiH7yZyS0IUIrWSJlm5A/JFlAjBDWBxFzv5eLJzDtnIEqN2FxFoea8r7EENQ2nrTHPc='

pass 7385279 2023-08-31 04:15:19 2023-08-31 05:17:15 2023-08-31 07:23:22 2:06:07 1:57:40 0:08:27 smithi main rhel 8.6 fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} 2
dead 7385280 2023-08-31 04:15:20 2023-08-31 05:20:06 2023-08-31 05:40:13 0:20:07 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsync-tester}} 3
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7385281 2023-08-31 04:15:20 2023-08-31 05:20:06 2023-08-31 06:35:15 1:15:09 1:01:10 0:13:59 smithi main ubuntu 20.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
fail 7385282 2023-08-31 04:15:21 2023-08-31 05:22:37 2023-08-31 05:58:13 0:35:36 0:25:41 0:09:55 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} 2
Failure Reason:

"2023-08-31T05:43:21.689575+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 142372.081177 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

pass 7385283 2023-08-31 04:15:22 2023-08-31 05:22:37 2023-08-31 06:01:09 0:38:32 0:26:10 0:12:22 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 7385284 2023-08-31 04:15:22 2023-08-31 05:23:28 2023-08-31 05:55:18 0:31:50 0:24:45 0:07:05 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 7385285 2023-08-31 04:15:23 2023-08-31 05:24:18 2023-08-31 05:50:54 0:26:36 0:15:45 0:10:51 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} 2
pass 7385286 2023-08-31 04:15:24 2023-08-31 05:24:49 2023-08-31 05:55:35 0:30:46 0:20:24 0:10:22 smithi main centos 8.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 7385287 2023-08-31 04:15:24 2023-08-31 05:32:57 smithi main ubuntu 22.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
Failure Reason:

Host key for server 'smithi083.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIHg/Nyk+8T/7ISjayAjeCnUY7MexFEiUKV6UERz1YDVs', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC8PWprlKUEgmY4gzA7Cef2pobAgoBMKHY8mqTwzca00KOpv9uPTvuKJ7nhXmzd8dmjUH10Jlgm9/cofCvsQm9zko3sNBwJ1UgKWqtj6Ia17Q/xP0djfWCUQc1TrD92X6kDjdY5dVviQP/txufGWZCuYl1F+PRE6bW7bl/oSzzJ+bt0kbhCyJawzxKF6SGN7ENk8QnW3UeLPtNltJsMoedvpw+YslGB4WLFNsUB/KR2xhTRFQSHMWNSBqGL1UlxjnZdFN5oNRfWDkS4PS1mJnSguQ2eFIMhHQ0iYVSMfRKT8Pur7WQZ9DdmX7xroCjJuUeTnfSSI/8vmysdy1sCRipA4L2k30biQyLIfEPYHDeZlOiKNX1BEX7hBz4JaSuBL5KaRAbip6XHCJrTFag2XoCRymhqnIWnbc3ReAaJj6GX+pwvRuIkf5l+s89d5vWY2xhFrAd6g3OSwG8JiDnJriYECb1mP9wMyiOqm17znvpuTn146yYBCt0YLqQJfI/2zas='

pass 7385288 2023-08-31 04:15:25 2023-08-31 05:25:19 2023-08-31 06:07:00 0:41:41 0:35:40 0:06:01 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} 3
pass 7385289 2023-08-31 04:15:26 2023-08-31 06:54:07 4584 smithi main ubuntu 20.04 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} 2
pass 7385290 2023-08-31 04:15:27 2023-08-31 06:07:48 2099 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} 2
fail 7385291 2023-08-31 04:15:27 2023-08-31 05:25:51 2023-08-31 05:34:14 0:08:23 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} 2
fail 7385292 2023-08-31 04:15:28 2023-08-31 05:27:11 2023-08-31 05:34:52 0:07:41 smithi main centos 9.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} 2
fail 7385293 2023-08-31 04:15:29 2023-08-31 05:27:42 2023-08-31 12:21:53 6:54:11 6:43:19 0:10:52 smithi main centos 8.stream fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/valgrind} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi031 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

pass 7385294 2023-08-31 04:15:30 2023-08-31 06:06:16 1592 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
pass 7385295 2023-08-31 04:15:30 2023-08-31 05:29:13 2023-08-31 06:30:26 1:01:13 0:47:41 0:13:32 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} 3
fail 7385296 2023-08-31 04:15:31 2023-08-31 05:30:53 2023-08-31 05:38:34 0:07:41 smithi main ubuntu 22.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} 2
Failure Reason:

Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIEFiICQDiPEnz9C/i8QqGMGUK+coMmnumDNW7HfNDNzB', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCj63dFdayjzmnDOu1S3He1LNA0FLFxk0LX9kTpoOIeZq8dXXTpkp++jtMnZ8+moPdOiD/HV8fsvk/WC/MZBlGRg8Rwfheh1KfY/9jMmGIiNDDZI3rTrxP8xscqNpgD3yyXBd4e7VqaZ+cOpoPEdyhzzjwGV24Mm80opX1xLhDAI9wqI4p40UDJtQTlYi4AyYINw13O+kspOeGeqvUkEmmcd77VpcD+WCDYxLSxI6XLtBI/PBzpFU7yH8DN2PYmji8t7Oj1amadXKsZoQQKX+A6svn9FnmDJDcs+Ue6zuZRAm/4pGBdR4oyUk4kKOrBUwrLykmXututisOZmxXPGA6fbqY316vVjSt4Ly9uQmkr54CQKFw6bMfcAJ6yuaWHv8y+WoyJY/XzPsWYr06pUze2/zFOBTWxXOIsjy3WXjr5Fy8oeXkyDtMUmIT4EOvTanvmv1n9H3Z1O05vwNa0xBOQuZakUv8dNX+Gj5B6BBxRMMkiBwFT1UrJNRRbMIyuOfc='

fail 7385297 2023-08-31 04:15:32 2023-08-31 05:30:54 2023-08-31 12:00:38 6:29:44 6:21:59 0:07:45 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi116 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

pass 7385298 2023-08-31 04:15:33 2023-08-31 06:38:46 3392 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} 2
pass 7385299 2023-08-31 04:15:33 2023-08-31 05:31:34 2023-08-31 05:53:12 0:21:38 0:14:42 0:06:56 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} 2
fail 7385300 2023-08-31 04:15:34 2023-08-31 05:31:55 2023-08-31 05:40:00 0:08:05 smithi main centos 9.stream fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-dbench}} 3
pass 7385301 2023-08-31 04:15:35 2023-08-31 05:32:25 2023-08-31 06:58:28 1:26:03 1:15:20 0:10:43 smithi main rhel 8.6 fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} 2
fail 7385302 2023-08-31 04:15:36 2023-08-31 05:33:06 2023-08-31 05:40:43 0:07:37 smithi main ubuntu 22.04 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
Failure Reason:

Host key for server 'smithi174.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIJ+/9V9dqXj9AQnC+i7GuRriN0N5FAm9Obejut8UFZGT', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC/1DPVuSiAdefrG3uqTz2XdlUSnG1v4Rxpa00SuigrqamMxA39iI9LP5MrwJMSqcopH0lyXL9qFfP4jblWAVi7RIbN5JajhV/+ULJQZF7++QWSJZLS9TW7KopvXbbZl9DdFa+0hjpuU4NXNU29DpjER2LPdxfN3XwCeMgI7cG79kbWN2DNVmYFTcnlGbGXpqTK31iwRY3w8flR85RzzSpvT7OoDarGddupGD2KZ3DD2M+dcEVLE0SfhqzFRCC/K/DUU/BhLuOrrTb4rqmL0MXeGmRW57ZL3yCszIdktpMmD/9rte/6RlGvYisvUods0dcxV6NiISHUaBTz20zZoigOP4TQ4DMlStNOMuR8TGcuwm48Tx5/m2/UdOutHOe2dBVn6v/qN9PbL4bY9QXalyMRHxcfEyLDbHZd68HARFo8AZ3Oiv8yVBTb9YlK0Kf+uHNJ17y+oVXM+gAGlw9wKuQFj5kUFQhAOCSph/2px5w/U8K+O/hEP04UdcJtJh2cvLM='

fail 7385303 2023-08-31 04:15:36 2023-08-31 05:33:06 2023-08-31 05:41:54 0:08:48 smithi main ubuntu 22.04 fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
Failure Reason:

Host key for server 'smithi169.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIA4ooF4BqN1tJMIcdZhM//4iWpW4WNFxkj9Q3rRnREFq', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC/sUp8S30dFklWu3dh1JI/3zEzQXzd3vmy8kpekQ3QUKWPz3+XbFGpHg9XtkKwq7Rro7CPG527rcu5Fvqud6sj/9tN52Wubob2WG5vqIuJK3JcUek7oDeShqEaoOHQuJzoYyMUboeXJB5aEYTy+1ndfF+tw7Sk7Wy+ZhK07gRLnwm5Qq/wCSeq225xYNMXEdwTCcYUrEbBt+dg22N8yh84w06NXtw5d/nmlIochX/aVgXQnJSkXVvC/h/arkdrSBM8xH5g25KgdsmrkmGT6Kc9IGFtHdCgaCBTDCueqDBag2U4XH3RLNyb8lgD/JOpeAsaeemR9OJOb3CL/riF0gXHG7Nx87d7lLlSXg0UzHN1IDaP8p6DsQABq+rqlaDggVx1EJFdhxeM/Om9pwSMlrh9UTEiTOOMWiYxuJFsE3gJyDxWj4QGLmGqVVt5e7rd4t8TXrx9YqiYa3bMRkat7byDr/Zl9sdWpmmHKeR6TwdIr6AOVnI/7ssQ3PBIDGogdjE='

pass 7385304 2023-08-31 04:15:37 2023-08-31 05:34:17 2023-08-31 06:02:37 0:28:20 0:16:55 0:11:25 smithi main ubuntu 22.04 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} 2
pass 7385305 2023-08-31 04:15:38 2023-08-31 06:25:08 2167 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
fail 7385306 2023-08-31 04:15:39 2023-08-31 05:37:58 2023-08-31 06:05:34 0:27:36 0:16:48 0:10:48 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} 2
Failure Reason:

Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)

pass 7385307 2023-08-31 04:15:39 2023-08-31 06:21:11 2075 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/iozone}} 3
fail 7385308 2023-08-31 04:15:40 2023-08-31 05:47:14 smithi main centos 9.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7385309 2023-08-31 04:15:41 2023-08-31 05:40:19 2023-08-31 06:15:52 0:35:33 0:23:55 0:11:38 smithi main centos 8.stream fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health} 2
pass 7385310 2023-08-31 04:15:42 2023-08-31 06:21:52 1826 smithi main rhel 8.6 fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} 2
dead 7385311 2023-08-31 04:15:42 2023-08-31 05:51:09 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 5
Failure Reason:

Error reimaging machines: Expected smithi136's OS to be ubuntu 22.04 but found rhel 8.6

dead 7385312 2023-08-31 04:15:43 2023-08-31 05:45:51 2023-08-31 05:53:03 0:07:12 smithi main rhel 8.6 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

SSH connection to smithi136 was lost: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_g1931c6efd6a8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/ --input-file=-'

pass 7385313 2023-08-31 04:15:44 2023-08-31 05:45:52 2023-08-31 06:16:21 0:30:29 0:19:19 0:11:10 smithi main ubuntu 20.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 7385314 2023-08-31 04:15:45 2023-08-31 05:46:12 2023-08-31 05:54:17 0:08:05 smithi main centos 9.stream fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7385315 2023-08-31 04:15:45 2023-08-31 05:47:23 2023-08-31 06:17:42 0:30:19 0:17:46 0:12:33 smithi main centos 8.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2
fail 7385316 2023-08-31 04:15:46 2023-08-31 05:48:33 2023-08-31 05:58:10 0:09:37 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} 2
dead 7385317 2023-08-31 04:15:47 2023-08-31 05:51:04 2023-08-31 05:57:59 0:06:55 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
Failure Reason:

Error reimaging machines: Expected smithi136's OS to be centos 8 but found rhel 8.6

dead 7385318 2023-08-31 04:15:47 2023-08-31 05:51:24 2023-08-31 06:09:48 0:18:24 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7385319 2023-08-31 04:15:48 2023-08-31 05:51:25 2023-08-31 06:28:15 0:36:50 0:28:51 0:07:59 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} 2
fail 7385320 2023-08-31 04:15:49 2023-08-31 05:53:06 2023-08-31 07:02:16 1:09:10 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/pjd}} 3
Failure Reason:

machine smithi136.front.sepia.ceph.com is not locked

pass 7385321 2023-08-31 04:15:50 2023-08-31 05:53:16 2023-08-31 06:23:26 0:30:10 0:17:57 0:12:13 smithi main centos 8.stream fs/upgrade/nofs/{bluestore-bitmap centos_8 conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} 1
pass 7385322 2023-08-31 04:15:50 2023-08-31 05:53:56 2023-08-31 06:27:20 0:33:24 0:22:56 0:10:28 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} 2
pass 7385323 2023-08-31 04:15:51 2023-08-31 05:54:27 2023-08-31 06:26:44 0:32:17 0:24:07 0:08:10 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} 2
pass 7385324 2023-08-31 04:15:52 2023-08-31 05:55:27 2023-08-31 06:20:50 0:25:23 0:14:17 0:11:06 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}} 2
pass 7385325 2023-08-31 04:15:52 2023-08-31 05:55:38 2023-08-31 08:04:25 2:08:47 1:57:34 0:11:13 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} 2
pass 7385326 2023-08-31 04:15:53 2023-08-31 05:57:18 2023-08-31 06:23:15 0:25:57 0:19:33 0:06:24 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} 2
fail 7385327 2023-08-31 04:15:54 2023-08-31 05:58:09 2023-08-31 06:04:52 0:06:43 smithi main centos 9.stream fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} 2
pass 7385328 2023-08-31 04:15:54 2023-08-31 05:58:09 2023-08-31 06:39:21 0:41:12 0:34:27 0:06:45 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} 3
pass 7385329 2023-08-31 04:15:55 2023-08-31 05:58:20 2023-08-31 06:19:37 0:21:17 0:15:04 0:06:13 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} 2
pass 7385330 2023-08-31 04:15:56 2023-08-31 05:58:30 2023-08-31 06:31:37 0:33:07 0:21:34 0:11:33 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} 2
pass 7385331 2023-08-31 04:15:56 2023-08-31 05:58:40 2023-08-31 06:32:29 0:33:49 0:21:32 0:12:17 smithi main centos 8.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} 2
pass 7385332 2023-08-31 04:15:57 2023-08-31 05:59:11 2023-08-31 06:32:24 0:33:13 0:21:31 0:11:42 smithi main centos 8.stream fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 7385333 2023-08-31 04:15:58 2023-08-31 05:59:21 2023-08-31 06:31:54 0:32:33 0:19:10 0:13:23 smithi main ubuntu 22.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
fail 7385334 2023-08-31 04:15:58 2023-08-31 06:01:12 2023-08-31 06:08:28 0:07:16 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} 2
pass 7385335 2023-08-31 04:15:59 2023-08-31 06:01:12 2023-08-31 07:01:08 0:59:56 0:49:57 0:09:59 smithi main rhel 8.6 fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} 2
pass 7385336 2023-08-31 04:16:00 2023-08-31 06:02:13 2023-08-31 06:42:07 0:39:54 0:25:13 0:14:41 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
fail 7385337 2023-08-31 04:16:00 2023-08-31 06:04:53 2023-08-31 06:12:36 0:07:43 smithi main centos 9.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
pass 7385338 2023-08-31 04:16:01 2023-08-31 06:05:44 2023-08-31 06:54:11 0:48:27 0:37:18 0:11:09 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} 2
pass 7385339 2023-08-31 04:16:02 2023-08-31 06:06:24 2023-08-31 08:22:22 2:15:58 2:05:14 0:10:44 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/misc}} 3
pass 7385340 2023-08-31 04:16:02 2023-08-31 06:07:05 2023-08-31 06:44:37 0:37:32 0:31:00 0:06:32 smithi main rhel 8.6 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
fail 7385341 2023-08-31 04:16:03 2023-08-31 06:07:05 2023-08-31 06:16:11 0:09:06 smithi main centos 9.stream fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
fail 7385342 2023-08-31 04:16:04 2023-08-31 06:07:56 2023-08-31 06:16:37 0:08:41 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 4
Failure Reason:

Host key for server 'smithi084.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIAEDkuP6zAalh1Awcf274m51XO9v/jan1rAHXbnJHLxA', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDJZEZHZGWJUqCibWYU4Q+4N8oAnKvUF4POlewfKkRe5FvLtNiSuPA+0NvRFWLCK2hqcYbD/NVMCJO5R0M1ObcgQJ02fZYpMHDMOqJouyRYezZXZwx0zpLG6YvLbYlM/KNg8Z5gVpUg+CdTACPQgdPDpYWXeW9CY3lm62oFWEgM3w0W6BMrO7AdEp3K0gY47v90BoVBFERbFWNKFLSU8xyLKjpgTzL77UX26RiUvadBpOHfU1LNYb6VFn2Xle1fP4gFf1ZbY4JNAgxndm9Wtj7sNT/GuAy3Q5RG7JufyfI2/OhhWFeM8RXj4uAgDn/uw8zmQmDqq+HTucHbvo4OksENi7fYLqwJAe5XRsRJw4khehdKUzYrfP8EH8G4zhUFba9Y1O/c97Jih1TCCjjc/Ofm5yPOe4f1hKHgusTK7X9ZR4YB301ABkYL7WukLh3MbWzgwmXx4Tbh2GBkUjU088pI+OiQXGfmcB7zIu7oQTwkRIZTxlaug54RjOzcLw4toBs='

dead 7385343 2023-08-31 04:16:04 2023-08-31 06:08:46 2023-08-31 06:29:12 0:20:26 smithi main rhel 8.6 fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7385344 2023-08-31 04:16:05 2023-08-31 06:10:07 2023-08-31 06:56:36 0:46:29 0:39:01 0:07:28 smithi main rhel 8.6 fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7385345 2023-08-31 04:16:06 2023-08-31 06:11:17 2023-08-31 07:22:34 1:11:17 1:00:42 0:10:35 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} 2
pass 7385346 2023-08-31 04:16:07 2023-08-31 06:11:38 2023-08-31 06:39:31 0:27:53 0:21:39 0:06:14 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} 2
pass 7385347 2023-08-31 04:16:07 2023-08-31 06:12:18 2023-08-31 06:59:40 0:47:22 0:35:15 0:12:07 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
pass 7385348 2023-08-31 04:16:08 2023-08-31 06:12:39 2023-08-31 06:43:02 0:30:23 0:16:43 0:13:40 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} 2
pass 7385349 2023-08-31 04:16:09 2023-08-31 06:15:59 2023-08-31 07:24:29 1:08:30 0:56:54 0:11:36 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} 2
pass 7385350 2023-08-31 04:16:09 2023-08-31 06:16:20 2023-08-31 06:54:03 0:37:43 0:25:09 0:12:34 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} 3
pass 7385351 2023-08-31 04:16:10 2023-08-31 06:16:30 2023-08-31 07:55:56 1:39:26 1:33:22 0:06:04 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} 3
pass 7385352 2023-08-31 04:16:11 2023-08-31 06:16:41 2023-08-31 06:50:00 0:33:19 0:22:02 0:11:17 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} 2
pass 7385353 2023-08-31 04:16:11 2023-08-31 06:16:51 2023-08-31 06:55:40 0:38:49 0:25:55 0:12:54 smithi main centos 8.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 7385354 2023-08-31 04:16:12 2023-08-31 06:17:52 2023-08-31 06:48:46 0:30:54 0:22:35 0:08:19 smithi main rhel 8.6 fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} 2
fail 7385355 2023-08-31 04:16:13 2023-08-31 06:19:42 2023-08-31 14:18:38 7:58:56 7:51:17 0:07:39 smithi main rhel 8.6 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} 2
Failure Reason:

Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)

pass 7385356 2023-08-31 04:16:13 2023-08-31 06:20:53 2023-08-31 06:58:22 0:37:29 0:26:36 0:10:53 smithi main centos 8.stream fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} 2
fail 7385357 2023-08-31 04:16:14 2023-08-31 06:21:13 2023-08-31 06:28:52 0:07:39 smithi main ubuntu 22.04 fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
Failure Reason:

Host key for server 'smithi129.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIDpdwt7qCWipf0JiurJWXW7gnT2rcc97L4YM0qjff6ia', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDgOJOndxt1ZzvJ6UPWQTMwVLyYiM/SUuQ1HW66XCZvImP0gDJvfKl8W1AN7aTEPtCVhCkSUt5Q0ZlsVgafeXGCzx2L0EzJqHqPDZUmh4G4euJjYasXve9YuGi+5/O4gL9kzNkLU4dWZuzxk5qlQqcV40vHJUGynn3RdfVZTGk5ISdMYkNNZDPGbkwL+gXLTiQahsi8Z+iI+g3bRvcYpqBRhk4XF7s/EWb/IZ3RIBB1sP4Ui3TgbhC4hrkV1FRc/j9ZtcN4GTOB1TwyDs6hf06JnoUlmucMxm3nnTHoxZCgDOBFtqwYbmtud33pXdp/m9WEp0JUe8ZvGUOc8M4uxH0B+ceB1w54qV3teM+jKhsgseOwkrgtmS88DSfK+ICIZniRnQOlAbUSok9JbXx2zCGWi18SrBk0TnsOZAHbq4IXrvdBMNwz52xDScNfqwcOeqTuxYmt+8gZ6WsgLJRWvUu1Nc/0/UvD+VATr8Bj9UdYDy3eb0qrbYi7SE/Dv20Nv6U='

fail 7385358 2023-08-31 04:16:15 2023-08-31 06:21:14 2023-08-31 06:49:02 0:27:48 0:17:06 0:10:42 smithi main centos 8.stream fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} 2
Failure Reason:

Command failed (workunit test fs/test_python.sh) on smithi083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh'

pass 7385359 2023-08-31 04:16:15 2023-08-31 06:21:54 2023-08-31 06:53:42 0:31:48 0:19:32 0:12:16 smithi main ubuntu 20.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7385360 2023-08-31 04:16:16 2023-08-31 06:23:25 2023-08-31 06:48:27 0:25:02 0:17:36 0:07:26 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
pass 7385361 2023-08-31 04:16:17 2023-08-31 06:25:15 2023-08-31 07:42:40 1:17:25 1:04:56 0:12:29 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/postgres}} 3
fail 7385362 2023-08-31 04:16:17 2023-08-31 06:26:46 2023-08-31 06:56:35 0:29:49 0:18:47 0:11:02 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} 2
Failure Reason:

Command failed (workunit test fs/quota/quota.sh) on smithi102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c8583a87a5de28b8b0ab93d1f128c1a38a1bf71 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh'

pass 7385363 2023-08-31 04:16:18 2023-08-31 06:27:26 2023-08-31 07:12:07 0:44:41 0:31:40 0:13:01 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} 3
dead 7385364 2023-08-31 04:16:19 2023-08-31 06:28:57 2023-08-31 06:42:23 0:13:26 smithi main rhel 8.6 fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
Failure Reason:

Error reimaging machines: Timeout opening channel.

pass 7385365 2023-08-31 04:16:20 2023-08-31 06:29:27 2023-08-31 07:02:11 0:32:44 0:18:23 0:14:21 smithi main ubuntu 20.04 fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} 2
dead 7385366 2023-08-31 04:16:20 2023-08-31 06:30:28 2023-08-31 18:40:04 12:09:36 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

hit max job timeout

pass 7385367 2023-08-31 04:16:21 2023-08-31 06:30:28 2023-08-31 06:56:44 0:26:16 0:19:17 0:06:59 smithi main rhel 8.6 fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} 2
pass 7385368 2023-08-31 04:16:22 2023-08-31 06:31:39 2023-08-31 08:24:02 1:52:23 1:39:38 0:12:45 smithi main centos 8.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} 2
fail 7385369 2023-08-31 04:16:22 2023-08-31 06:31:59 2023-08-31 07:25:44 0:53:45 0:46:29 0:07:16 smithi main rhel 8.6 fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}