User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2023-08-15 16:56:50 | 2023-08-15 21:50:04 | 2023-08-16 04:13:57 | 6:23:53 | fs | wip-yuri7-testing-2023-08-15-0741-pacific | smithi | a73b87c | 5 | 86 | 80 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 7368817 | 2023-08-15 16:57:48 | 2023-08-15 21:42:23 | 2023-08-15 22:13:09 | 0:30:46 | 0:17:34 | 0:13:12 | smithi | main | ubuntu | 20.04 | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} | 2 | |
Failure Reason:
"2023-08-15T22:04:09.069599+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368818 | 2023-08-15 16:57:49 | 2023-08-15 21:43:22 | 2023-08-15 21:48:57 | 0:05:35 | smithi | main | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi188 |
||||||||||||||
dead | 7368819 | 2023-08-15 16:57:50 | 2023-08-15 21:45:08 | 2023-08-16 03:04:00 | 5:18:52 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi181' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368820 | 2023-08-15 16:57:51 | 2023-08-15 21:45:41 | 2023-08-15 21:56:53 | 0:11:12 | 0:03:23 | 0:07:49 | smithi | main | centos | 8.stream | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} | 2 | |
Failure Reason:
['/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."] |
||||||||||||||
dead | 7368821 | 2023-08-15 16:57:52 | 2023-08-15 21:46:17 | 2023-08-15 21:50:53 | 0:04:36 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi160's OS to be centos 8 but found ubuntu 22.04 |
||||||||||||||
dead | 7368822 | 2023-08-15 16:57:53 | 2023-08-15 21:47:25 | 2023-08-15 21:51:09 | 0:03:44 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi149's OS to be ubuntu 20.04 but found centos 9 |
||||||||||||||
dead | 7368823 | 2023-08-15 16:57:54 | 2023-08-15 21:47:25 | 2023-08-15 21:51:07 | 0:03:42 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi033's OS to be rhel 8.4 but found rhel 8.6 |
||||||||||||||
fail | 7368824 | 2023-08-15 16:57:54 | 2023-08-15 21:48:05 | 2023-08-15 23:20:49 | 1:32:44 | 0:17:16 | 1:15:28 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} | 2 | |
Failure Reason:
"2023-08-15T23:09:46.309989+0000 mgr.x (mgr.4123) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368825 | 2023-08-15 16:57:55 | 2023-08-15 21:48:16 | 2023-08-15 21:55:33 | 0:07:17 | smithi | main | ubuntu | 20.04 | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi086's OS to be ubuntu 20.04 but found rhel 8.6 |
||||||||||||||
dead | 7368826 | 2023-08-15 16:57:56 | 2023-08-15 21:49:03 | 2023-08-15 21:50:49 | 0:01:46 | smithi | main | rhel | 8.4 | fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} | 2 | |||
Failure Reason:
Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/191/task |
||||||||||||||
dead | 7368827 | 2023-08-15 16:57:57 | 2023-08-15 21:49:23 | 2023-08-15 21:55:33 | 0:06:10 | smithi | main | rhel | 8.4 | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi086's OS to be rhel 8.4 but found rhel 8.6 |
||||||||||||||
dead | 7368828 | 2023-08-15 16:57:58 | 2023-08-15 21:49:35 | 2023-08-15 21:55:45 | 0:06:10 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} | 4 | |||
Failure Reason:
Error reimaging machines: Expected smithi099's OS to be ubuntu 20.04 but found ubuntu 22.04 |
||||||||||||||
fail | 7368829 | 2023-08-15 16:57:59 | 2023-08-15 21:49:59 | 2023-08-15 22:21:25 | 0:31:26 | 0:19:10 | 0:12:16 | smithi | main | centos | 8.stream | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T22:12:50.440455+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368830 | 2023-08-15 16:58:00 | 2023-08-15 21:50:04 | 2023-08-15 21:56:14 | 0:06:10 | smithi | main | centos | 8.stream | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi170's OS to be centos 8 but found ubuntu 22.04 |
||||||||||||||
dead | 7368831 | 2023-08-15 16:58:00 | 2023-08-15 21:50:16 | 2023-08-15 21:54:37 | 0:04:21 | smithi | main | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi052 |
||||||||||||||
dead | 7368832 | 2023-08-15 16:58:01 | 2023-08-15 21:50:42 | 2023-08-15 21:56:00 | 0:05:18 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi103's OS to be rhel 8.4 but found ubuntu 22.04 |
||||||||||||||
dead | 7368833 | 2023-08-15 16:58:02 | 2023-08-15 21:50:43 | 2023-08-16 03:10:32 | 5:19:49 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi151' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368834 | 2023-08-15 16:58:03 | 2023-08-15 21:50:53 | 2023-08-16 03:09:51 | 5:18:58 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi173' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368835 | 2023-08-15 16:58:04 | 2023-08-15 21:51:35 | 2023-08-15 21:55:19 | 0:03:44 | smithi | main | centos | 8.stream | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi142's OS to be centos 8 but found centos 9 |
||||||||||||||
dead | 7368836 | 2023-08-15 16:58:05 | 2023-08-15 21:51:36 | 2023-08-15 21:55:01 | 0:03:25 | smithi | main | rhel | 8.4 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi195 |
||||||||||||||
dead | 7368837 | 2023-08-15 16:58:05 | 2023-08-15 21:51:36 | 2023-08-15 21:55:33 | 0:03:57 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi033's OS to be ubuntu 20.04 but found rhel 8.6 |
||||||||||||||
dead | 7368838 | 2023-08-15 16:58:06 | 2023-08-15 21:52:01 | 2023-08-15 21:55:24 | 0:03:23 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi149's OS to be rhel 8.4 but found centos 9 |
||||||||||||||
dead | 7368839 | 2023-08-15 16:58:07 | 2023-08-15 21:52:02 | 2023-08-15 21:56:54 | 0:04:52 | smithi | main | centos | 8.stream | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi105's OS to be centos 8 but found ubuntu 22.04 |
||||||||||||||
dead | 7368840 | 2023-08-15 16:58:08 | 2023-08-15 21:53:05 | 2023-08-15 21:56:35 | 0:03:30 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi194's OS to be centos 8 but found centos 9 |
||||||||||||||
fail | 7368841 | 2023-08-15 16:58:09 | 2023-08-15 21:53:41 | 2023-08-15 23:23:28 | 1:29:47 | 0:17:17 | 1:12:30 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} | 2 | |
Failure Reason:
"2023-08-15T23:14:25.649383+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368842 | 2023-08-15 16:58:10 | 2023-08-15 21:54:26 | 2023-08-15 23:26:59 | 1:32:33 | 0:19:28 | 1:13:05 | smithi | main | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 | |
Failure Reason:
"2023-08-15T23:18:27.062233+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368843 | 2023-08-15 16:58:11 | 2023-08-15 21:54:27 | 2023-08-15 22:26:16 | 0:31:49 | 0:19:17 | 0:12:32 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} | 2 | |
Failure Reason:
"2023-08-15T22:16:29.767896+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368844 | 2023-08-15 16:58:11 | 2023-08-15 21:55:34 | 2023-08-15 22:27:18 | 0:31:44 | 0:18:13 | 0:13:31 | smithi | main | centos | 8.stream | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} | 2 | |
Failure Reason:
"2023-08-15T22:16:51.067810+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368845 | 2023-08-15 16:58:12 | 2023-08-15 21:55:34 | 2023-08-15 22:33:37 | 0:38:03 | 0:20:15 | 0:17:48 | smithi | main | ubuntu | 20.04 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} | 2 | |
Failure Reason:
"2023-08-15T22:22:57.065660+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368846 | 2023-08-15 16:58:13 | 2023-08-15 21:55:34 | 2023-08-15 22:26:37 | 0:31:03 | 0:17:31 | 0:13:32 | smithi | main | ubuntu | 20.04 | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} | 2 | |
Failure Reason:
"2023-08-15T22:17:36.293743+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368847 | 2023-08-15 16:58:14 | 2023-08-15 21:56:18 | 2023-08-15 21:57:35 | 0:01:17 | smithi | main | ubuntu | 20.04 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} | 2 | |||
Failure Reason:
Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/144/task |
||||||||||||||
dead | 7368848 | 2023-08-15 16:58:15 | 2023-08-15 21:56:42 | 2023-08-15 22:02:46 | 0:06:04 | smithi | main | ubuntu | 20.04 | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi039's OS to be ubuntu 20.04 but found rhel 8.4 |
||||||||||||||
dead | 7368849 | 2023-08-15 16:58:16 | 2023-08-15 21:56:42 | 2023-08-15 22:00:05 | 0:03:23 | smithi | main | ubuntu | 20.04 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi149's OS to be ubuntu 20.04 but found centos 9 |
||||||||||||||
dead | 7368850 | 2023-08-15 16:58:17 | 2023-08-15 21:57:08 | 2023-08-15 22:00:10 | 0:03:02 | smithi | main | centos | 8.stream | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi167's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368851 | 2023-08-15 16:58:17 | 2023-08-15 21:57:18 | 2023-08-15 22:00:28 | 0:03:10 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi067's OS to be ubuntu 20.04 but found centos 9 |
||||||||||||||
dead | 7368852 | 2023-08-15 16:58:18 | 2023-08-15 21:57:18 | 2023-08-15 21:59:27 | 0:02:09 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi079 |
||||||||||||||
dead | 7368853 | 2023-08-15 16:58:19 | 2023-08-15 21:57:19 | 2023-08-15 22:00:33 | 0:03:14 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi102's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368854 | 2023-08-15 16:58:20 | 2023-08-15 21:57:19 | 2023-08-15 22:00:43 | 0:03:24 | smithi | main | centos | 8.stream | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi110 |
||||||||||||||
dead | 7368855 | 2023-08-15 16:58:21 | 2023-08-15 21:57:35 | 2023-08-15 22:02:24 | 0:04:49 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} | 5 | |||
Failure Reason:
Error reimaging machines: Expected smithi194's OS to be ubuntu 20.04 but found centos 9 |
||||||||||||||
dead | 7368856 | 2023-08-15 16:58:22 | 2023-08-15 21:57:50 | 2023-08-15 22:02:48 | 0:04:58 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi039's OS to be ubuntu 20.04 but found rhel 8.4 |
||||||||||||||
dead | 7368857 | 2023-08-15 16:58:23 | 2023-08-15 21:58:16 | 2023-08-15 22:02:05 | 0:03:49 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi105's OS to be rhel 8.4 but found ubuntu 22.04 |
||||||||||||||
dead | 7368858 | 2023-08-15 16:58:23 | 2023-08-15 21:58:16 | 2023-08-15 22:02:18 | 0:04:02 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi131's OS to be rhel 8.4 but found centos 8 |
||||||||||||||
dead | 7368859 | 2023-08-15 16:58:24 | 2023-08-15 21:58:16 | 2023-08-15 22:01:59 | 0:03:43 | smithi | main | centos | 8.stream | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi123's OS to be centos 8 but found rhel 8.6 |
||||||||||||||
dead | 7368860 | 2023-08-15 16:58:25 | 2023-08-15 21:58:37 | 2023-08-15 22:01:58 | 0:03:21 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi005's OS to be ubuntu 20.04 but found rhel 8.6 |
||||||||||||||
pass | 7368861 | 2023-08-15 16:58:26 | 2023-08-15 21:58:42 | 2023-08-15 22:42:20 | 0:43:38 | 0:30:10 | 0:13:28 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |
fail | 7368862 | 2023-08-15 16:58:27 | 2023-08-15 22:00:43 | 2023-08-15 22:35:20 | 0:34:37 | 0:20:22 | 0:14:15 | smithi | main | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} | 3 | |
Failure Reason:
"2023-08-15T22:24:45.830409+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368863 | 2023-08-15 16:58:28 | 2023-08-15 22:01:27 | 2023-08-15 22:31:51 | 0:30:24 | 0:21:13 | 0:09:11 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} | 2 | |
Failure Reason:
"2023-08-15T22:23:28.339451+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368864 | 2023-08-15 16:58:29 | 2023-08-15 22:01:32 | 2023-08-15 22:36:59 | 0:35:27 | 0:22:26 | 0:13:01 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 | |
Failure Reason:
"2023-08-15T22:25:58.054125+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368865 | 2023-08-15 16:58:29 | 2023-08-15 22:01:38 | 2023-08-15 22:38:46 | 0:37:08 | 0:22:26 | 0:14:42 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} | 2 | |
Failure Reason:
"2023-08-15T22:30:40.104667+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368866 | 2023-08-15 16:58:30 | 2023-08-15 22:01:51 | 2023-08-15 22:35:20 | 0:33:29 | 0:18:59 | 0:14:30 | smithi | main | rhel | 8.4 | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T22:25:38.652808+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368867 | 2023-08-15 16:58:31 | 2023-08-15 22:01:51 | 2023-08-15 22:36:41 | 0:34:50 | 0:19:03 | 0:15:47 | smithi | main | centos | 8.stream | fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} | 2 | |
Failure Reason:
"2023-08-15T22:27:36.896498+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368868 | 2023-08-15 16:58:32 | 2023-08-15 22:03:32 | 2023-08-15 22:35:20 | 0:31:48 | 0:18:40 | 0:13:08 | smithi | main | rhel | 8.4 | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T22:25:29.561470+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368869 | 2023-08-15 16:58:33 | 2023-08-15 22:03:56 | 2023-08-15 22:29:23 | 0:25:27 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |||
Failure Reason:
Failed to reconnect to smithi039 |
||||||||||||||
fail | 7368870 | 2023-08-15 16:58:34 | 2023-08-15 22:03:57 | 2023-08-15 22:42:17 | 0:38:20 | 0:23:59 | 0:14:21 | smithi | main | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} | 2 | |
Failure Reason:
"2023-08-15T22:32:13.498063+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368871 | 2023-08-15 16:58:35 | 2023-08-15 22:04:02 | 2023-08-15 23:38:10 | 1:34:08 | 0:20:04 | 1:14:04 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} | 2 | |
Failure Reason:
"2023-08-15T23:28:43.745271+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368872 | 2023-08-15 16:58:35 | 2023-08-15 22:04:17 | 2023-08-15 22:37:25 | 0:33:08 | 0:18:13 | 0:14:55 | smithi | main | centos | 8.stream | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}} | 3 | |
Failure Reason:
"2023-08-15T22:28:53.214052+0000 mgr.z (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368873 | 2023-08-15 16:58:36 | 2023-08-15 22:04:53 | 2023-08-15 22:20:51 | 0:15:58 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} | 2 | |||
Failure Reason:
Command failed on smithi039 with status 1: 'sudo yum install -y kernel' |
||||||||||||||
dead | 7368874 | 2023-08-15 16:58:37 | 2023-08-15 22:04:53 | 2023-08-15 22:13:43 | 0:08:50 | smithi | main | centos | 8.stream | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi131's OS to be centos 8 but found rhel 8.4 |
||||||||||||||
fail | 7368875 | 2023-08-15 16:58:38 | 2023-08-15 22:05:14 | 2023-08-15 22:16:13 | 0:10:59 | smithi | main | rhel | 8.4 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} | 2 | |||
Failure Reason:
[Errno None] Unable to connect to port 22 on 172.21.15.131 |
||||||||||||||
fail | 7368876 | 2023-08-15 16:58:39 | 2023-08-15 22:05:44 | 2023-08-15 23:36:43 | 1:30:59 | 0:18:35 | 1:12:24 | smithi | main | ubuntu | 20.04 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} | 2 | |
Failure Reason:
"2023-08-15T23:26:43.574780+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368877 | 2023-08-15 16:58:40 | 2023-08-15 22:06:45 | 2023-08-15 22:09:45 | 0:03:00 | smithi | main | centos | 8.stream | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi055 |
||||||||||||||
pass | 7368878 | 2023-08-15 16:58:41 | 2023-08-15 22:06:53 | 2023-08-15 22:50:44 | 0:43:51 | 0:31:54 | 0:11:57 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |
dead | 7368879 | 2023-08-15 16:58:42 | 2023-08-15 22:07:14 | 2023-08-15 22:11:25 | 0:04:11 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi112's OS to be rhel 8.4 but found centos 9 |
||||||||||||||
dead | 7368880 | 2023-08-15 16:58:42 | 2023-08-15 22:07:24 | 2023-08-15 22:10:33 | 0:03:09 | smithi | main | centos | 8.stream | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi084's OS to be centos 8 but found centos 9 |
||||||||||||||
dead | 7368881 | 2023-08-15 16:58:43 | 2023-08-15 22:07:25 | 2023-08-15 22:10:33 | 0:03:08 | smithi | main | centos | 8.stream | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi150's OS to be centos 8 but found rhel 8.6 |
||||||||||||||
dead | 7368882 | 2023-08-15 16:58:44 | 2023-08-15 22:07:55 | 2023-08-15 22:11:20 | 0:03:25 | smithi | main | ubuntu | 20.04 | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi119's OS to be ubuntu 20.04 but found ubuntu 22.04 |
||||||||||||||
fail | 7368883 | 2023-08-15 16:58:45 | 2023-08-15 22:08:28 | 2023-08-15 22:42:18 | 0:33:50 | 0:17:57 | 0:15:53 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} | 4 | |
Failure Reason:
"2023-08-15T22:32:29.665338+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368884 | 2023-08-15 16:58:46 | 2023-08-15 22:09:03 | 2023-08-15 22:47:20 | 0:38:17 | 0:23:59 | 0:14:18 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} | 3 | |
Failure Reason:
"2023-08-15T22:38:45.149054+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368885 | 2023-08-15 16:58:47 | 2023-08-15 22:10:33 | 2023-08-15 22:48:10 | 0:37:37 | 0:23:07 | 0:14:30 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} | 2 | |
Failure Reason:
"2023-08-15T22:37:17.729737+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368886 | 2023-08-15 16:58:48 | 2023-08-15 22:10:34 | 2023-08-15 22:13:25 | 0:02:51 | smithi | main | ubuntu | 20.04 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi154 |
||||||||||||||
fail | 7368887 | 2023-08-15 16:58:48 | 2023-08-15 22:11:03 | 2023-08-15 22:47:00 | 0:35:57 | 0:19:54 | 0:16:03 | smithi | main | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 | |
Failure Reason:
"2023-08-15T22:37:07.461001+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368888 | 2023-08-15 16:58:49 | 2023-08-15 22:11:38 | 2023-08-15 22:48:10 | 0:36:32 | 0:20:34 | 0:15:58 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} | 2 | |
Failure Reason:
"2023-08-15T22:39:14.314150+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368889 | 2023-08-15 16:58:50 | 2023-08-15 22:12:22 | 2023-08-15 22:43:59 | 0:31:37 | 0:19:24 | 0:12:13 | smithi | main | centos | 8.stream | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} | 2 | |
Failure Reason:
"2023-08-15T22:34:46.102860+0000 mgr.x (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368890 | 2023-08-15 16:58:51 | 2023-08-15 22:13:14 | 2023-08-15 22:45:33 | 0:32:19 | 0:19:45 | 0:12:34 | smithi | main | rhel | 8.4 | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} | 2 | |
Failure Reason:
"2023-08-15T22:36:12.711471+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368891 | 2023-08-15 16:58:52 | 2023-08-15 22:13:14 | 2023-08-15 22:58:28 | 0:45:14 | 0:28:01 | 0:17:13 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} | 3 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7368892 | 2023-08-15 16:58:53 | 2023-08-15 22:13:15 | 2023-08-15 23:50:18 | 1:37:03 | 0:13:20 | 1:23:43 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} | 2 | |
Failure Reason:
['See stdout/stderr for the exact error', 'The module failed to execute correctly, you probably need to set the interpreter.'] |
||||||||||||||
fail | 7368893 | 2023-08-15 16:58:54 | 2023-08-15 22:14:54 | 2023-08-15 22:45:48 | 0:30:54 | 0:18:02 | 0:12:52 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} | 2 | |
Failure Reason:
"2023-08-15T22:36:56.626554+0000 mgr.x (mgr.4124) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368894 | 2023-08-15 16:58:55 | 2023-08-15 22:15:04 | 2023-08-15 22:25:08 | 0:10:04 | smithi | main | centos | 8.stream | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi154's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368895 | 2023-08-15 16:58:56 | 2023-08-15 22:16:30 | 2023-08-15 22:16:41 | 0:00:11 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} | 2 | |||
Failure Reason:
Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/237/task |
||||||||||||||
dead | 7368896 | 2023-08-15 16:58:57 | 2023-08-15 22:27:22 | smithi | main | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} | 2 | |||||
pass | 7368897 | 2023-08-15 16:58:57 | 2023-08-15 22:17:14 | 2023-08-15 23:03:28 | 0:46:14 | 0:34:29 | 0:11:45 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |
fail | 7368898 | 2023-08-15 16:58:58 | 2023-08-15 22:17:15 | 2023-08-15 22:30:25 | 0:13:10 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir} | 2 | |||
Failure Reason:
Failed to reconnect to smithi132 |
||||||||||||||
fail | 7368899 | 2023-08-15 16:58:59 | 2023-08-15 22:17:20 | 2023-08-15 22:53:36 | 0:36:16 | 0:20:32 | 0:15:44 | smithi | main | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} | 2 | |
Failure Reason:
"2023-08-15T22:42:02.591482+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368900 | 2023-08-15 16:59:00 | 2023-08-15 22:19:55 | 2023-08-15 22:53:20 | 0:33:25 | 0:19:35 | 0:13:50 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} | 2 | |
Failure Reason:
"2023-08-15T22:45:07.139846+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368901 | 2023-08-15 16:59:01 | 2023-08-15 22:20:29 | 2023-08-15 22:57:41 | 0:37:12 | 0:20:43 | 0:16:29 | smithi | main | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} | 3 | |
Failure Reason:
"2023-08-15T22:48:25.453427+0000 mgr.z (mgr.4121) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368902 | 2023-08-15 16:59:02 | 2023-08-15 22:22:16 | 2023-08-15 22:56:51 | 0:34:35 | 0:20:24 | 0:14:11 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 | |
Failure Reason:
"2023-08-15T22:46:12.208674+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368903 | 2023-08-15 16:59:03 | 2023-08-15 22:22:27 | 2023-08-15 22:47:20 | 0:24:53 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} | 2 | |||
Failure Reason:
failed to install new kernel version within timeout |
||||||||||||||
dead | 7368904 | 2023-08-15 16:59:04 | 2023-08-15 22:25:37 | 2023-08-15 22:37:17 | 0:11:40 | smithi | main | rhel | 8.4 | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi154's OS to be rhel 8.4 but found ubuntu 20.04 |
||||||||||||||
fail | 7368905 | 2023-08-15 16:59:04 | 2023-08-15 22:26:16 | 2023-08-15 22:56:55 | 0:30:39 | 0:19:24 | 0:11:15 | smithi | main | centos | 8.stream | fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} | 1 | |
Failure Reason:
"2023-08-15T22:46:11.540637+0000 mon.a (mon.0) 65 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
fail | 7368906 | 2023-08-15 16:59:05 | 2023-08-15 22:26:16 | 2023-08-15 23:01:51 | 0:35:35 | 0:23:49 | 0:11:46 | smithi | main | centos | 8.stream | fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} | 2 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7368907 | 2023-08-15 16:59:06 | 2023-08-15 22:26:16 | 2023-08-15 23:01:03 | 0:34:47 | 0:24:17 | 0:10:30 | smithi | main | rhel | 8.4 | fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} | 1 | |
Failure Reason:
"2023-08-15T22:46:23.103165+0000 mon.a (mon.0) 40 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
fail | 7368908 | 2023-08-15 16:59:07 | 2023-08-15 22:26:17 | 2023-08-15 23:04:30 | 0:38:13 | 0:23:29 | 0:14:44 | smithi | main | centos | 8.stream | fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} | 2 | |
Failure Reason:
"2023-08-15T22:55:07.203564+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368909 | 2023-08-15 16:59:08 | 2023-08-15 22:27:22 | 2023-08-15 22:59:32 | 0:32:10 | 0:18:39 | 0:13:31 | smithi | main | centos | 8.stream | fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror} | 1 | |
Failure Reason:
"2023-08-15T22:48:07.606425+0000 mon.a (mon.0) 68 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
fail | 7368910 | 2023-08-15 16:59:09 | 2023-08-15 22:27:27 | 2023-08-15 22:59:31 | 0:32:04 | 0:20:31 | 0:11:33 | smithi | main | rhel | 8.4 | fs/mirror-ha/{begin cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit} | 1 | |
Failure Reason:
"2023-08-15T22:48:22.528156+0000 mon.a (mon.0) 68 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
dead | 7368911 | 2023-08-15 16:59:09 | 2023-08-15 22:27:33 | 2023-08-15 22:30:36 | 0:03:03 | smithi | main | rhel | 8.4 | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi154 |
||||||||||||||
fail | 7368912 | 2023-08-15 16:59:10 | 2023-08-15 22:27:58 | 2023-08-15 22:39:49 | 0:11:51 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} | 5 | |||
Failure Reason:
timed out |
||||||||||||||
fail | 7368913 | 2023-08-15 16:59:11 | 2023-08-15 22:31:02 | 2023-08-15 22:59:38 | 0:28:36 | 0:18:17 | 0:10:19 | smithi | main | centos | 8.stream | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} | 2 | |
Failure Reason:
"2023-08-15T22:51:30.648213+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368914 | 2023-08-15 16:59:12 | 2023-08-15 22:31:02 | 2023-08-15 23:04:30 | 0:33:28 | 0:19:31 | 0:13:57 | smithi | main | rhel | 8.4 | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} | 2 | |
Failure Reason:
"2023-08-15T22:54:06.070552+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368915 | 2023-08-15 16:59:13 | 2023-08-15 22:32:09 | 2023-08-15 23:04:17 | 0:32:08 | 0:17:10 | 0:14:58 | smithi | main | ubuntu | 20.04 | fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} | 2 | |
Failure Reason:
"2023-08-15T22:54:26.920558+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368916 | 2023-08-15 16:59:14 | 2023-08-15 22:34:13 | 2023-08-15 23:06:47 | 0:32:34 | 0:19:27 | 0:13:07 | smithi | main | rhel | 8.4 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} | 2 | |
Failure Reason:
"2023-08-15T22:56:56.179698+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368917 | 2023-08-15 16:59:15 | 2023-08-15 22:35:40 | 2023-08-15 23:06:57 | 0:31:17 | 0:20:07 | 0:11:10 | smithi | main | rhel | 8.4 | fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/fstop} | 1 | |
Failure Reason:
"2023-08-15T22:55:53.223592+0000 mon.a (mon.0) 64 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
fail | 7368918 | 2023-08-15 16:59:15 | 2023-08-15 22:35:56 | 2023-08-15 23:06:47 | 0:30:51 | 0:17:57 | 0:12:54 | smithi | main | ubuntu | 20.04 | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} | 2 | |
Failure Reason:
"2023-08-15T22:57:19.784247+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368919 | 2023-08-15 16:59:16 | 2023-08-15 22:36:17 | 2023-08-15 23:26:07 | 0:49:50 | 0:35:51 | 0:13:59 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} | 3 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7368920 | 2023-08-15 16:59:17 | 2023-08-15 22:36:43 | 2023-08-15 23:22:28 | 0:45:45 | 0:32:38 | 0:13:07 | smithi | main | centos | 8.stream | fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} | 1 | |
Failure Reason:
"2023-08-15T23:11:29.954503+0000 mon.a (mon.0) 64 : cluster [WRN] Health check failed: Module 'devicehealth' has failed dependency: cannot import name 'MgrDBNotReady' (MGR_MODULE_DEPENDENCY)" in cluster log |
||||||||||||||
fail | 7368921 | 2023-08-15 16:59:18 | 2023-08-15 22:36:53 | 2023-08-15 23:12:13 | 0:35:20 | 0:22:50 | 0:12:30 | smithi | main | centos | 8.stream | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volume-client} | 2 | |
Failure Reason:
"2023-08-15T23:03:46.093738+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368922 | 2023-08-15 16:59:19 | 2023-08-15 22:37:18 | 2023-08-15 23:09:53 | 0:32:35 | 0:18:15 | 0:14:20 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} | 2 | |
Failure Reason:
"2023-08-15T22:58:54.329745+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368923 | 2023-08-15 16:59:20 | 2023-08-15 22:37:18 | 2023-08-15 22:45:58 | 0:08:40 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi154's OS to be rhel 8.4 but found centos 8 |
||||||||||||||
dead | 7368924 | 2023-08-15 16:59:21 | 2023-08-15 22:37:44 | 2023-08-15 22:39:39 | 0:01:55 | smithi | main | rhel | 8.4 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi099 |
||||||||||||||
fail | 7368925 | 2023-08-15 16:59:22 | 2023-08-15 22:37:44 | 2023-08-15 23:11:56 | 0:34:12 | 0:20:13 | 0:13:59 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} | 3 | |
Failure Reason:
"2023-08-15T23:01:12.486137+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368926 | 2023-08-15 16:59:22 | 2023-08-15 22:38:49 | 2023-08-15 23:16:57 | 0:38:08 | 0:22:49 | 0:15:19 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} | 2 | |
Failure Reason:
"2023-08-15T23:06:38.805711+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368927 | 2023-08-15 16:59:23 | 2023-08-15 22:39:59 | 2023-08-15 22:48:44 | 0:08:45 | smithi | main | centos | 8.stream | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} | 2 | |||
pass | 7368928 | 2023-08-15 16:59:24 | 2023-08-15 22:39:59 | 2023-08-15 23:27:51 | 0:47:52 | 0:34:47 | 0:13:05 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |
dead | 7368929 | 2023-08-15 16:59:25 | 2023-08-15 22:40:00 | 2023-08-15 22:47:56 | 0:07:56 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to reconnect to smithi132 |
||||||||||||||
fail | 7368930 | 2023-08-15 16:59:26 | 2023-08-15 22:40:05 | 2023-08-15 23:11:56 | 0:31:51 | 0:19:56 | 0:11:55 | smithi | main | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} | 2 | |
Failure Reason:
"2023-08-15T23:02:00.875362+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368931 | 2023-08-15 16:59:27 | 2023-08-15 22:40:15 | 2023-08-16 00:11:28 | 1:31:13 | 0:17:23 | 1:13:50 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} | 2 | |
Failure Reason:
"2023-08-16T00:02:18.408888+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368932 | 2023-08-15 16:59:28 | 2023-08-15 22:42:38 | 2023-08-16 04:00:37 | 5:17:59 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi086' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368933 | 2023-08-15 16:59:29 | 2023-08-15 22:42:38 | 2023-08-15 22:45:17 | 0:02:39 | smithi | main | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi103 |
||||||||||||||
dead | 7368934 | 2023-08-15 16:59:29 | 2023-08-15 22:43:04 | 2023-08-15 22:46:33 | 0:03:29 | smithi | main | centos | 8.stream | fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-octopus 1-upgrade}} | 1 | |||
Failure Reason:
Error reimaging machines: Expected smithi057's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368935 | 2023-08-15 16:59:30 | 2023-08-15 22:43:24 | 2023-08-15 22:46:28 | 0:03:04 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi008 |
||||||||||||||
fail | 7368936 | 2023-08-15 16:59:31 | 2023-08-15 22:44:41 | 2023-08-15 23:22:28 | 0:37:47 | 0:21:38 | 0:16:09 | smithi | main | rhel | 8.4 | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T23:13:46.906344+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368937 | 2023-08-15 16:59:32 | 2023-08-15 22:46:28 | 2023-08-15 23:20:39 | 0:34:11 | 0:19:08 | 0:15:03 | smithi | main | centos | 8.stream | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T23:11:21.995012+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368938 | 2023-08-15 16:59:33 | 2023-08-15 22:47:03 | 2023-08-16 04:04:49 | 5:17:46 | smithi | main | centos | 8.stream | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi143' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368939 | 2023-08-15 16:59:34 | 2023-08-15 22:47:19 | 2023-08-15 22:49:52 | 0:02:33 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi190 |
||||||||||||||
dead | 7368940 | 2023-08-15 16:59:35 | 2023-08-15 22:47:19 | 2023-08-16 00:04:42 | 1:17:23 | smithi | main | rhel | 8.4 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi154's OS to be rhel 8.4 but found centos 8 |
||||||||||||||
dead | 7368941 | 2023-08-15 16:59:36 | 2023-08-15 22:47:19 | 2023-08-15 22:50:32 | 0:03:13 | smithi | main | centos | 8.stream | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi175's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368942 | 2023-08-15 16:59:37 | 2023-08-15 22:47:20 | 2023-08-15 22:51:55 | 0:04:35 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} | 4 | |||
Failure Reason:
Error reimaging machines: Expected smithi031's OS to be ubuntu 20.04 but found rhel 8.4 |
||||||||||||||
dead | 7368943 | 2023-08-15 16:59:37 | 2023-08-15 22:48:10 | 2023-08-15 22:50:49 | 0:02:39 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi008's OS to be ubuntu 20.04 but found centos 8 |
||||||||||||||
dead | 7368944 | 2023-08-15 16:59:38 | 2023-08-15 22:48:11 | 2023-08-15 22:50:54 | 0:02:43 | smithi | main | centos | 8.stream | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi132's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368945 | 2023-08-15 16:59:39 | 2023-08-15 22:48:11 | 2023-08-15 22:51:55 | 0:03:44 | smithi | main | centos | 8.stream | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi150's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368946 | 2023-08-15 16:59:40 | 2023-08-15 22:48:11 | 2023-08-15 22:51:19 | 0:03:08 | smithi | main | centos | 8.stream | fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi057's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
fail | 7368947 | 2023-08-15 16:59:41 | 2023-08-15 22:48:12 | 2023-08-15 23:22:34 | 0:34:22 | 0:19:17 | 0:15:05 | smithi | main | rhel | 8.4 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} | 2 | |
Failure Reason:
"2023-08-15T23:12:14.054189+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368948 | 2023-08-15 16:59:42 | 2023-08-15 22:50:01 | 2023-08-15 22:52:56 | 0:02:55 | smithi | main | rhel | 8.4 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi100 |
||||||||||||||
dead | 7368949 | 2023-08-15 16:59:43 | 2023-08-15 22:50:11 | 2023-08-15 22:54:33 | 0:04:22 | smithi | main | centos | 8.stream | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi012's OS to be centos 8 but found centos 9 |
||||||||||||||
dead | 7368950 | 2023-08-15 16:59:44 | 2023-08-15 22:51:30 | 2023-08-15 23:02:47 | 0:11:17 | 0:03:22 | 0:07:55 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} | 2 | |
Failure Reason:
['/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."] |
||||||||||||||
dead | 7368951 | 2023-08-15 16:59:44 | 2023-08-15 22:52:05 | 2023-08-15 22:55:20 | 0:03:15 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi044's OS to be ubuntu 20.04 but found rhel 8.4 |
||||||||||||||
fail | 7368952 | 2023-08-15 16:59:45 | 2023-08-15 22:52:06 | 2023-08-15 23:25:15 | 0:33:09 | 0:21:22 | 0:11:47 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} | 2 | |
Failure Reason:
"2023-08-15T23:16:35.649327+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
dead | 7368953 | 2023-08-15 16:59:46 | 2023-08-15 22:52:35 | 2023-08-15 22:55:59 | 0:03:24 | smithi | main | ubuntu | 20.04 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi161 |
||||||||||||||
dead | 7368954 | 2023-08-15 16:59:47 | 2023-08-15 22:52:56 | 2023-08-16 04:12:12 | 5:19:16 | smithi | main | ubuntu | 18.04 | fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi114' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368955 | 2023-08-15 16:59:48 | 2023-08-15 22:53:06 | 2023-08-16 04:11:16 | 5:18:10 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi070' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368956 | 2023-08-15 16:59:49 | 2023-08-15 22:53:41 | 2023-08-16 00:04:46 | 1:11:05 | smithi | main | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}} | 3 | |||
Failure Reason:
Error reimaging machines: Expected smithi100's OS to be ubuntu 20.04 but found centos 8 |
||||||||||||||
dead | 7368957 | 2023-08-15 16:59:49 | 2023-08-15 22:54:08 | 2023-08-15 22:54:37 | 0:00:29 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} | 2 | |||
Failure Reason:
Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/205/task |
||||||||||||||
dead | 7368958 | 2023-08-15 16:59:50 | 2023-08-15 22:54:18 | 2023-08-15 22:57:20 | 0:03:02 | smithi | main | centos | 8.stream | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi157's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368959 | 2023-08-15 16:59:51 | 2023-08-15 22:54:18 | 2023-08-15 22:57:19 | 0:03:01 | smithi | main | ubuntu | 20.04 | fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi148's OS to be ubuntu 20.04 but found rhel 8.4 |
||||||||||||||
dead | 7368960 | 2023-08-15 16:59:52 | 2023-08-15 22:54:19 | 2023-08-15 22:56:56 | 0:02:37 | smithi | main | centos | 8.stream | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} | 2 | |||
Failure Reason:
Error reimaging machines: Expected smithi057's OS to be centos 8 but found ubuntu 20.04 |
||||||||||||||
dead | 7368961 | 2023-08-15 16:59:53 | 2023-08-15 22:54:19 | 2023-08-15 22:58:12 | 0:03:53 | smithi | main | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi100 |
||||||||||||||
dead | 7368962 | 2023-08-15 16:59:54 | 2023-08-15 22:55:20 | 2023-08-15 22:58:12 | 0:02:52 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} | 2 | |||
Failure Reason:
Error reimaging machines: Failed to power on smithi154 |
||||||||||||||
dead | 7368963 | 2023-08-15 16:59:55 | 2023-08-15 22:55:26 | 2023-08-16 04:13:57 | 5:18:31 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |||
Failure Reason:
Error reimaging machines: 'wait for sentinel on smithi044' reached maximum tries (35) after waiting for 1800 seconds |
||||||||||||||
dead | 7368964 | 2023-08-15 16:59:56 | 2023-08-15 22:56:26 | 2023-08-15 23:08:38 | 0:12:12 | 0:04:13 | 0:07:59 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} | 2 | |
Failure Reason:
['/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."] |
||||||||||||||
fail | 7368965 | 2023-08-15 16:59:56 | 2023-08-15 22:56:55 | 2023-08-15 23:34:07 | 0:37:12 | 0:23:30 | 0:13:42 | smithi | main | centos | 8.stream | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} | 2 | |
Failure Reason:
"2023-08-15T23:24:04.445499+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368966 | 2023-08-15 16:59:57 | 2023-08-15 22:57:36 | 2023-08-15 23:32:02 | 0:34:26 | 0:22:26 | 0:12:00 | smithi | main | centos | 8.stream | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} | 2 | |
Failure Reason:
"2023-08-15T23:23:04.493982+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368967 | 2023-08-15 16:59:58 | 2023-08-15 22:57:41 | 2023-08-15 23:38:44 | 0:41:03 | 0:24:31 | 0:16:32 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}} | 3 | |
Failure Reason:
"2023-08-15T23:29:29.661138+0000 mgr.z (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368968 | 2023-08-15 16:59:59 | 2023-08-15 22:58:16 | 2023-08-15 23:31:48 | 0:33:32 | 0:19:11 | 0:14:21 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} | 2 | |
Failure Reason:
"2023-08-15T23:22:53.374583+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368969 | 2023-08-15 17:00:00 | 2023-08-15 22:58:33 | 2023-08-15 23:33:54 | 0:35:21 | 0:21:04 | 0:14:17 | smithi | main | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} | 2 | |
Failure Reason:
"2023-08-15T23:23:13.569398+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368970 | 2023-08-15 17:00:01 | 2023-08-15 22:58:33 | 2023-08-15 23:35:35 | 0:37:02 | 0:20:35 | 0:16:27 | smithi | main | ubuntu | 20.04 | fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} | 2 | |
Failure Reason:
"2023-08-15T23:24:58.795762+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368971 | 2023-08-15 17:00:02 | 2023-08-15 22:58:33 | 2023-08-15 23:36:38 | 0:38:05 | 0:19:30 | 0:18:35 | smithi | main | ubuntu | 20.04 | fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} | 5 | |
Failure Reason:
"2023-08-15T23:26:48.633546+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368972 | 2023-08-15 17:00:02 | 2023-08-15 22:59:38 | 2023-08-15 23:39:24 | 0:39:46 | 0:22:41 | 0:17:05 | smithi | main | centos | 8.stream | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} | 2 | |
Failure Reason:
"2023-08-15T23:29:37.788873+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368973 | 2023-08-15 17:00:03 | 2023-08-15 22:59:44 | 2023-08-15 23:39:05 | 0:39:21 | 0:25:45 | 0:13:36 | smithi | main | centos | 8.stream | fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 | |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
fail | 7368974 | 2023-08-15 17:00:04 | 2023-08-15 23:00:20 | 2023-08-15 23:35:15 | 0:34:55 | 0:20:58 | 0:13:57 | smithi | main | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 | |
Failure Reason:
"2023-08-15T23:27:09.477099+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368975 | 2023-08-15 17:00:05 | 2023-08-15 23:00:20 | 2023-08-15 23:35:59 | 0:35:39 | 0:20:56 | 0:14:43 | smithi | main | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} | 2 | |
Failure Reason:
"2023-08-15T23:27:31.162187+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368976 | 2023-08-15 17:00:06 | 2023-08-15 23:00:20 | 2023-08-15 23:36:27 | 0:36:07 | 0:20:44 | 0:15:23 | smithi | main | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} | 3 | |
Failure Reason:
"2023-08-15T23:26:36.781784+0000 mgr.z (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368977 | 2023-08-15 17:00:07 | 2023-08-15 23:00:21 | 2023-08-15 23:32:18 | 0:31:57 | 0:18:00 | 0:13:57 | smithi | main | ubuntu | 20.04 | fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T23:23:08.244257+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368978 | 2023-08-15 17:00:08 | 2023-08-15 23:02:34 | 2023-08-15 23:38:33 | 0:35:59 | 0:22:42 | 0:13:17 | smithi | main | centos | 8.stream | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} | 2 | |
Failure Reason:
"2023-08-15T23:29:53.627196+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368979 | 2023-08-15 17:00:09 | 2023-08-15 23:03:04 | 2023-08-15 23:37:40 | 0:34:36 | 0:17:58 | 0:16:38 | smithi | main | ubuntu | 20.04 | fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} | 2 | |
Failure Reason:
"2023-08-15T23:26:43.986942+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368980 | 2023-08-15 17:00:10 | 2023-08-15 23:04:14 | 2023-08-15 23:41:49 | 0:37:35 | 0:23:28 | 0:14:07 | smithi | main | centos | 8.stream | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} | 2 | |
Failure Reason:
"2023-08-15T23:32:45.494503+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368981 | 2023-08-15 17:00:11 | 2023-08-15 23:05:07 | 2023-08-15 23:35:50 | 0:30:43 | 0:18:52 | 0:11:51 | smithi | main | rhel | 8.4 | fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} | 2 | |
Failure Reason:
"2023-08-15T23:25:35.275743+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368982 | 2023-08-15 17:00:11 | 2023-08-15 23:05:07 | 2023-08-15 23:41:49 | 0:36:42 | 0:23:40 | 0:13:02 | smithi | main | centos | 8.stream | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} | 2 | |
Failure Reason:
"2023-08-15T23:32:16.279157+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368983 | 2023-08-15 17:00:12 | 2023-08-15 23:05:28 | 2023-08-15 23:38:17 | 0:32:49 | 0:20:12 | 0:12:37 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} | 2 | |
Failure Reason:
"2023-08-15T23:29:09.561737+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
pass | 7368984 | 2023-08-15 17:00:13 | 2023-08-15 23:07:34 | 2023-08-15 23:50:43 | 0:43:09 | 0:31:20 | 0:11:49 | smithi | main | centos | 8.stream | fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 | |
fail | 7368985 | 2023-08-15 17:00:14 | 2023-08-15 23:07:44 | 2023-08-15 23:56:19 | 0:48:35 | 0:35:08 | 0:13:27 | smithi | main | centos | 8.stream | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} | 2 | |
Failure Reason:
"2023-08-15T23:42:45.105396+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368986 | 2023-08-15 17:00:15 | 2023-08-15 23:08:08 | 2023-08-15 23:42:16 | 0:34:08 | 0:19:31 | 0:14:37 | smithi | main | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} | 2 | |
Failure Reason:
"2023-08-15T23:32:28.483086+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |
||||||||||||||
fail | 7368987 | 2023-08-15 17:00:16 | 2023-08-15 23:10:15 | 2023-08-15 23:44:03 | 0:33:48 | 0:19:37 | 0:14:11 | smithi | main | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} | 2 | |
Failure Reason:
"2023-08-15T23:34:26.058067+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: devicehealth" in cluster log |