Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7135970 2023-01-24 17:10:56 2023-01-24 23:03:57 2023-01-25 00:14:48 1:10:51 1:00:57 0:09:54 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-24T23:38:59.225086+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135971 2023-01-24 17:10:57 2023-01-24 23:03:58 2023-01-24 23:40:55 0:36:57 0:27:35 0:09:22 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-24T23:22:45.621021+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135972 2023-01-24 17:10:58 2023-01-24 23:05:48 2023-01-25 02:51:43 3:45:55 3:36:24 0:09:31 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi156 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7135973 2023-01-24 17:10:59 2023-01-24 23:06:19 2023-01-25 00:20:12 1:13:53 1:03:36 0:10:17 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/qemu_on_immutable_object_cache_and_thrash} 2
Failure Reason:

"2023-01-24T23:25:32.679201+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135974 2023-01-24 17:11:00 2023-01-24 23:07:09 2023-01-25 00:43:48 1:36:39 1:28:57 0:07:42 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-24T23:25:20.559755+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135975 2023-01-24 17:11:01 2023-01-24 23:08:50 2023-01-25 01:27:02 2:18:12 2:05:27 0:12:45 smithi main centos 8.stream rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-24T23:37:33.208307+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135976 2023-01-24 17:11:02 2023-01-24 23:12:00 2023-01-24 23:35:07 0:23:07 0:16:29 0:06:38 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
Failure Reason:

"2023-01-24T23:28:22.719851+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135977 2023-01-24 17:11:03 2023-01-24 23:12:11 2023-01-25 01:14:55 2:02:44 1:55:16 0:07:28 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-24T23:30:25.148114+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135978 2023-01-24 17:11:05 2023-01-24 23:13:51 2023-01-24 23:44:48 0:30:57 0:21:52 0:09:05 smithi main centos 8.stream rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-24T23:39:13.687716+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135979 2023-01-24 17:11:06 2023-01-24 23:13:51 2023-01-24 23:47:05 0:33:14 0:22:47 0:10:27 smithi main centos 8.stream rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_journaling} 3
Failure Reason:

"2023-01-24T23:32:45.747498+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135980 2023-01-24 17:11:07 2023-01-24 23:14:22 2023-01-24 23:37:09 0:22:47 0:14:41 0:08:06 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} 2
Failure Reason:

"2023-01-24T23:32:34.937995+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135981 2023-01-24 17:11:08 2023-01-24 23:14:22 2023-01-25 01:32:55 2:18:33 2:11:10 0:07:23 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-24T23:32:34.446282+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135982 2023-01-24 17:11:09 2023-01-24 23:15:23 2023-01-25 00:45:34 1:30:11 1:19:17 0:10:54 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-24T23:36:07.981620+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135983 2023-01-24 17:11:10 2023-01-24 23:15:53 2023-01-24 23:49:39 0:33:46 0:22:53 0:10:53 smithi main centos 8.stream rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-24T23:42:01.687370+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135984 2023-01-24 17:11:11 2023-01-24 23:16:33 2023-01-24 23:59:03 0:42:30 0:34:37 0:07:53 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-24T23:51:03.948366+0000 mon.a (mon.0) 360 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135985 2023-01-24 17:11:12 2023-01-24 23:16:34 2023-01-25 03:01:06 3:44:32 3:37:48 0:06:44 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi072 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

pass 7135986 2023-01-24 17:11:13 2023-01-24 23:17:24 2023-01-24 23:45:03 0:27:39 0:17:14 0:10:25 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7135987 2023-01-24 17:11:14 2023-01-24 23:17:44 2023-01-24 23:46:28 0:28:44 0:17:59 0:10:45 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} 2
Failure Reason:

"2023-01-24T23:38:23.481449+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135988 2023-01-24 17:11:15 2023-01-24 23:18:25 2023-01-24 23:50:54 0:32:29 0:25:46 0:06:43 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-24T23:40:26.067610+0000 mon.a (mon.0) 143 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135989 2023-01-24 17:11:16 2023-01-24 23:18:25 2023-01-25 00:52:37 1:34:12 1:25:42 0:08:30 smithi main rhel 8.4 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-24T23:36:30.645396+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135990 2023-01-24 17:11:17 2023-01-24 23:19:15 2023-01-25 00:33:12 1:13:57 1:06:21 0:07:36 smithi main rhel 8.4 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-24T23:37:06.245875+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135991 2023-01-24 17:11:18 2023-01-24 23:20:36 2023-01-25 00:37:58 1:17:22 1:11:36 0:05:46 smithi main rhel 8.4 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-24T23:38:12.535988+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135992 2023-01-24 17:11:19 2023-01-24 23:21:06 2023-01-25 01:02:11 1:41:05 1:32:38 0:08:27 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-24T23:39:53.097047+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135993 2023-01-24 17:11:20 2023-01-24 23:23:17 2023-01-24 23:54:58 0:31:41 0:24:34 0:07:07 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} 2
Failure Reason:

"2023-01-24T23:40:35.979756+0000 mgr.y (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135994 2023-01-24 17:11:21 2023-01-24 23:24:07 2023-01-25 01:08:49 1:44:42 1:33:25 0:11:17 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-24T23:45:13.911819+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7135995 2023-01-24 17:11:23 2023-01-24 23:24:18 2023-01-24 23:48:43 0:24:25 0:14:09 0:10:16 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} 3
pass 7135996 2023-01-24 17:11:24 2023-01-24 23:27:08 2023-01-24 23:46:30 0:19:22 0:11:54 0:07:28 smithi main rhel 8.4 rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} 1
fail 7135997 2023-01-24 17:11:25 2023-01-24 23:27:09 2023-01-25 00:10:09 0:43:00 0:33:35 0:09:25 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} 1
Failure Reason:

"2023-01-25T00:01:57.810049+0000 mon.a (mon.0) 427 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7135998 2023-01-24 17:11:26 2023-01-24 23:27:09 2023-01-25 00:05:15 0:38:06 0:27:28 0:10:38 smithi main centos 8.stream rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/c_api_tests} 3
Failure Reason:

"2023-01-24T23:47:09.332618+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7135999 2023-01-24 17:11:27 2023-01-24 23:28:09 2023-01-25 00:00:59 0:32:50 0:26:55 0:05:55 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-24T23:50:30.385509+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136000 2023-01-24 17:11:28 2023-01-24 23:28:10 2023-01-25 00:12:45 0:44:35 0:34:13 0:10:22 smithi main rhel 8.4 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-24T23:48:40.872668+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136001 2023-01-24 17:11:29 2023-01-24 23:31:30 2023-01-25 01:28:27 1:56:57 1:46:55 0:10:02 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-24T23:52:28.354311+0000 mgr.x (mgr.4122) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136002 2023-01-24 17:11:30 2023-01-24 23:34:01 2023-01-25 01:14:19 1:40:18 1:32:35 0:07:43 smithi main rhel 8.4 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-24T23:52:02.735657+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136003 2023-01-24 17:11:31 2023-01-24 23:35:11 2023-01-25 00:10:09 0:34:58 0:26:11 0:08:47 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-24T23:59:16.327872+0000 mon.a (mon.0) 337 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136004 2023-01-24 17:11:32 2023-01-24 23:37:12 2023-01-25 00:20:09 0:42:57 0:28:29 0:14:28 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-24T23:59:36.728251+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136005 2023-01-24 17:11:33 2023-01-24 23:41:03 2023-01-25 00:09:08 0:28:05 0:20:28 0:07:37 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
Failure Reason:

"2023-01-25T00:04:34.894579+0000 mon.a (mon.0) 962 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136006 2023-01-24 17:11:34 2023-01-24 23:42:03 2023-01-25 00:38:11 0:56:08 0:46:17 0:09:51 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-25T00:01:05.972772+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136007 2023-01-24 17:11:35 2023-01-24 23:45:04 2023-01-25 00:22:16 0:37:12 0:25:41 0:11:31 smithi main centos 8.stream rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 4
Failure Reason:

"2023-01-25T00:06:34.835682+0000 mgr.z (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136008 2023-01-24 17:11:37 2023-01-24 23:46:34 2023-01-25 00:29:29 0:42:55 0:33:04 0:09:51 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} 1
Failure Reason:

"2023-01-25T00:21:23.239777+0000 mon.a (mon.0) 473 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136009 2023-01-24 17:11:38 2023-01-24 23:46:35 2023-01-25 00:11:58 0:25:23 0:15:46 0:09:37 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} 2
Failure Reason:

"2023-01-25T00:05:26.212231+0000 mgr.x (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136010 2023-01-24 17:11:39 2023-01-24 23:47:15 2023-01-25 00:26:15 0:39:00 0:27:45 0:11:15 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} 3
Failure Reason:

"2023-01-25T00:08:02.875737+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136011 2023-01-24 17:11:40 2023-01-24 23:48:45 2023-01-25 00:14:01 0:25:16 0:16:45 0:08:31 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} 3
Failure Reason:

"2023-01-25T00:07:51.620127+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136012 2023-01-24 17:11:41 2023-01-24 23:50:56 2023-01-25 03:20:55 3:29:59 3:17:49 0:12:10 smithi main rhel 8.4 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-25T00:12:24.256959+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136013 2023-01-24 17:11:42 2023-01-24 23:55:37 2023-01-25 01:36:08 1:40:31 1:26:26 0:14:05 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-25T00:19:57.082196+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136014 2023-01-24 17:11:43 2023-01-25 00:01:08 2023-01-25 01:28:23 1:27:15 1:17:14 0:10:01 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-25T00:21:52.892867+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136015 2023-01-24 17:11:44 2023-01-25 00:05:19 2023-01-25 00:25:57 0:20:38 0:12:34 0:08:04 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} 2
Failure Reason:

"2023-01-25T00:23:20.335493+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136016 2023-01-24 17:11:45 2023-01-25 00:05:19 2023-01-25 00:38:11 0:32:52 0:22:46 0:10:06 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-25T00:31:22.204522+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136017 2023-01-24 17:11:46 2023-01-25 00:09:10 2023-01-25 01:13:55 1:04:45 0:56:21 0:08:24 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

"2023-01-25T00:43:58.230031+0000 mon.a (mon.0) 672 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136018 2023-01-24 17:11:47 2023-01-25 00:09:10 2023-01-25 01:19:10 1:10:00 1:00:22 0:09:38 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-25T00:27:46.195854+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136019 2023-01-24 17:11:48 2023-01-25 00:10:11 2023-01-25 02:08:59 1:58:48 1:50:48 0:08:00 smithi main rhel 8.4 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-25T00:28:43.602388+0000 mgr.x (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136020 2023-01-24 17:11:49 2023-01-25 00:12:01 2023-01-25 00:47:49 0:35:48 0:25:31 0:10:17 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-25T00:38:01.388101+0000 mon.a (mon.0) 337 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136021 2023-01-24 17:11:50 2023-01-25 00:12:52 2023-01-25 02:57:09 2:44:17 2:33:58 0:10:19 smithi main centos 8.stream rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-25T00:32:56.623930+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136022 2023-01-24 17:11:51 2023-01-25 00:13:42 2023-01-25 00:53:09 0:39:27 0:32:18 0:07:09 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} 2
Failure Reason:

"2023-01-25T00:30:45.732965+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136023 2023-01-24 17:11:52 2023-01-25 00:14:02 2023-01-25 02:35:57 2:21:55 2:13:38 0:08:17 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-25T00:31:58.665341+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136024 2023-01-24 17:11:53 2023-01-25 00:14:53 2023-01-25 00:46:48 0:31:55 0:23:54 0:08:01 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-25T00:37:59.533620+0000 mon.a (mon.0) 392 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136025 2023-01-24 17:11:55 2023-01-25 00:15:53 2023-01-25 01:13:50 0:57:57 0:46:17 0:11:40 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests} 1
Failure Reason:

"2023-01-25T00:53:40.311824+0000 mon.a (mon.0) 402 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136026 2023-01-24 17:11:56 2023-01-25 00:16:44 2023-01-25 00:59:12 0:42:28 0:32:46 0:09:42 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} 2
Failure Reason:

"2023-01-25T00:36:45.719994+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136027 2023-01-24 17:11:57 2023-01-25 00:20:14 2023-01-25 03:09:31 2:49:17 2:43:41 0:05:36 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/fio} 2
Failure Reason:

"2023-01-25T00:36:49.182972+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136028 2023-01-24 17:11:58 2023-01-25 00:20:15 2023-01-25 00:55:33 0:35:18 0:23:40 0:11:38 smithi main centos 8.stream rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{centos_8} workloads/fsx} 3
Failure Reason:

"2023-01-25T00:41:06.343078+0000 mgr.y (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136029 2023-01-24 17:11:59 2023-01-25 00:22:25 2023-01-25 02:06:02 1:43:37 1:29:06 0:14:31 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-25T00:45:38.945541+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136030 2023-01-24 17:12:00 2023-01-25 00:26:06 2023-01-25 00:57:46 0:31:40 0:24:51 0:06:49 smithi main rhel 8.4 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-25T00:43:22.695099+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136031 2023-01-24 17:12:01 2023-01-25 00:26:16 2023-01-25 01:21:52 0:55:36 0:46:31 0:09:05 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests_with_defaults} 1
Failure Reason:

"2023-01-25T01:01:59.556179+0000 mon.a (mon.0) 429 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136032 2023-01-24 17:12:02 2023-01-25 00:26:17 2023-01-25 01:02:30 0:36:13 0:26:18 0:09:55 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-25T00:51:35.327937+0000 mon.a (mon.0) 331 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136033 2023-01-24 17:12:03 2023-01-25 00:29:37 2023-01-25 01:07:51 0:38:14 0:25:58 0:12:16 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/fio_on_immutable_object_cache} 2
Failure Reason:

"2023-01-25T00:50:51.930661+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136034 2023-01-24 17:12:04 2023-01-25 00:33:18 2023-01-25 01:17:02 0:43:44 0:33:28 0:10:16 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-25T01:00:02.418836+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136035 2023-01-24 17:12:05 2023-01-25 00:38:09 2023-01-25 02:09:43 1:31:34 1:21:23 0:10:11 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

Command failed on smithi050 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

fail 7136036 2023-01-24 17:12:06 2023-01-25 00:38:09 2023-01-25 02:07:19 1:29:10 1:18:01 0:11:09 smithi main centos 8.stream rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-25T00:58:34.050352+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136037 2023-01-24 17:12:07 2023-01-25 00:38:20 2023-01-25 01:20:42 0:42:22 0:30:20 0:12:02 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} 2
Failure Reason:

"2023-01-25T01:00:06.074775+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136038 2023-01-24 17:12:08 2023-01-25 00:43:51 2023-01-25 02:21:22 1:37:31 1:29:01 0:08:30 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-25T01:02:55.141028+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136039 2023-01-24 17:12:09 2023-01-25 00:45:41 2023-01-25 01:56:37 1:10:56 1:01:41 0:09:15 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-25T01:20:20.780346+0000 mon.a (mon.0) 399 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136040 2023-01-24 17:12:10 2023-01-25 00:45:41 2023-01-25 01:18:49 0:33:08 0:22:30 0:10:38 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} 3
Failure Reason:

"2023-01-25T01:06:23.709251+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136041 2023-01-24 17:12:11 2023-01-25 00:47:52 2023-01-25 01:14:03 0:26:11 0:14:53 0:11:18 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} 2
Failure Reason:

"2023-01-25T01:09:25.220689+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136042 2023-01-24 17:12:13 2023-01-25 00:52:43 2023-01-25 04:35:15 3:42:32 3:33:51 0:08:41 smithi main centos 8.stream rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi006 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7136043 2023-01-24 17:12:14 2023-01-25 00:52:43 2023-01-25 02:24:54 1:32:11 1:23:35 0:08:36 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-25T01:11:58.949265+0000 mgr.y (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136044 2023-01-24 17:12:15 2023-01-25 00:55:34 2023-01-25 02:49:20 1:53:46 1:41:15 0:12:31 smithi main centos 8.stream rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-25T01:24:21.719599+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136045 2023-01-24 17:12:16 2023-01-25 00:57:54 2023-01-25 02:40:22 1:42:28 1:34:47 0:07:41 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-25T01:15:50.338364+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136046 2023-01-24 17:12:17 2023-01-25 00:59:15 2023-01-25 01:33:58 0:34:43 0:25:25 0:09:18 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-25T01:23:44.226513+0000 mon.a (mon.0) 338 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136047 2023-01-24 17:12:18 2023-01-25 00:59:15 2023-01-25 01:49:01 0:49:46 0:38:12 0:11:34 smithi main centos 8.stream rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/recovery} 2
Failure Reason:

"2023-01-25T01:19:35.740978+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136048 2023-01-24 17:12:19 2023-01-25 01:02:16 2023-01-25 01:36:59 0:34:43 0:24:31 0:10:12 smithi main centos 8.stream rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} 4
Failure Reason:

"2023-01-25T01:23:01.432653+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136049 2023-01-24 17:12:20 2023-01-25 01:04:06 2023-01-25 02:47:07 1:43:01 1:27:20 0:15:41 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-25T01:29:39.442015+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136050 2023-01-24 17:12:21 2023-01-25 01:08:57 2023-01-25 01:37:14 0:28:17 0:23:06 0:05:11 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-25T01:30:37.192421+0000 mon.a (mon.0) 409 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136051 2023-01-24 17:12:22 2023-01-25 01:08:58 2023-01-25 01:44:56 0:35:58 0:21:13 0:14:45 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} 2
Failure Reason:

"2023-01-25T01:32:46.907764+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136052 2023-01-24 17:12:23 2023-01-25 01:13:59 2023-01-25 01:45:30 0:31:31 0:24:57 0:06:34 smithi main rhel 8.4 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} 3
Failure Reason:

"2023-01-25T01:31:29.110714+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136053 2023-01-24 17:12:24 2023-01-25 01:14:09 2023-01-25 03:53:45 2:39:36 2:33:22 0:06:14 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-25T01:31:19.581393+0000 mgr.x (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136054 2023-01-24 17:12:25 2023-01-25 01:14:29 2023-01-25 01:58:03 0:43:34 0:32:46 0:10:48 smithi main centos 8.stream rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-25T01:33:53.568206+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136055 2023-01-24 17:12:26 2023-01-25 01:15:00 2023-01-25 05:00:07 3:45:07 3:30:50 0:14:17 smithi main centos 8.stream rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-25T01:37:35.787978+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136056 2023-01-24 17:12:27 2023-01-25 01:18:50 2023-01-25 01:42:10 0:23:20 0:16:04 0:07:16 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
Failure Reason:

"2023-01-25T01:36:06.896527+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136057 2023-01-24 17:12:29 2023-01-25 03:15:50 6467 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-25T01:37:33.880068+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136058 2023-01-24 17:12:30 2023-01-25 01:51:44 1415 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-25T01:44:54.224680+0000 mon.a (mon.0) 389 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136059 2023-01-24 17:12:31 2023-01-25 01:22:02 2023-01-25 02:07:55 0:45:53 0:32:36 0:13:17 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-25T02:01:46.791866+0000 mon.a (mon.0) 464 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7136060 2023-01-24 17:12:32 2023-01-25 01:27:13 2023-01-25 02:36:12 1:08:59 0:59:41 0:09:18 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-25T01:45:29.467276+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7136061 2023-01-24 17:12:33 2023-01-25 01:27:13 2023-01-25 02:21:38 0:54:25 0:45:48 0:08:37 smithi main rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2023-01-25T01:50:53.411793+0000 mon.a (mon.0) 589 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log