Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7134116 2023-01-23 20:59:56 2023-01-23 21:08:25 2023-01-23 22:19:26 1:11:01 1:01:12 0:09:49 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-23T21:43:23.154917+0000 mon.a (mon.0) 339 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7134117 2023-01-23 20:59:57 2023-01-23 21:08:26 2023-01-23 22:19:07 1:10:41 1:03:37 0:07:04 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
fail 7134118 2023-01-23 20:59:58 2023-01-23 21:09:56 2023-01-23 21:46:03 0:36:07 0:27:45 0:08:22 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-23T21:27:41.714399+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134119 2023-01-23 21:00:00 2023-01-23 21:11:07 2023-01-24 00:42:40 3:31:33 3:22:18 0:09:15 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi203 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7134120 2023-01-23 21:00:01 2023-01-23 21:11:17 2023-01-23 22:24:09 1:12:52 1:01:22 0:11:30 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/qemu_on_immutable_object_cache_and_thrash} 2
Failure Reason:

"2023-01-23T21:30:50.163834+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134121 2023-01-23 21:00:02 2023-01-23 21:12:58 2023-01-23 22:46:35 1:33:37 1:27:12 0:06:25 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-23T21:30:30.740129+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134122 2023-01-23 21:00:03 2023-01-23 21:12:58 2023-01-23 21:47:30 0:34:32 0:24:17 0:10:15 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
fail 7134123 2023-01-23 21:00:04 2023-01-23 21:14:18 2023-01-23 23:25:56 2:11:38 2:00:24 0:11:14 smithi main centos 8.stream rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-23T21:36:04.060570+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134124 2023-01-23 21:00:05 2023-01-23 21:16:49 2023-01-23 21:36:38 0:19:49 0:12:33 0:07:16 smithi main rhel 8.4 rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} 1
fail 7134125 2023-01-23 21:00:07 2023-01-23 21:16:49 2023-01-23 21:42:06 0:25:17 0:16:05 0:09:12 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
Failure Reason:

"2023-01-23T21:35:33.418446+0000 mgr.y (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134126 2023-01-23 21:00:08 2023-01-23 21:19:10 2023-01-23 23:19:37 2:00:27 1:47:01 0:13:26 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-23T21:43:13.360583+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134127 2023-01-23 21:00:09 2023-01-23 21:26:31 2023-01-23 21:58:05 0:31:34 0:22:14 0:09:20 smithi main centos 8.stream rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-23T21:52:32.505797+0000 mon.a (mon.0) 477 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134128 2023-01-23 21:00:10 2023-01-23 21:26:31 2023-01-23 21:58:31 0:32:00 0:22:39 0:09:21 smithi main centos 8.stream rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_journaling} 3
Failure Reason:

"2023-01-23T21:45:46.703071+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134129 2023-01-23 21:00:11 2023-01-23 21:27:32 2023-01-23 21:52:36 0:25:04 0:15:11 0:09:53 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} 2
Failure Reason:

"2023-01-23T21:46:27.243169+0000 mgr.y (mgr.4098) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134130 2023-01-23 21:00:12 2023-01-23 21:27:32 2023-01-23 21:50:07 0:22:35 0:12:51 0:09:44 smithi main rhel 8.4 rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} 1
fail 7134131 2023-01-23 21:00:13 2023-01-23 21:31:03 2023-01-23 23:44:27 2:13:24 2:06:39 0:06:45 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-23T21:47:57.936494+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134132 2023-01-23 21:00:15 2023-01-23 21:31:23 2023-01-23 23:01:43 1:30:20 1:19:04 0:11:16 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-23T21:51:27.634894+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134133 2023-01-23 21:00:16 2023-01-23 21:32:24 2023-01-23 22:06:18 0:33:54 0:26:01 0:07:53 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-config-key} 2
fail 7134134 2023-01-23 21:00:17 2023-01-23 21:32:24 2023-01-23 22:05:38 0:33:14 0:22:01 0:11:13 smithi main centos 8.stream rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-23T21:59:30.595554+0000 mon.a (mon.0) 505 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134135 2023-01-23 21:00:18 2023-01-23 21:34:54 2023-01-23 22:18:47 0:43:53 0:34:20 0:09:33 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-23T22:10:44.715999+0000 mon.a (mon.0) 386 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134136 2023-01-23 21:00:19 2023-01-23 21:35:55 2023-01-24 01:18:37 3:42:42 3:37:43 0:04:59 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi037 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

pass 7134137 2023-01-23 21:00:20 2023-01-23 21:35:55 2023-01-23 22:36:32 1:00:37 0:53:03 0:07:34 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 7134138 2023-01-23 21:00:22 2023-01-23 21:36:45 2023-01-23 22:05:30 0:28:45 0:17:55 0:10:50 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
Failure Reason:

"2023-01-23T22:04:15.442281+0000 mon.a (mon.0) 873 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134139 2023-01-23 21:00:23 2023-01-23 21:38:16 2023-01-23 22:09:11 0:30:55 0:16:46 0:14:09 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} 2
Failure Reason:

"2023-01-23T22:01:08.197345+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134140 2023-01-23 21:00:24 2023-01-23 21:42:07 2023-01-23 22:19:47 0:37:40 0:31:23 0:06:17 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-23T22:05:02.216291+0000 mon.a (mon.0) 143 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134141 2023-01-23 21:00:25 2023-01-23 21:42:57 2023-01-23 23:15:52 1:32:55 1:24:48 0:08:07 smithi main rhel 8.4 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-23T22:02:32.919213+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134142 2023-01-23 21:00:26 2023-01-23 21:43:48 2023-01-23 22:52:52 1:09:04 1:01:44 0:07:20 smithi main rhel 8.4 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

Command failed on smithi139 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 7134143 2023-01-23 21:00:27 2023-01-23 21:43:58 2023-01-23 22:02:50 0:18:52 0:12:38 0:06:14 smithi main rhel 8.4 rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-zlib openstack supported-random-distro$/{rhel_8}} 1
fail 7134144 2023-01-23 21:00:29 2023-01-23 21:43:58 2023-01-23 23:00:27 1:16:29 1:09:08 0:07:21 smithi main rhel 8.4 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-23T22:02:46.312723+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134145 2023-01-23 21:00:30 2023-01-23 21:45:09 2023-01-23 23:27:07 1:41:58 1:33:48 0:08:10 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-23T22:03:04.383244+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134146 2023-01-23 21:00:31 2023-01-23 21:46:09 2023-01-23 22:11:09 0:25:00 0:19:30 0:05:30 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} 2
Failure Reason:

"2023-01-23T22:02:54.300539+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134147 2023-01-23 21:00:32 2023-01-23 21:46:19 2023-01-23 22:06:54 0:20:35 0:09:43 0:10:52 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=66470d7ff315c7c2887bdf61d1964432eb93c3e7

fail 7134148 2023-01-23 21:00:33 2023-01-23 21:47:40 2023-01-23 22:05:13 0:17:33 0:10:56 0:06:37 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=66470d7ff315c7c2887bdf61d1964432eb93c3e7

fail 7134149 2023-01-23 21:00:34 2023-01-23 21:47:50 2023-01-23 22:07:12 0:19:22 0:10:30 0:08:52 smithi main rhel 8.4 rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-zstd openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=66470d7ff315c7c2887bdf61d1964432eb93c3e7

fail 7134150 2023-01-23 21:00:36 2023-01-23 21:50:11 2023-01-23 22:35:39 0:45:28 0:33:53 0:11:35 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} 1
Failure Reason:

"2023-01-23T22:27:56.015767+0000 mon.a (mon.0) 427 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134151 2023-01-23 21:00:37 2023-01-23 21:52:41 2023-01-23 22:30:08 0:37:27 0:27:26 0:10:01 smithi main centos 8.stream rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/c_api_tests} 3
Failure Reason:

"2023-01-23T22:11:19.380227+0000 mgr.x (mgr.4122) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134152 2023-01-23 21:00:38 2023-01-23 21:53:12 2023-01-23 22:05:43 0:12:31 0:06:36 0:05:55 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=66470d7ff315c7c2887bdf61d1964432eb93c3e7

fail 7134153 2023-01-23 21:00:39 2023-01-23 21:53:12 2023-01-23 22:07:26 0:14:14 0:06:30 0:07:44 smithi main rhel 8.4 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=66470d7ff315c7c2887bdf61d1964432eb93c3e7

fail 7134154 2023-01-23 21:00:40 2023-01-23 21:54:12 2023-01-23 23:39:36 1:45:24 1:35:23 0:10:01 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-23T22:15:00.657283+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134155 2023-01-23 21:00:41 2023-01-23 21:58:33 2023-01-23 22:19:35 0:21:02 0:11:07 0:09:55 smithi main centos 8.stream rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-hybrid openstack supported-random-distro$/{centos_8}} 1
fail 7134156 2023-01-23 21:00:43 2023-01-23 21:58:34 2023-01-23 23:42:01 1:43:27 1:32:30 0:10:57 smithi main rhel 8.4 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-23T22:19:51.894469+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134157 2023-01-23 21:00:44 2023-01-23 22:02:55 2023-01-23 22:40:21 0:37:26 0:28:34 0:08:52 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-23T22:27:31.807320+0000 mon.a (mon.0) 336 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134158 2023-01-23 21:00:45 2023-01-23 22:05:15 2023-01-23 22:41:58 0:36:43 0:27:56 0:08:47 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-23T22:23:20.565038+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134159 2023-01-23 21:00:46 2023-01-23 22:05:15 2023-01-23 22:50:54 0:45:39 0:34:49 0:10:50 smithi main centos 8.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
fail 7134160 2023-01-23 21:00:47 2023-01-23 22:05:36 2023-01-23 22:32:06 0:26:30 0:19:31 0:06:59 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
Failure Reason:

"2023-01-23T22:29:36.686578+0000 mon.a (mon.0) 919 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134161 2023-01-23 21:00:48 2023-01-23 22:06:26 2023-01-23 22:59:55 0:53:29 0:47:36 0:05:53 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-23T22:23:01.100145+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134162 2023-01-23 21:00:50 2023-01-23 22:06:56 2023-01-23 22:40:30 0:33:34 0:22:59 0:10:35 smithi main centos 8.stream rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 4
Failure Reason:

"2023-01-23T22:26:41.018938+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134163 2023-01-23 21:00:51 2023-01-23 22:07:27 2023-01-23 22:50:19 0:42:52 0:33:49 0:09:03 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} 1
Failure Reason:

"2023-01-23T22:42:08.853679+0000 mon.a (mon.0) 428 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134164 2023-01-23 21:00:52 2023-01-23 22:07:27 2023-01-23 22:34:09 0:26:42 0:15:23 0:11:19 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} 2
Failure Reason:

"2023-01-23T22:28:06.820083+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134165 2023-01-23 21:00:53 2023-01-23 22:09:18 2023-01-23 22:48:04 0:38:46 0:27:52 0:10:54 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} 3
Failure Reason:

"2023-01-23T22:29:37.562238+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134166 2023-01-23 21:00:54 2023-01-23 22:10:58 2023-01-23 22:39:55 0:28:57 0:16:13 0:12:44 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} 3
Failure Reason:

"2023-01-23T22:33:27.524484+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134167 2023-01-23 21:00:55 2023-01-23 22:16:59 2023-01-24 01:32:32 3:15:33 3:06:20 0:09:13 smithi main rhel 8.4 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-23T22:41:53.944052+0000 mon.a (mon.0) 149 : cluster [WRN] Health check failed: 2 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134168 2023-01-23 21:00:57 2023-01-23 22:19:10 2023-01-24 00:00:59 1:41:49 1:31:52 0:09:57 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-23T22:38:36.757058+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134169 2023-01-23 21:00:58 2023-01-23 22:19:40 2023-01-23 23:53:12 1:33:32 1:23:40 0:09:52 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-23T22:39:01.471685+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134170 2023-01-23 21:00:59 2023-01-23 22:20:51 2023-01-23 22:45:08 0:24:17 0:12:21 0:11:56 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} 2
Failure Reason:

"2023-01-23T22:42:37.625436+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134171 2023-01-23 21:01:00 2023-01-23 22:24:12 2023-01-23 22:52:30 0:28:18 0:22:56 0:05:22 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-23T22:45:54.653228+0000 mon.a (mon.0) 407 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134172 2023-01-23 21:01:01 2023-01-23 22:24:12 2023-01-23 23:34:53 1:10:41 0:54:44 0:15:57 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

"2023-01-23T23:05:01.100160+0000 mon.a (mon.0) 737 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134173 2023-01-23 21:01:03 2023-01-23 22:30:13 2023-01-23 23:39:00 1:08:47 0:59:12 0:09:35 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-23T22:48:03.063485+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134174 2023-01-23 21:01:04 2023-01-23 22:30:13 2023-01-24 00:26:01 1:55:48 1:46:43 0:09:05 smithi main rhel 8.4 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-23T22:49:44.036374+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134175 2023-01-23 21:01:05 2023-01-23 22:32:14 2023-01-23 23:09:20 0:37:06 0:25:48 0:11:18 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-23T22:59:09.626045+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134176 2023-01-23 21:01:06 2023-01-23 22:34:14 2023-01-24 01:06:32 2:32:18 2:20:16 0:12:02 smithi main centos 8.stream rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-23T22:56:28.512555+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134177 2023-01-23 21:01:07 2023-01-23 22:36:35 2023-01-23 23:19:41 0:43:06 0:34:30 0:08:36 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} 2
Failure Reason:

"2023-01-23T22:55:37.849518+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134178 2023-01-23 21:01:08 2023-01-23 22:38:55 2023-01-24 00:53:07 2:14:12 2:06:51 0:07:21 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-23T22:57:02.679774+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134179 2023-01-23 21:01:09 2023-01-23 22:40:06 2023-01-23 23:50:35 1:10:29 1:00:52 0:09:37 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
fail 7134180 2023-01-23 21:01:11 2023-01-23 22:40:36 2023-01-23 23:11:20 0:30:44 0:23:58 0:06:46 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-23T23:02:38.776656+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134181 2023-01-23 21:01:12 2023-01-23 22:40:36 2023-01-23 23:35:28 0:54:52 0:44:49 0:10:03 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests} 1
Failure Reason:

"2023-01-23T23:15:48.243803+0000 mon.a (mon.0) 448 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134182 2023-01-23 21:01:13 2023-01-23 22:40:37 2023-01-23 23:20:50 0:40:13 0:32:05 0:08:08 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} 2
Failure Reason:

"2023-01-23T22:58:29.521717+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134183 2023-01-23 21:01:14 2023-01-23 22:42:07 2023-01-23 23:06:26 0:24:19 0:14:36 0:09:43 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} 3
fail 7134184 2023-01-23 21:01:15 2023-01-23 22:45:18 2023-01-24 01:26:05 2:40:47 2:32:13 0:08:34 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/fio} 2
Failure Reason:

"2023-01-23T23:03:04.052676+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134185 2023-01-23 21:01:16 2023-01-23 22:46:38 2023-01-23 23:17:02 0:30:24 0:20:24 0:10:00 smithi main centos 8.stream rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{centos_8} workloads/fsx} 3
Failure Reason:

"2023-01-23T23:06:31.661107+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134186 2023-01-23 21:01:17 2023-01-23 22:50:30 2023-01-24 00:30:34 1:40:04 1:29:54 0:10:10 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-23T23:09:49.848636+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134187 2023-01-23 21:01:19 2023-01-23 22:51:00 2023-01-23 23:13:50 0:22:50 0:14:22 0:08:28 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
fail 7134188 2023-01-23 21:01:20 2023-01-23 22:53:01 2023-01-23 23:27:36 0:34:35 0:23:58 0:10:37 smithi main rhel 8.4 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-23T23:18:56.810332+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7134189 2023-01-23 21:01:21 2023-01-23 22:56:21 2023-01-23 23:44:00 0:47:39 0:33:52 0:13:47 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} 2
fail 7134190 2023-01-23 21:01:22 2023-01-23 23:00:02 2023-01-23 23:55:30 0:55:28 0:45:42 0:09:46 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests_with_defaults} 1
Failure Reason:

"2023-01-23T23:35:22.548460+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134191 2023-01-23 21:01:23 2023-01-23 23:00:32 2023-01-23 23:35:16 0:34:44 0:28:03 0:06:41 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-23T23:22:35.854321+0000 mon.a (mon.0) 329 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134192 2023-01-23 21:01:24 2023-01-23 23:00:33 2023-01-23 23:36:46 0:36:13 0:26:06 0:10:07 smithi main centos 8.stream rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/fio_on_immutable_object_cache} 2
Failure Reason:

"2023-01-23T23:19:51.207927+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134193 2023-01-23 21:01:26 2023-01-23 23:01:53 2023-01-23 23:29:19 0:27:26 0:15:47 0:11:39 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
pass 7134194 2023-01-23 21:01:27 2023-01-23 23:02:33 2023-01-23 23:22:00 0:19:27 0:09:45 0:09:42 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7134195 2023-01-23 21:01:28 2023-01-23 23:02:34 2023-01-23 23:36:55 0:34:21 0:20:04 0:14:17 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
fail 7134196 2023-01-23 21:01:29 2023-01-23 23:13:54 2023-01-23 23:53:01 0:39:07 0:31:30 0:07:37 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-23T23:38:08.392069+0000 mon.a (mon.0) 150 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7134197 2023-01-23 21:01:30 2023-01-23 23:15:55 2023-01-23 23:40:53 0:24:58 0:13:45 0:11:13 smithi main ubuntu 20.04 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
fail 7134198 2023-01-23 21:01:32 2023-01-23 22:48:09 2023-01-24 00:16:30 1:28:21 1:16:26 0:11:55 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

Command failed on smithi142 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

fail 7134199 2023-01-23 21:01:33 2023-01-23 23:17:05 2023-01-24 00:52:38 1:35:33 1:24:02 0:11:31 smithi main centos 8.stream rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-23T23:37:51.911768+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134200 2023-01-23 21:01:34 2023-01-23 23:19:46 2023-01-23 23:56:53 0:37:07 0:30:53 0:06:14 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} 2
Failure Reason:

"2023-01-23T23:36:17.800257+0000 mgr.x (mgr.4123) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134201 2023-01-23 21:01:35 2023-01-23 23:19:46 2023-01-24 00:51:48 1:32:02 1:24:26 0:07:36 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{rhel_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-23T23:37:36.352905+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134202 2023-01-23 21:01:37 2023-01-23 23:20:56 2023-01-23 23:40:47 0:19:51 0:13:45 0:06:06 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} 1
fail 7134203 2023-01-23 21:01:38 2023-01-23 23:20:57 2023-01-24 00:36:42 1:15:45 1:06:11 0:09:34 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-23T23:57:06.985788+0000 mon.a (mon.0) 333 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134204 2023-01-23 21:01:39 2023-01-23 23:22:07 2023-01-23 23:59:04 0:36:57 0:22:54 0:14:03 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} 3
Failure Reason:

"2023-01-23T23:44:52.508450+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134205 2023-01-23 21:01:40 2023-01-23 23:25:58 2023-01-23 23:48:05 0:22:07 0:14:59 0:07:08 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} 2
Failure Reason:

"2023-01-23T23:43:39.931578+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134206 2023-01-23 21:01:41 2023-01-23 23:27:08 2023-01-24 03:12:11 3:45:03 3:36:15 0:08:48 smithi main centos 8.stream rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi087 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66470d7ff315c7c2887bdf61d1964432eb93c3e7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7134207 2023-01-23 21:01:42 2023-01-23 23:27:09 2023-01-24 00:56:50 1:29:41 1:23:11 0:06:30 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-23T23:44:03.056791+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134208 2023-01-23 21:01:43 2023-01-23 23:27:39 2023-01-24 01:21:19 1:53:40 1:40:59 0:12:41 smithi main centos 8.stream rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-23T23:48:44.935465+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134209 2023-01-23 21:01:45 2023-01-23 23:29:20 2023-01-24 01:30:34 2:01:14 1:48:55 0:12:19 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-23T23:52:29.194931+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134210 2023-01-23 21:01:46 2023-01-23 23:35:31 2023-01-24 00:07:48 0:32:17 0:25:36 0:06:41 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 7134211 2023-01-23 21:01:47 2023-01-23 23:36:51 2023-01-24 00:36:18 0:59:27 0:49:56 0:09:31 smithi main centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
fail 7134212 2023-01-23 21:01:48 2023-01-23 23:37:02 2023-01-24 00:12:07 0:35:05 0:25:23 0:09:42 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-24T00:01:56.198288+0000 mon.a (mon.0) 336 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7134213 2023-01-23 21:01:49 2023-01-23 23:37:02 2023-01-24 00:02:38 0:25:36 0:17:09 0:08:27 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7134214 2023-01-23 21:01:50 2023-01-23 23:39:43 2023-01-24 00:28:32 0:48:49 0:39:17 0:09:32 smithi main centos 8.stream rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/recovery} 2
Failure Reason:

"2023-01-23T23:57:11.806388+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134215 2023-01-23 21:01:52 2023-01-23 23:39:43 2023-01-24 00:15:05 0:35:22 0:22:33 0:12:49 smithi main centos 8.stream rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{centos_8}} 4
Failure Reason:

"2023-01-24T00:01:33.465048+0000 mgr.z (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134216 2023-01-23 21:01:53 2023-01-23 23:40:53 2023-01-24 01:10:06 1:29:13 1:20:03 0:09:10 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-23T23:59:46.800652+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134217 2023-01-23 21:01:54 2023-01-23 23:40:54 2023-01-24 00:10:53 0:29:59 0:22:59 0:07:00 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-24T00:04:10.142048+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134218 2023-01-23 21:01:55 2023-01-23 23:42:04 2023-01-24 00:05:06 0:23:02 0:14:24 0:08:38 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} 2
Failure Reason:

"2023-01-24T00:00:49.937561+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134219 2023-01-23 21:01:56 2023-01-23 23:42:05 2023-01-24 00:15:38 0:33:33 0:23:47 0:09:46 smithi main rhel 8.4 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} 3
Failure Reason:

"2023-01-24T00:01:26.335921+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134220 2023-01-23 21:01:57 2023-01-23 23:44:35 2023-01-24 02:11:20 2:26:45 2:17:41 0:09:04 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-24T00:04:37.687907+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134221 2023-01-23 21:01:58 2023-01-23 23:48:06 2023-01-24 00:29:47 0:41:41 0:28:39 0:13:02 smithi main centos 8.stream rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-24T00:09:27.352743+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7134222 2023-01-23 21:02:00 2023-01-23 23:50:37 2023-01-24 00:53:59 1:03:22 0:54:52 0:08:30 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 7134223 2023-01-23 21:02:01 2023-01-23 23:52:57 2023-01-24 03:33:47 3:40:50 3:29:27 0:11:23 smithi main centos 8.stream rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-24T00:13:42.277690+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134224 2023-01-23 21:02:02 2023-01-23 23:53:18 2023-01-24 00:18:23 0:25:05 0:16:10 0:08:55 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
Failure Reason:

"2023-01-24T00:11:46.147670+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134225 2023-01-23 21:02:03 2023-01-23 23:55:18 2023-01-24 01:48:06 1:52:48 1:45:31 0:07:17 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-24T00:13:36.876706+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134226 2023-01-23 21:02:04 2023-01-23 23:56:59 2023-01-24 00:26:09 0:29:10 0:23:23 0:05:47 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-24T00:19:22.626006+0000 mon.a (mon.0) 450 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134227 2023-01-23 21:02:05 2023-01-24 00:39:07 1940 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-24T00:32:49.847475+0000 mon.a (mon.0) 481 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7134228 2023-01-23 21:02:07 2023-01-23 23:58:20 2023-01-24 01:06:19 1:07:59 0:57:52 0:10:07 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-24T00:17:50.121370+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7134229 2023-01-23 21:02:08 2023-01-23 23:59:10 2023-01-24 00:51:40 0:52:30 0:46:17 0:06:13 smithi main rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2023-01-24T00:21:05.340484+0000 mon.a (mon.0) 575 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log