Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7139311 2023-01-27 00:52:53 2023-01-27 01:12:56 2023-01-27 02:25:26 1:12:30 1:03:55 0:08:35 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-27T01:47:29.806340+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139312 2023-01-27 00:52:54 2023-01-27 01:12:56 2023-01-27 01:48:11 0:35:15 0:27:55 0:07:20 smithi main rhel 8.4 rbd/singleton/{all/qos objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2023-01-27T01:35:17.800605+0000 mon.a (mon.0) 105 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139313 2023-01-27 00:52:55 2023-01-27 01:13:06 2023-01-27 02:23:21 1:10:15 0:59:46 0:10:29 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
pass 7139314 2023-01-27 00:52:56 2023-01-27 01:13:17 2023-01-27 01:43:32 0:30:15 0:20:32 0:09:43 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 7139315 2023-01-27 00:52:57 2023-01-27 01:13:27 2023-01-27 01:38:03 0:24:36 0:09:22 0:15:14 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
fail 7139316 2023-01-27 00:52:58 2023-01-27 01:18:18 2023-01-27 01:54:56 0:36:38 0:26:32 0:10:06 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-27T01:38:41.347752+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139317 2023-01-27 00:52:59 2023-01-27 01:21:19 2023-01-27 04:51:28 3:30:09 3:19:12 0:10:57 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi121 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7139318 2023-01-27 00:53:00 2023-01-27 01:21:29 2023-01-27 02:39:48 1:18:19 1:04:47 0:13:32 smithi main rhel 8.4 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/qemu_on_immutable_object_cache_and_thrash} 2
Failure Reason:

"2023-01-27T01:44:57.961593+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139319 2023-01-27 00:53:01 2023-01-27 01:28:40 2023-01-27 03:06:50 1:38:10 1:30:28 0:07:42 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-27T01:46:40.898967+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139320 2023-01-27 00:53:02 2023-01-27 01:29:31 2023-01-27 02:01:51 0:32:20 0:21:48 0:10:32 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
fail 7139321 2023-01-27 00:53:03 2023-01-27 01:30:01 2023-01-27 02:00:46 0:30:45 0:19:13 0:11:32 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
Failure Reason:

"2023-01-27T01:57:33.636456+0000 mon.a (mon.0) 977 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139322 2023-01-27 00:53:04 2023-01-27 01:31:31 2023-01-27 03:48:04 2:16:33 2:08:50 0:07:43 smithi main rhel 8.4 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-27T01:49:47.328484+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139323 2023-01-27 00:53:05 2023-01-27 01:32:42 2023-01-27 01:53:40 0:20:58 0:11:37 0:09:21 smithi main centos 8.stream rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi173.front.sepia.ceph.com: ['type=AVC msg=audit(1674783878.517:14040): avc: denied { map } for pid=77399 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16993): avc: denied { map } for pid=94010 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.716:212): avc: denied { lock } for pid=2548 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.722:213): avc: denied { map } for pid=2548 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783877.316:14035): avc: denied { search } for pid=1847 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674783628.708:211): avc: denied { read } for pid=2548 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14038): avc: denied { open } for pid=77399 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783999.787:16960): avc: denied { read } for pid=696 comm="sssd" name="resolv.conf" dev="sda1" ino=525261 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16992): avc: denied { lock } for pid=94010 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16991): avc: denied { read } for pid=94010 comm="rpm" name="Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784000.148:16991): avc: denied { open } for pid=94010 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14039): avc: denied { lock } for pid=77399 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783628.708:211): avc: denied { open } for pid=2548 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783878.517:14038): avc: denied { read } for pid=77399 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139324 2023-01-27 00:53:06 2023-01-27 01:32:52 2023-01-27 01:56:02 0:23:10 0:12:01 0:11:09 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
fail 7139325 2023-01-27 00:53:07 2023-01-27 01:33:53 2023-01-27 03:27:59 1:54:06 1:45:54 0:08:12 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T01:52:01.364259+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139326 2023-01-27 00:53:08 2023-01-27 01:34:13 2023-01-27 02:06:11 0:31:58 0:22:21 0:09:37 smithi main centos 8.stream rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-27T02:00:08.207374+0000 mon.a (mon.0) 490 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139327 2023-01-27 00:53:09 2023-01-27 01:35:23 2023-01-27 02:06:20 0:30:57 0:22:11 0:08:46 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/fsx} 1
Failure Reason:

SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC msg=audit(1674783788.486:210): avc: denied { map } for pid=2391 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.479:209): avc: denied { lock } for pid=2391 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:212): avc: denied { read } for pid=3700 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:212): avc: denied { open } for pid=3700 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:213): avc: denied { lock } for pid=3700 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.465:208): avc: denied { open } for pid=2391 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783789.481:214): avc: denied { map } for pid=3700 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783788.465:208): avc: denied { read } for pid=2391 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139328 2023-01-27 00:53:10 2023-01-27 01:35:24 2023-01-27 02:28:56 0:53:32 0:46:17 0:07:15 smithi main rhel 8.4 rbd/singleton/{all/rbd_mirror objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2023-01-27T01:58:09.700616+0000 mon.a (mon.0) 592 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139329 2023-01-27 00:53:11 2023-01-27 01:35:24 2023-01-27 04:17:55 2:42:31 2:28:32 0:13:59 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
fail 7139330 2023-01-27 00:53:12 2023-01-27 01:36:24 2023-01-27 02:44:45 1:08:21 0:56:59 0:11:22 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
Failure Reason:

SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674784309.581:16985): avc: denied { lock } for pid=93971 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.024:208): avc: denied { read } for pid=2503 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16984): avc: denied { read } for pid=93971 comm="rpm" name="Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16984): avc: denied { open } for pid=93971 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.581:16986): avc: denied { map } for pid=93971 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.064:210): avc: denied { map } for pid=2503 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.024:208): avc: denied { open } for pid=2503 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783934.045:209): avc: denied { lock } for pid=2503 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784309.221:16953): avc: denied { read } for pid=694 comm="sssd" name="resolv.conf" dev="sda1" ino=525299 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1']

pass 7139331 2023-01-27 00:53:13 2023-01-27 01:37:45 2023-01-27 02:22:20 0:44:35 0:31:24 0:13:11 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
fail 7139332 2023-01-27 00:53:14 2023-01-27 01:39:55 2023-01-27 01:58:53 0:18:58 0:12:40 0:06:18 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi093.front.sepia.ceph.com: ['type=AVC msg=audit(1674784173.063:15019): avc: denied { map } for pid=61328 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:416): avc: denied { map } for pid=6987 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { open } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:414): avc: denied { read } for pid=6987 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { open } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674783906.914:415): avc: denied { lock } for pid=6987 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15017): avc: denied { read } for pid=61328 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784173.063:15018): avc: denied { lock } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784172.718:14996): avc: denied { search } for pid=6897 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1']

fail 7139333 2023-01-27 00:53:15 2023-01-27 01:39:56 2023-01-27 02:02:18 0:22:22 0:15:09 0:07:13 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

SELinux denials found on ubuntu@smithi112.front.sepia.ceph.com: ['type=AVC msg=audit(1674784275.590:15021): avc: denied { map } for pid=61349 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15020): avc: denied { lock } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.594:21275): avc: denied { read } for pid=100598 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17304): avc: denied { lock } for pid=69882 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.483:21423): avc: denied { map } for pid=101327 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21239): avc: denied { getattr } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15019): avc: denied { open } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21247): avc: denied { lock } for pid=100755 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17305): avc: denied { map } for pid=69882 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.237:17272): avc: denied { read } for pid=873 comm="sssd" name="resolv.conf" dev="sda1" ino=394924 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17378): avc: denied { map } for pid=70121 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17303): avc: denied { open } for pid=69882 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21237): avc: denied { open } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.243:14998): avc: denied { search } for pid=6922 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674784773.483:21422): avc: denied { lock } for pid=101327 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17377): avc: denied { lock } for pid=70121 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.594:21275): avc: denied { open } for pid=100598 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21237): avc: denied { read write } for pid=100598 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21246): avc: denied { read } for pid=100755 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21248): avc: denied { map } for pid=100755 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784275.589:15019): avc: denied { read } for pid=61349 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17376): avc: denied { open } for pid=70121 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784370.584:17303): avc: denied { read } for pid=69882 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784769.328:21246): avc: denied { open } for pid=100755 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.482:21421): avc: denied { open } for pid=101327 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21240): avc: denied { map } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784773.482:21421): avc: denied { read } for pid=101327 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784371.351:17376): avc: denied { read } for pid=70121 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784768.941:21238): avc: denied { lock } for pid=100598 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139334 2023-01-27 00:53:16 2023-01-27 01:40:56 2023-01-27 02:30:11 0:49:15 0:41:06 0:08:09 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/8G 7-workloads/recovery} 2
Failure Reason:

"2023-01-27T01:59:47.358096+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139335 2023-01-27 00:53:17 2023-01-27 01:43:07 2023-01-27 02:14:43 0:31:36 0:24:08 0:07:28 smithi main rhel 8.4 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/python_api_tests_with_journaling} 3
Failure Reason:

"2023-01-27T02:00:44.499606+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139336 2023-01-27 00:53:18 2023-01-27 01:43:37 2023-01-27 02:05:27 0:21:50 0:11:55 0:09:55 smithi main centos 8.stream rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_luks_encryption} 1
Failure Reason:

SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674784719.824:16954): avc: denied { read } for pid=688 comm="sssd" name="resolv.conf" dev="sda1" ino=525299 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.229:208): avc: denied { open } for pid=2222 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16985): avc: denied { read } for pid=93960 comm="rpm" name="Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.229:208): avc: denied { read } for pid=2222 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16986): avc: denied { lock } for pid=93960 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:214): avc: denied { map } for pid=3528 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.249:209): avc: denied { lock } for pid=2222 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16985): avc: denied { open } for pid=93960 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525267 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784340.254:210): avc: denied { map } for pid=2222 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784720.182:16987): avc: denied { map } for pid=93960 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:213): avc: denied { lock } for pid=3528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:212): avc: denied { read } for pid=3528 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784341.126:212): avc: denied { open } for pid=3528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139337 2023-01-27 00:53:19 2023-01-27 01:43:37 2023-01-27 02:11:41 0:28:04 0:15:45 0:12:19 smithi main centos 8.stream rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/qemu_fsstress} 3
Failure Reason:

"2023-01-27T02:05:56.890168+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139338 2023-01-27 00:53:20 2023-01-27 01:45:58 2023-01-27 02:14:24 0:28:26 0:14:53 0:13:33 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_copy_on_read} 2
pass 7139339 2023-01-27 00:53:21 2023-01-27 01:48:19 2023-01-27 05:49:14 4:00:55 3:49:10 0:11:45 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} 3
pass 7139340 2023-01-27 00:53:22 2023-01-27 01:48:49 2023-01-27 02:08:39 0:19:50 0:09:30 0:10:20 smithi main ubuntu 20.04 rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7139341 2023-01-27 00:53:23 2023-01-27 01:48:49 2023-01-27 05:42:19 3:53:30 3:38:44 0:14:46 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
fail 7139342 2023-01-27 00:53:24 2023-01-27 01:53:40 2023-01-27 03:22:11 1:28:31 1:18:24 0:10:07 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T02:14:03.768854+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139343 2023-01-27 00:53:25 2023-01-27 01:55:01 2023-01-27 02:28:43 0:33:42 0:23:24 0:10:18 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
fail 7139344 2023-01-27 00:53:26 2023-01-27 01:55:01 2023-01-27 02:13:20 0:18:19 0:11:08 0:07:11 smithi main rhel 8.4 rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi182.front.sepia.ceph.com: ['type=AVC msg=audit(1674785154.254:15000): avc: denied { search } for pid=6896 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674784891.641:418): avc: denied { read } for pid=6986 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15022): avc: denied { lock } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.641:418): avc: denied { open } for pid=6986 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.642:419): avc: denied { lock } for pid=6986 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15021): avc: denied { open } for pid=61328 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.600:15021): avc: denied { read } for pid=61328 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674784891.642:420): avc: denied { map } for pid=6986 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785154.601:15023): avc: denied { map } for pid=61328 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139345 2023-01-27 00:53:27 2023-01-27 01:56:11 2023-01-27 02:25:53 0:29:42 0:20:51 0:08:51 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} 1
fail 7139346 2023-01-27 00:53:28 2023-01-27 01:56:12 2023-01-27 02:39:31 0:43:19 0:32:48 0:10:31 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-27T02:31:58.955634+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139347 2023-01-27 00:53:29 2023-01-27 01:56:12 2023-01-27 05:39:31 3:43:19 3:37:05 0:06:14 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi098 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7139348 2023-01-27 00:53:30 2023-01-27 01:56:12 2023-01-27 03:02:33 1:06:21 0:53:56 0:12:25 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674785483.791:15034): avc: denied { map } for pid=61349 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.438:15011): avc: denied { search } for pid=6923 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674785483.791:15033): avc: denied { lock } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17391): avc: denied { map } for pid=70123 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { open } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { read } for pid=7013 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:428): avc: denied { lock } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { open } for pid=61349 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:429): avc: denied { map } for pid=7013 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { open } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17317): avc: denied { lock } for pid=69884 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17316): avc: denied { read } for pid=69884 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785206.429:427): avc: denied { open } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17389): avc: denied { read } for pid=70123 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785581.624:17390): avc: denied { lock } for pid=70123 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.851:17318): avc: denied { map } for pid=69884 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785580.496:17285): avc: denied { read } for pid=867 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674785483.791:15032): avc: denied { read } for pid=61349 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139349 2023-01-27 00:53:31 2023-01-27 02:00:43 2023-01-27 02:28:54 0:28:11 0:17:20 0:10:51 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7139350 2023-01-27 00:53:32 2023-01-27 02:00:53 2023-01-27 02:24:57 0:24:04 0:17:33 0:06:31 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} 2
Failure Reason:

"2023-01-27T02:18:35.391685+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139351 2023-01-27 00:53:33 2023-01-27 02:01:54 2023-01-27 02:41:42 0:39:48 0:32:36 0:07:12 smithi main rhel 8.4 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_fio} 3
Failure Reason:

"2023-01-27T02:19:18.055961+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139352 2023-01-27 00:53:34 2023-01-27 02:02:24 2023-01-27 02:38:31 0:36:07 0:25:21 0:10:46 smithi main centos 8.stream rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-27T02:28:18.844842+0000 mon.a (mon.0) 156 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139353 2023-01-27 00:53:35 2023-01-27 02:02:25 2023-01-27 03:41:21 1:38:56 1:25:20 0:13:36 smithi main centos 8.stream rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-27T02:24:59.950616+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139354 2023-01-27 00:53:36 2023-01-27 02:06:25 2023-01-27 03:26:56 1:20:31 1:04:36 0:15:55 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-27T02:30:08.006406+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139355 2023-01-27 00:53:37 2023-01-27 02:11:46 2023-01-27 02:30:09 0:18:23 0:08:43 0:09:40 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139356 2023-01-27 00:53:38 2023-01-27 02:11:47 2023-01-27 03:33:45 1:21:58 1:08:47 0:13:11 smithi main centos 8.stream rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-27T02:33:22.324986+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139357 2023-01-27 00:53:39 2023-01-27 02:14:27 2023-01-27 03:58:25 1:43:58 1:37:33 0:06:25 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-27T02:32:15.141551+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139358 2023-01-27 00:53:40 2023-01-27 02:14:48 2023-01-27 02:55:53 0:41:05 0:26:11 0:14:54 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
Failure Reason:

SELinux denials found on ubuntu@smithi165.front.sepia.ceph.com: ['type=AVC msg=audit(1674786749.098:15025): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786748.752:15002): avc: denied { search } for pid=6922 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674786749.098:15024): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786749.098:15023): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139359 2023-01-27 00:53:41 2023-01-27 02:22:29 2023-01-27 02:49:28 0:26:59 0:16:15 0:10:44 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} 2
fail 7139360 2023-01-27 00:53:42 2023-01-27 02:23:30 2023-01-27 04:15:52 1:52:22 1:41:24 0:10:58 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{centos_8} 5-pool/replicated-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T02:43:46.283239+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139361 2023-01-27 00:53:43 2023-01-27 02:25:00 2023-01-27 02:42:56 0:17:56 0:08:49 0:09:07 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
fail 7139362 2023-01-27 00:53:44 2023-01-27 02:25:31 2023-01-27 02:51:39 0:26:08 0:13:13 0:12:55 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

SELinux denials found on ubuntu@smithi016.front.sepia.ceph.com: ['type=AVC msg=audit(1674787273.495:14039): avc: denied { read } for pid=77369 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16994): avc: denied { map } for pid=93980 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16992): avc: denied { read } for pid=93980 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14039): avc: denied { open } for pid=77369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.944:214): avc: denied { lock } for pid=6317 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.952:215): avc: denied { map } for pid=6317 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787272.346:14036): avc: denied { search } for pid=6204 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787396.255:16961): avc: denied { read } for pid=689 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16992): avc: denied { open } for pid=93980 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787396.633:16993): avc: denied { lock } for pid=93980 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.934:213): avc: denied { read } for pid=6317 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14040): avc: denied { lock } for pid=77369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787017.934:213): avc: denied { open } for pid=6317 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787273.495:14041): avc: denied { map } for pid=77369 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139363 2023-01-27 00:53:45 2023-01-27 02:28:51 2023-01-27 02:50:06 0:21:15 0:11:36 0:09:39 smithi main centos 8.stream rbd/singleton/{all/read-flags-writeback objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi161.front.sepia.ceph.com: ['type=AVC msg=audit(1674787291.097:14038): avc: denied { lock } for pid=77400 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14044): avc: denied { lock } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787290.737:14036): avc: denied { search } for pid=6247 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525252 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787044.648:213): avc: denied { open } for pid=6360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14043): avc: denied { read } for pid=77407 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14043): avc: denied { open } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.657:214): avc: denied { lock } for pid=6360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16997): avc: denied { map } for pid=94017 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.096:14037): avc: denied { open } for pid=77400 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16996): avc: denied { lock } for pid=94017 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16995): avc: denied { open } for pid=94017 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.869:14045): avc: denied { map } for pid=77407 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.758:16998): avc: denied { read } for pid=740 comm="sssd" name="resolv.conf" dev="sda1" ino=395820 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.668:215): avc: denied { map } for pid=6360 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.097:14039): avc: denied { map } for pid=77400 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787044.648:213): avc: denied { read } for pid=6360 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787291.096:14037): avc: denied { read } for pid=77400 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.385:16964): avc: denied { read } for pid=740 comm="sssd" name="resolv.conf" dev="sda1" ino=395818 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787414.744:16995): avc: denied { read } for pid=94017 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139364 2023-01-27 00:53:46 2023-01-27 02:29:01 2023-01-27 03:36:14 1:07:13 0:56:47 0:10:26 smithi main centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 7139365 2023-01-27 00:53:47 2023-01-27 02:29:02 2023-01-27 02:48:02 0:19:00 0:13:21 0:05:39 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/rbd_cls_tests} 1
Failure Reason:

SELinux denials found on ubuntu@smithi080.front.sepia.ceph.com: ['type=AVC msg=audit(1674787117.189:15024): avc: denied { map } for pid=61363 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:421): avc: denied { map } for pid=7021 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:420): avc: denied { lock } for pid=7021 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15022): avc: denied { read } for pid=61363 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15023): avc: denied { lock } for pid=61363 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787117.189:15022): avc: denied { open } for pid=61363 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787116.838:15001): avc: denied { search } for pid=6931 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674786853.717:419): avc: denied { read } for pid=7021 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674786853.717:419): avc: denied { open } for pid=7021 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139366 2023-01-27 00:53:48 2023-01-27 02:29:02 2023-01-27 03:13:06 0:44:04 0:33:59 0:10:05 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} 1
Failure Reason:

"2023-01-27T03:05:42.276740+0000 mon.a (mon.0) 444 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139367 2023-01-27 00:53:49 2023-01-27 02:30:12 2023-01-27 03:15:26 0:45:14 0:26:37 0:18:37 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 7139368 2023-01-27 00:53:50 2023-01-27 02:38:34 2023-01-27 03:15:40 0:37:06 0:26:24 0:10:42 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
fail 7139369 2023-01-27 00:53:51 2023-01-27 02:39:34 2023-01-27 03:23:01 0:43:27 0:34:21 0:09:06 smithi main rhel 8.4 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-27T03:04:14.388930+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139370 2023-01-27 00:53:52 2023-01-27 02:41:45 2023-01-27 04:42:04 2:00:19 1:48:57 0:11:22 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-27T03:01:49.673925+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139371 2023-01-27 00:53:53 2023-01-27 02:43:06 2023-01-27 03:17:39 0:34:33 0:26:27 0:08:06 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-policy-none} 2
Failure Reason:

SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674787790.129:418): avc: denied { read } for pid=6997 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15023): avc: denied { read } for pid=61340 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15023): avc: denied { open } for pid=61340 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787790.129:420): avc: denied { map } for pid=6997 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674787790.129:418): avc: denied { open } for pid=6997 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15025): avc: denied { map } for pid=61340 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.022:15000): avc: denied { search } for pid=6907 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674787790.129:419): avc: denied { lock } for pid=6997 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674788056.367:15024): avc: denied { lock } for pid=61340 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139372 2023-01-27 00:53:54 2023-01-27 02:44:46 2023-01-27 03:04:29 0:19:43 0:08:33 0:11:10 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139373 2023-01-27 00:53:54 2023-01-27 02:46:36 2023-01-27 03:11:15 0:24:39 0:16:19 0:08:20 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} 2
Failure Reason:

"2023-01-27T03:04:40.688909+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139374 2023-01-27 00:53:56 2023-01-27 02:48:07 2023-01-27 05:10:10 2:22:03 2:10:42 0:11:21 smithi main ubuntu 20.04 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} 3
fail 7139375 2023-01-27 00:53:56 2023-01-27 02:50:08 2023-01-27 03:26:26 0:36:18 0:25:23 0:10:55 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-27T03:16:37.233199+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139376 2023-01-27 00:53:57 2023-01-27 02:51:48 2023-01-27 03:26:08 0:34:20 0:29:10 0:05:10 smithi main rhel 8.4 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-27T03:07:32.595411+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139377 2023-01-27 00:53:58 2023-01-27 02:51:48 2023-01-27 03:52:27 1:00:39 0:38:28 0:22:11 smithi main centos 8.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
Failure Reason:

SELinux denials found on ubuntu@smithi002.front.sepia.ceph.com: ['type=AVC msg=audit(1674789523.009:16961): avc: denied { read } for pid=692 comm="sssd" name="resolv.conf" dev="sda1" ino=525300 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { open } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { open } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16993): avc: denied { lock } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { read } for pid=94007 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.230:217): avc: denied { map } for pid=6342 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14037): avc: denied { read } for pid=77380 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16994): avc: denied { map } for pid=94007 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789399.032:14038): avc: denied { lock } for pid=77380 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.213:215): avc: denied { read } for pid=6342 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789398.678:14036): avc: denied { search } for pid=6229 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674789399.032:14039): avc: denied { map } for pid=77380 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789523.379:16992): avc: denied { open } for pid=94007 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674789150.220:216): avc: denied { lock } for pid=6342 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139378 2023-01-27 00:53:59 2023-01-27 03:02:40 2023-01-27 03:32:41 0:30:01 0:16:03 0:13:58 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7139379 2023-01-27 00:54:00 2023-01-27 03:06:51 2023-01-27 04:00:08 0:53:17 0:47:23 0:05:54 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/c_api_tests_with_defaults} 2
Failure Reason:

"2023-01-27T03:23:02.157277+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139380 2023-01-27 00:54:01 2023-01-27 03:06:51 2023-01-27 03:47:12 0:40:21 0:20:26 0:19:55 smithi main centos 8.stream rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} 4
Failure Reason:

"2023-01-27T03:35:51.553631+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139381 2023-01-27 00:54:02 2023-01-27 03:15:33 2023-01-27 05:34:05 2:18:32 2:08:08 0:10:24 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 7139382 2023-01-27 00:54:03 2023-01-27 03:15:43 2023-01-27 03:35:19 0:19:36 0:08:47 0:10:49 smithi main ubuntu 20.04 rbd/singleton/{all/snap-diff objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7139383 2023-01-27 00:54:04 2023-01-27 03:17:44 2023-01-27 04:24:19 1:06:35 0:52:02 0:14:33 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 7139384 2023-01-27 00:54:05 2023-01-27 03:22:15 2023-01-27 03:42:32 0:20:17 0:12:39 0:07:38 smithi main centos 8.stream rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} 1
Failure Reason:

SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1674790541.377:16961): avc: denied { read } for pid=687 comm="sssd" name="resolv.conf" dev="sda1" ino=525293 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.345:212): avc: denied { read } for pid=6337 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790414.641:14036): avc: denied { search } for pid=6055 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393279 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674790541.753:16992): avc: denied { read } for pid=94002 comm="rpm" name="Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.376:214): avc: denied { map } for pid=6337 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14038): avc: denied { lock } for pid=77381 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14039): avc: denied { map } for pid=77381 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16993): avc: denied { lock } for pid=94002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16994): avc: denied { map } for pid=94002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.345:212): avc: denied { open } for pid=6337 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14037): avc: denied { read } for pid=77381 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790415.003:14037): avc: denied { open } for pid=77381 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790163.367:213): avc: denied { lock } for pid=6337 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790541.753:16992): avc: denied { open } for pid=94002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139385 2023-01-27 00:54:06 2023-01-27 03:22:15 2023-01-27 04:05:08 0:42:53 0:33:22 0:09:31 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} 1
Failure Reason:

"2023-01-27T03:56:58.726269+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139386 2023-01-27 00:54:07 2023-01-27 03:22:15 2023-01-27 05:36:25 2:14:10 2:03:20 0:10:50 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-27T03:41:57.711538+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139387 2023-01-27 00:54:08 2023-01-27 03:23:05 2023-01-27 03:59:42 0:36:37 0:23:27 0:13:10 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
fail 7139388 2023-01-27 00:54:09 2023-01-27 03:26:16 2023-01-27 03:50:08 0:23:52 0:17:14 0:06:38 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} 2
Failure Reason:

"2023-01-27T03:43:38.104429+0000 mgr.y (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139389 2023-01-27 00:54:10 2023-01-27 03:27:07 2023-01-27 04:07:44 0:40:37 0:27:55 0:12:42 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_defaults} 3
Failure Reason:

"2023-01-27T03:48:26.138137+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139390 2023-01-27 00:54:11 2023-01-27 03:28:07 2023-01-27 03:45:44 0:17:37 0:08:55 0:08:42 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} 1
pass 7139391 2023-01-27 00:54:12 2023-01-27 03:28:07 2023-01-27 03:56:49 0:28:42 0:13:34 0:15:08 smithi main ubuntu 20.04 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
pass 7139392 2023-01-27 00:54:13 2023-01-27 03:32:48 2023-01-27 03:51:45 0:18:57 0:08:40 0:10:17 smithi main ubuntu 20.04 rbd/singleton/{all/verify_pool objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139393 2023-01-27 00:54:14 2023-01-27 03:33:49 2023-01-27 07:04:44 3:30:55 3:18:56 0:11:59 smithi main centos 8.stream rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-27T03:54:19.051412+0000 mgr.y (mgr.4129) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139394 2023-01-27 00:54:15 2023-01-27 03:35:29 2023-01-27 03:55:17 0:19:48 0:12:33 0:07:15 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi203.front.sepia.ceph.com: ['type=AVC msg=audit(1674790889.602:418): avc: denied { map } for pid=7013 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15020): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15019): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.634:14998): avc: denied { search } for pid=6923 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674790889.602:416): avc: denied { open } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15021): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790889.602:416): avc: denied { read } for pid=7013 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791150.981:15019): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674790889.602:417): avc: denied { lock } for pid=7013 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139395 2023-01-27 00:54:16 2023-01-27 03:36:19 2023-01-27 04:02:21 0:26:02 0:14:03 0:11:59 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674791466.599:15034): avc: denied { open } for pid=61374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17353): avc: denied { lock } for pid=70016 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.599:15036): avc: denied { map } for pid=61374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17352): avc: denied { read } for pid=70016 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.245:15013): avc: denied { search } for pid=6941 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674791466.599:15034): avc: denied { read } for pid=61374 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17354): avc: denied { map } for pid=70016 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791563.123:17352): avc: denied { open } for pid=70016 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791466.599:15035): avc: denied { lock } for pid=61374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674791562.754:17317): avc: denied { read } for pid=788 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1']

fail 7139396 2023-01-27 00:54:17 2023-01-27 03:41:30 2023-01-27 05:34:54 1:53:24 1:39:33 0:13:51 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/rebuild_object_map} 3
Failure Reason:

"2023-01-27T04:04:14.228054+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139397 2023-01-27 00:54:18 2023-01-27 03:45:51 2023-01-27 05:59:08 2:13:17 2:02:02 0:11:15 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 7139398 2023-01-27 00:54:19 2023-01-27 03:47:22 2023-01-27 04:16:06 0:28:44 0:16:54 0:11:50 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
fail 7139399 2023-01-27 00:54:20 2023-01-27 03:48:12 2023-01-27 04:43:41 0:55:29 0:45:03 0:10:26 smithi main centos 8.stream rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2023-01-27T04:09:50.108780+0000 mon.a (mon.0) 226 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7139400 2023-01-27 00:54:21 2023-01-27 03:48:13 2023-01-27 04:08:09 0:19:56 0:08:04 0:11:52 smithi main ubuntu 20.04 rbd/singleton/{all/admin_socket objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139401 2023-01-27 00:54:22 2023-01-27 03:50:13 2023-01-27 04:15:00 0:24:47 0:12:28 0:12:19 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} 2
Failure Reason:

"2023-01-27T04:10:41.134436+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139402 2023-01-27 00:54:23 2023-01-27 03:51:54 2023-01-27 04:21:39 0:29:45 0:22:35 0:07:10 smithi main rhel 8.4 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rbd_python_api_tests_old_format} 1
Failure Reason:

"2023-01-27T04:14:45.254355+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139403 2023-01-27 00:54:24 2023-01-27 03:52:34 2023-01-27 04:58:10 1:05:36 0:54:54 0:10:42 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

"2023-01-27T04:29:19.135325+0000 mon.a (mon.0) 756 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139404 2023-01-27 00:54:25 2023-01-27 03:52:34 2023-01-27 05:27:27 1:34:53 1:20:49 0:14:04 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} 2
pass 7139405 2023-01-27 00:54:26 2023-01-27 03:55:25 2023-01-27 04:47:11 0:51:46 0:39:52 0:11:54 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 7139406 2023-01-27 00:54:27 2023-01-27 03:56:55 2023-01-27 04:16:23 0:19:28 0:08:45 0:10:43 smithi main ubuntu 20.04 rbd/singleton/{all/formatted-output objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139407 2023-01-27 00:54:28 2023-01-27 03:58:36 2023-01-27 04:19:08 0:20:32 0:12:27 0:08:05 smithi main centos 8.stream rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi019.front.sepia.ceph.com: ['type=AVC msg=audit(1674792611.189:14038): avc: denied { lock } for pid=77348 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14037): avc: denied { open } for pid=77348 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14037): avc: denied { read } for pid=77348 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792611.189:14039): avc: denied { map } for pid=77348 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.737:212): avc: denied { lock } for pid=6193 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16992): avc: denied { open } for pid=93966 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16992): avc: denied { read } for pid=93966 comm="rpm" name="Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16994): avc: denied { map } for pid=93966 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525263 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.716:211): avc: denied { open } for pid=6193 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17065): avc: denied { map } for pid=94283 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525263 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.052:16961): avc: denied { read } for pid=680 comm="sssd" name="resolv.conf" dev="sda1" ino=525295 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17063): avc: denied { open } for pid=94283 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792739.238:17064): avc: denied { lock } for pid=94283 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.425:16993): avc: denied { lock } for pid=93966 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.747:213): avc: denied { map } for pid=6193 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792738.448:16995): avc: denied { read } for pid=680 comm="sssd" name="resolv.conf" dev="sda1" ino=525297 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792359.716:211): avc: denied { read } for pid=6193 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674792610.772:14036): avc: denied { search } for pid=5378 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393279 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674792739.238:17063): avc: denied { read } for pid=94283 comm="rpm" name="Packages" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139408 2023-01-27 00:54:29 2023-01-27 03:58:36 2023-01-27 06:59:25 3:00:49 2:49:47 0:11:02 smithi main ubuntu 20.04 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
fail 7139409 2023-01-27 00:54:30 2023-01-27 03:59:47 2023-01-27 04:35:32 0:35:45 0:24:34 0:11:11 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-27T04:25:55.734004+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139410 2023-01-27 00:54:31 2023-01-27 04:00:17 2023-01-27 04:28:14 0:27:57 0:15:59 0:11:58 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7139411 2023-01-27 00:54:32 2023-01-27 04:02:28 2023-01-27 06:49:31 2:47:03 2:34:43 0:12:20 smithi main rhel 8.4 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-27T04:30:49.950760+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139412 2023-01-27 00:54:33 2023-01-27 04:07:49 2023-01-27 04:50:42 0:42:53 0:33:05 0:09:48 smithi main centos 8.stream rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/cache thrashosds-health workloads/rbd_api_tests} 2
Failure Reason:

"2023-01-27T04:25:55.671056+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139413 2023-01-27 00:54:34 2023-01-27 04:07:49 2023-01-27 06:28:24 2:20:35 2:06:26 0:14:09 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-27T04:31:38.903130+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139414 2023-01-27 00:54:35 2023-01-27 04:15:10 2023-01-27 04:38:50 0:23:40 0:13:07 0:10:33 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-bootstrap-workunit} 2
Failure Reason:

SELinux denials found on ubuntu@smithi077.front.sepia.ceph.com: ['type=AVC msg=audit(1674793419.933:210): avc: denied { lock } for pid=2519 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.921:209): avc: denied { open } for pid=2519 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:213): avc: denied { open } for pid=3718 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:213): avc: denied { read } for pid=3718 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.921:209): avc: denied { read } for pid=2519 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793419.944:211): avc: denied { map } for pid=2519 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:215): avc: denied { map } for pid=3718 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793420.793:214): avc: denied { lock } for pid=3718 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139415 2023-01-27 00:54:36 2023-01-27 04:16:01 2023-01-27 05:23:32 1:07:31 1:01:19 0:06:12 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} 2
Failure Reason:

SELinux denials found on ubuntu@smithi148.front.sepia.ceph.com: ['type=AVC msg=audit(1674793300.769:420): avc: denied { lock } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15024): avc: denied { map } for pid=61343 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793571.666:14989): avc: denied { search } for pid=6912 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674793572.015:15022): avc: denied { open } for pid=61343 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:419): avc: denied { read } for pid=7002 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:419): avc: denied { open } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15023): avc: denied { lock } for pid=61343 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793300.769:421): avc: denied { map } for pid=7002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793572.015:15022): avc: denied { read } for pid=61343 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139416 2023-01-27 00:54:37 2023-01-27 04:16:11 2023-01-27 04:37:50 0:21:39 0:11:34 0:10:05 smithi main ubuntu 20.04 rbd/singleton/{all/merge_diff objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7139417 2023-01-27 00:54:38 2023-01-27 04:16:11 2023-01-27 06:35:30 2:19:19 2:04:32 0:14:47 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
fail 7139418 2023-01-27 00:54:39 2023-01-27 04:18:02 2023-01-27 04:49:02 0:31:00 0:22:25 0:08:35 smithi main centos 8.stream rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-27T04:43:23.758098+0000 mon.a (mon.0) 516 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139419 2023-01-27 00:54:40 2023-01-27 04:18:02 2023-01-27 05:13:42 0:55:40 0:46:29 0:09:11 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/c_api_tests} 1
Failure Reason:

"2023-01-27T04:53:47.302450+0000 mon.a (mon.0) 431 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139420 2023-01-27 00:54:41 2023-01-27 04:19:13 2023-01-27 05:05:38 0:46:25 0:34:23 0:12:02 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} 2
Failure Reason:

"2023-01-27T04:41:12.912650+0000 mgr.y (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139421 2023-01-27 00:54:42 2023-01-27 04:24:23 2023-01-27 04:45:19 0:20:56 0:12:09 0:08:47 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi169.front.sepia.ceph.com: ['type=AVC msg=audit(1674793934.746:210): avc: denied { read } for pid=3370 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14037): avc: denied { open } for pid=77371 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794179.127:14034): avc: denied { search } for pid=1873 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674794180.423:14039): avc: denied { map } for pid=77371 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14037): avc: denied { read } for pid=77371 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794180.423:14038): avc: denied { lock } for pid=77371 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.764:211): avc: denied { lock } for pid=3370 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.766:212): avc: denied { map } for pid=3370 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674793934.746:210): avc: denied { open } for pid=3370 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139422 2023-01-27 00:54:43 2023-01-27 04:24:24 2023-01-27 04:51:25 0:27:01 0:13:25 0:13:36 smithi main centos 8.stream rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674794432.272:14038): avc: denied { open } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.273:14040): avc: denied { map } for pid=77374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794431.909:14035): avc: denied { search } for pid=1821 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525248 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674794432.273:14039): avc: denied { lock } for pid=77374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674794432.272:14038): avc: denied { read } for pid=77374 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139423 2023-01-27 00:54:44 2023-01-27 04:28:25 2023-01-27 07:34:13 3:05:48 2:45:07 0:20:41 smithi main ubuntu 20.04 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/fio} 2
pass 7139424 2023-01-27 00:54:45 2023-01-27 04:37:56 2023-01-27 05:18:00 0:40:04 0:25:20 0:14:44 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 7139425 2023-01-27 00:54:46 2023-01-27 04:42:07 2023-01-27 04:59:38 0:17:31 0:08:32 0:08:59 smithi main ubuntu 20.04 rbd/singleton/{all/mon-command-help objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139426 2023-01-27 00:54:47 2023-01-27 04:42:07 2023-01-27 06:25:19 1:43:12 1:31:13 0:11:59 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-27T05:02:55.135528+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139427 2023-01-27 00:54:48 2023-01-27 04:43:48 2023-01-27 05:07:18 0:23:30 0:10:39 0:12:51 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
fail 7139428 2023-01-27 00:54:49 2023-01-27 04:47:18 2023-01-27 05:06:13 0:18:55 0:13:10 0:05:45 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_luks_encryption} 1
Failure Reason:

SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1674795418.423:15023): avc: denied { lock } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:419): avc: denied { open } for pid=6991 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15022): avc: denied { open } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15024): avc: denied { map } for pid=61332 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17306): avc: denied { open } for pid=69858 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.067:14999): avc: denied { search } for pid=6900 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674795145.682:421): avc: denied { map } for pid=6991 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17307): avc: denied { lock } for pid=69858 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:419): avc: denied { read } for pid=6991 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17306): avc: denied { read } for pid=69858 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795418.423:15022): avc: denied { read } for pid=61332 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795518.648:17275): avc: denied { read } for pid=866 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795145.682:420): avc: denied { lock } for pid=6991 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795519.013:17308): avc: denied { map } for pid=69858 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139429 2023-01-27 00:54:50 2023-01-27 04:47:19 2023-01-27 05:23:10 0:35:51 0:24:05 0:11:46 smithi main rhel 8.4 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-27T05:08:46.180806+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139430 2023-01-27 00:54:51 2023-01-27 04:50:49 2023-01-27 06:04:21 1:13:32 1:06:49 0:06:43 smithi main rhel 8.4 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-27T05:08:06.704087+0000 mgr.x (mgr.4122) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139431 2023-01-27 00:54:52 2023-01-27 04:51:30 2023-01-27 05:34:33 0:43:03 0:36:02 0:07:01 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} 2
Failure Reason:

SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674795677.080:15036): avc: denied { map } for pid=61358 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.636:19711): avc: denied { read } for pid=87559 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:420): avc: denied { lock } for pid=6994 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17320): avc: denied { map } for pid=69894 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19510): avc: denied { map } for pid=86742 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795772.934:17287): avc: denied { read } for pid=902 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19508): avc: denied { open } for pid=86742 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797222.301:19507): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797545.636:19713): avc: denied { map } for pid=87559 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:419): avc: denied { open } for pid=6994 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19509): avc: denied { lock } for pid=86742 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797225.696:19508): avc: denied { read } for pid=86742 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17318): avc: denied { open } for pid=69894 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.253:19678): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797545.636:19711): avc: denied { open } for pid=87559 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797545.636:19712): avc: denied { lock } for pid=87559 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:419): avc: denied { read } for pid=6994 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15034): avc: denied { open } for pid=61358 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15035): avc: denied { lock } for pid=61358 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795403.416:421): avc: denied { map } for pid=6994 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795677.080:15034): avc: denied { read } for pid=61358 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795773.290:17319): avc: denied { lock } for pid=69894 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795676.717:14999): avc: denied { search } for pid=6921 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674795773.290:17318): avc: denied { read } for pid=69894 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139432 2023-01-27 00:54:53 2023-01-27 04:51:30 2023-01-27 05:17:49 0:26:19 0:13:29 0:12:50 smithi main rhel 8.4 rbd/singleton/{all/permissions objectstore/bluestore-comp-zlib openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi090.front.sepia.ceph.com: ['type=AVC msg=audit(1674795841.947:415): avc: denied { map } for pid=7026 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.301:14995): avc: denied { search } for pid=6936 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674796103.646:15017): avc: denied { lock } for pid=61369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15018): avc: denied { map } for pid=61369 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15016): avc: denied { read } for pid=61369 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:414): avc: denied { lock } for pid=7026 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:413): avc: denied { read } for pid=7026 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674795841.947:413): avc: denied { open } for pid=7026 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796103.646:15016): avc: denied { open } for pid=61369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139433 2023-01-27 00:54:54 2023-01-27 04:58:11 2023-01-27 07:10:50 2:12:39 1:59:13 0:13:26 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T05:22:13.822531+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139434 2023-01-27 00:54:55 2023-01-27 05:05:43 2023-01-27 05:55:39 0:49:56 0:37:35 0:12:21 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} 2
fail 7139435 2023-01-27 00:54:56 2023-01-27 05:07:23 2023-01-27 05:29:58 0:22:35 0:12:50 0:09:45 smithi main centos 8.stream rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/rbd_cls_tests} 1
Failure Reason:

SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1674796515.146:214): avc: denied { lock } for pid=6351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.136:213): avc: denied { read } for pid=6351 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796893.682:16961): avc: denied { read } for pid=715 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14035): avc: denied { open } for pid=77387 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17056): avc: denied { read } for pid=94315 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17057): avc: denied { lock } for pid=94315 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.136:213): avc: denied { open } for pid=6351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17056): avc: denied { open } for pid=94315 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16992): avc: denied { open } for pid=94006 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16994): avc: denied { map } for pid=94006 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.838:17058): avc: denied { map } for pid=94315 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796515.150:215): avc: denied { map } for pid=6351 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14036): avc: denied { lock } for pid=77387 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.520:14034): avc: denied { search } for pid=6238 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674796894.040:16992): avc: denied { read } for pid=94006 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14035): avc: denied { read } for pid=77387 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796894.040:16993): avc: denied { lock } for pid=94006 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674796766.896:14037): avc: denied { map } for pid=77387 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139436 2023-01-27 00:54:57 2023-01-27 05:07:23 2023-01-27 06:05:20 0:57:57 0:46:19 0:11:38 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests_with_defaults} 1
Failure Reason:

"2023-01-27T05:45:27.076788+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139437 2023-01-27 00:54:58 2023-01-27 05:10:14 2023-01-27 05:44:06 0:33:52 0:24:05 0:09:47 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
fail 7139438 2023-01-27 00:54:59 2023-01-27 05:10:14 2023-01-27 05:46:16 0:36:02 0:27:17 0:08:45 smithi main rhel 8.4 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} 2
Failure Reason:

"2023-01-27T05:29:42.409472+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139439 2023-01-27 00:55:00 2023-01-27 05:13:45 2023-01-27 07:41:23 2:27:38 2:12:35 0:15:03 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-27T05:37:05.017852+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139440 2023-01-27 00:55:01 2023-01-27 05:18:06 2023-01-27 05:58:19 0:40:13 0:24:45 0:15:28 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
Failure Reason:

SELinux denials found on ubuntu@smithi142.front.sepia.ceph.com: ['type=AVC msg=audit(1674797498.366:214): avc: denied { lock } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { read } for pid=94164 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14039): avc: denied { map } for pid=77401 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17021): avc: denied { lock } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { read } for pid=6359 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.340:213): avc: denied { open } for pid=6359 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17020): avc: denied { open } for pid=94164 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.060:16989): avc: denied { read } for pid=699 comm="sssd" name="resolv.conf" dev="sda1" ino=525304 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { read } for pid=77401 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797867.408:17022): avc: denied { map } for pid=94164 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14037): avc: denied { open } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797745.915:14038): avc: denied { lock } for pid=77401 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797498.371:215): avc: denied { map } for pid=6359 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797744.817:14034): avc: denied { search } for pid=6246 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1']

pass 7139441 2023-01-27 00:55:02 2023-01-27 05:23:17 2023-01-27 05:51:31 0:28:14 0:17:19 0:10:55 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7139442 2023-01-27 00:55:03 2023-01-27 05:23:37 2023-01-27 05:45:22 0:21:45 0:10:25 0:11:20 smithi main centos 8.stream rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi090.front.sepia.ceph.com: ['type=AVC msg=audit(1674797849.155:14038): avc: denied { lock } for pid=77415 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.824:214): avc: denied { lock } for pid=6373 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797849.155:14039): avc: denied { map } for pid=77415 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.794:213): avc: denied { read } for pid=6373 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.794:213): avc: denied { open } for pid=6373 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797604.824:215): avc: denied { map } for pid=6373 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797847.688:14034): avc: denied { search } for pid=6260 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674797849.155:14037): avc: denied { read } for pid=77415 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674797849.155:14037): avc: denied { open } for pid=77415 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139443 2023-01-27 00:55:04 2023-01-27 05:23:37 2023-01-27 06:00:27 0:36:50 0:20:05 0:16:45 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
fail 7139444 2023-01-27 00:55:05 2023-01-27 05:30:09 2023-01-27 06:13:24 0:43:15 0:32:32 0:10:43 smithi main rhel 8.4 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} 1
Failure Reason:

"2023-01-27T05:56:35.881621+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139445 2023-01-27 00:55:06 2023-01-27 05:34:09 2023-01-27 05:57:44 0:23:35 0:16:05 0:07:30 smithi main rhel 8.4 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} 3
Failure Reason:

"2023-01-27T05:51:29.611184+0000 mgr.x (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139446 2023-01-27 00:55:07 2023-01-27 05:34:40 2023-01-27 06:43:56 1:09:16 0:59:47 0:09:29 smithi main centos 8.stream rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

Command failed on smithi175 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

fail 7139447 2023-01-27 00:55:08 2023-01-27 05:35:00 2023-01-27 06:59:47 1:24:47 1:13:38 0:11:09 smithi main centos 8.stream rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-27T05:55:21.374003+0000 mgr.y (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139448 2023-01-27 00:55:09 2023-01-27 05:36:31 2023-01-27 06:13:36 0:37:05 0:31:34 0:05:31 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} 2
Failure Reason:

"2023-01-27T05:53:09.562455+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139449 2023-01-27 00:55:10 2023-01-27 05:36:31 2023-01-27 06:43:49 1:07:18 0:54:23 0:12:55 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
Failure Reason:

SELinux denials found on ubuntu@smithi101.front.sepia.ceph.com: ['type=AVC msg=audit(1674798745.427:15034): avc: denied { read } for pid=61368 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19741): avc: denied { read } for pid=89897 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19518): avc: denied { map } for pid=89014 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19516): avc: denied { open } for pid=89014 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19516): avc: denied { read } for pid=89014 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798745.427:15034): avc: denied { open } for pid=61368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.029:19707): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674798745.427:15036): avc: denied { map } for pid=61368 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:421): avc: denied { map } for pid=7015 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19741): avc: denied { open } for pid=89897 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:419): avc: denied { read } for pid=7015 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:419): avc: denied { open } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798479.442:420): avc: denied { lock } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801182.342:19515): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674798745.427:15035): avc: denied { lock } for pid=61368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19743): avc: denied { map } for pid=89897 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801185.710:19517): avc: denied { lock } for pid=89014 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801536.399:19742): avc: denied { lock } for pid=89897 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674798745.083:15013): avc: denied { search } for pid=6942 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1']

pass 7139450 2023-01-27 00:55:11 2023-01-27 05:42:22 2023-01-27 06:02:30 0:20:08 0:09:36 0:10:32 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7139451 2023-01-27 00:55:12 2023-01-27 05:42:22 2023-01-27 08:10:25 2:28:03 2:12:21 0:15:42 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
fail 7139452 2023-01-27 00:55:13 2023-01-27 05:45:23 2023-01-27 07:30:40 1:45:17 1:32:15 0:13:02 smithi main centos 8.stream rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{centos_8} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T06:08:18.931774+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139453 2023-01-27 00:55:14 2023-01-27 05:49:24 2023-01-27 06:21:56 0:32:32 0:25:47 0:06:45 smithi main rhel 8.4 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
Failure Reason:

SELinux denials found on ubuntu@smithi012.front.sepia.ceph.com: ['type=AVC msg=audit(1674799756.973:19490): avc: denied { read write } for pid=79660 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15022): avc: denied { lock } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19495): avc: denied { lock } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { open } for pid=79717 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { open } for pid=61332 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17308): avc: denied { lock } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19491): avc: denied { lock } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19492): avc: denied { getattr } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.464:15021): avc: denied { read } for pid=61332 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19496): avc: denied { map } for pid=79717 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19493): avc: denied { map } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799756.973:19490): avc: denied { open } for pid=79660 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.368:19494): avc: denied { read } for pid=79717 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.921:17309): avc: denied { map } for pid=69869 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { open } for pid=69869 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799757.644:19497): avc: denied { read } for pid=79660 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799223.556:17276): avc: denied { read } for pid=869 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.465:15023): avc: denied { map } for pid=61332 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799123.107:14990): avc: denied { search } for pid=6902 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799223.920:17307): avc: denied { read } for pid=69869 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139454 2023-01-27 00:55:15 2023-01-27 05:49:24 2023-01-27 06:10:46 0:21:22 0:13:01 0:08:21 smithi main rhel 8.4 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} 1
Failure Reason:

SELinux denials found on ubuntu@smithi156.front.sepia.ceph.com: ['type=AVC msg=audit(1674799376.292:17304): avc: denied { lock } for pid=69876 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.535:14996): avc: denied { search } for pid=6903 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799377.076:17380): avc: denied { read } for pid=70140 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17380): avc: denied { open } for pid=70140 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:415): avc: denied { lock } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15019): avc: denied { read } for pid=61350 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15019): avc: denied { open } for pid=61350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.291:17303): avc: denied { open } for pid=69876 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17381): avc: denied { lock } for pid=70140 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:416): avc: denied { map } for pid=6993 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:414): avc: denied { open } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.292:17305): avc: denied { map } for pid=69876 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799377.076:17382): avc: denied { map } for pid=70140 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799018.824:414): avc: denied { read } for pid=6993 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15020): avc: denied { lock } for pid=61350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799375.942:17272): avc: denied { read } for pid=892 comm="sssd" name="resolv.conf" dev="sda1" ino=394924 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799376.291:17303): avc: denied { read } for pid=69876 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799281.885:15021): avc: denied { map } for pid=61350 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139455 2023-01-27 00:55:16 2023-01-27 05:51:35 2023-01-27 07:02:41 1:11:06 1:01:09 0:09:57 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

"2023-01-27T06:26:56.355329+0000 mon.a (mon.0) 452 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139456 2023-01-27 00:55:17 2023-01-27 05:51:35 2023-01-27 06:10:33 0:18:58 0:12:58 0:06:00 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi099.front.sepia.ceph.com: ['type=AVC msg=audit(1674799269.564:15026): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.219:15001): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15025): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.940:19432): avc: denied { map } for pid=87059 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19431): avc: denied { lock } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799779.815:19618): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19668): avc: denied { lock } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { read } for pid=87059 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { read } for pid=6999 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799684.939:19430): avc: denied { open } for pid=87059 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799269.564:15024): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:420): avc: denied { lock } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:421): avc: denied { map } for pid=6999 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799004.822:419): avc: denied { open } for pid=6999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.185:19669): avc: denied { map } for pid=90420 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799681.565:19429): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { read } for pid=90420 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799780.184:19667): avc: denied { open } for pid=90420 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139457 2023-01-27 00:55:18 2023-01-27 05:51:35 2023-01-27 06:18:58 0:27:23 0:14:33 0:12:50 smithi main rhel 8.4 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_nbd} 3
Failure Reason:

SELinux denials found on ubuntu@smithi046.front.sepia.ceph.com: ['type=AVC msg=audit(1674799664.827:15006): avc: denied { map } for pid=61296 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15004): avc: denied { open } for pid=61296 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15005): avc: denied { lock } for pid=61296 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.458:14971): avc: denied { search } for pid=6925 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799763.670:17305): avc: denied { read } for pid=889 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17337): avc: denied { lock } for pid=70001 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799664.827:15004): avc: denied { read } for pid=61296 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17338): avc: denied { map } for pid=70001 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17336): avc: denied { read } for pid=70001 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799764.035:17336): avc: denied { open } for pid=70001 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139458 2023-01-27 00:55:19 2023-01-27 05:57:46 2023-01-27 06:19:04 0:21:18 0:10:49 0:10:29 smithi main centos 8.stream rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi107.front.sepia.ceph.com: ['type=AVC msg=audit(1674799829.800:14059): avc: denied { read } for pid=77509 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14060): avc: denied { lock } for pid=77509 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.665:213): avc: denied { open } for pid=6390 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17059): avc: denied { open } for pid=94350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799827.969:14036): avc: denied { search } for pid=6277 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674799951.535:16995): avc: denied { open } for pid=94044 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14039): avc: denied { read } for pid=77434 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14040): avc: denied { lock } for pid=77434 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17059): avc: denied { read } for pid=94350 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.665:213): avc: denied { read } for pid=6390 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16997): avc: denied { map } for pid=94044 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14059): avc: denied { open } for pid=77509 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.671:214): avc: denied { lock } for pid=6390 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.185:16964): avc: denied { read } for pid=752 comm="sssd" name="resolv.conf" dev="sda1" ino=525300 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17060): avc: denied { lock } for pid=94350 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.800:14061): avc: denied { map } for pid=77509 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799582.674:215): avc: denied { map } for pid=6390 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16996): avc: denied { lock } for pid=94044 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799952.310:17061): avc: denied { map } for pid=94350 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525268 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14041): avc: denied { map } for pid=77434 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799951.535:16995): avc: denied { read } for pid=94044 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674799829.041:14039): avc: denied { open } for pid=77434 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139459 2023-01-27 00:55:20 2023-01-27 05:57:46 2023-01-27 06:31:29 0:33:43 0:22:39 0:11:04 smithi main centos 8.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} 3
Failure Reason:

"2023-01-27T06:17:22.140980+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139460 2023-01-27 00:55:21 2023-01-27 05:58:27 2023-01-27 06:22:22 0:23:55 0:15:39 0:08:16 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} 2
Failure Reason:

"2023-01-27T06:16:05.008739+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139461 2023-01-27 00:55:22 2023-01-27 05:59:17 2023-01-27 09:38:39 3:39:22 3:30:09 0:09:13 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
Failure Reason:

Command failed (workunit test rbd/cli_generic.sh) on smithi050 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0c8245b45314ecfe0b7cf39532aecb29f18f697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'

fail 7139462 2023-01-27 00:55:23 2023-01-27 05:59:17 2023-01-27 07:29:47 1:30:30 1:23:21 0:07:09 smithi main rhel 8.4 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests} 3
Failure Reason:

"2023-01-27T06:17:14.684494+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139463 2023-01-27 00:55:24 2023-01-27 06:00:28 2023-01-27 07:51:27 1:50:59 1:40:56 0:10:03 smithi main rhel 8.4 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks2} 3
Failure Reason:

"2023-01-27T06:20:38.483627+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139464 2023-01-27 00:55:25 2023-01-27 06:04:29 2023-01-27 08:00:04 1:55:35 1:39:45 0:15:50 smithi main centos 8.stream rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features} 3
Failure Reason:

"2023-01-27T06:29:38.309223+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139465 2023-01-27 00:55:26 2023-01-27 06:10:40 2023-01-27 06:45:37 0:34:57 0:21:22 0:13:35 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
fail 7139466 2023-01-27 00:55:27 2023-01-27 06:13:31 2023-01-27 07:10:55 0:57:24 0:51:24 0:06:00 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
Failure Reason:

SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1674800612.349:15024): avc: denied { open } for pid=61351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15026): avc: denied { map } for pid=61351 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.345:17277): avc: denied { read } for pid=890 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17308): avc: denied { read } for pid=69878 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15025): avc: denied { lock } for pid=61351 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17310): avc: denied { map } for pid=69878 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800612.349:15024): avc: denied { read } for pid=61351 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800708.701:17308): avc: denied { open } for pid=69878 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800611.994:15003): avc: denied { search } for pid=6918 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674800708.701:17309): avc: denied { lock } for pid=69878 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139467 2023-01-27 00:55:28 2023-01-27 06:13:41 2023-01-27 06:35:57 0:22:16 0:10:41 0:11:35 smithi main rhel 8.4 rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-stupid openstack supported-random-distro$/{rhel_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi169.front.sepia.ceph.com: ['type=AVC msg=audit(1674800912.473:15022): avc: denied { open } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15024): avc: denied { map } for pid=61344 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:421): avc: denied { map } for pid=7002 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.123:14999): avc: denied { search } for pid=6912 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674800912.473:15022): avc: denied { read } for pid=61344 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { read } for pid=7002 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800912.473:15023): avc: denied { lock } for pid=61344 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.853:420): avc: denied { lock } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674800648.852:419): avc: denied { open } for pid=7002 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139468 2023-01-27 00:55:29 2023-01-27 06:19:02 2023-01-27 06:53:55 0:34:53 0:25:20 0:09:33 smithi main centos 8.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_generic} 1
Failure Reason:

"2023-01-27T06:43:41.118109+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139469 2023-01-27 00:55:30 2023-01-27 06:19:02 2023-01-27 06:48:05 0:29:03 0:16:24 0:12:39 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 7139470 2023-01-27 00:55:31 2023-01-27 06:22:03 2023-01-27 07:09:17 0:47:14 0:41:16 0:05:58 smithi main rhel 8.4 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/recovery} 2
Failure Reason:

"2023-01-27T06:38:19.106218+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139471 2023-01-27 00:55:32 2023-01-27 06:22:23 2023-01-27 06:51:10 0:28:47 0:18:53 0:09:54 smithi main rhel 8.4 rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} 4
Failure Reason:

"2023-01-27T06:43:26.730070+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139472 2023-01-27 00:55:33 2023-01-27 06:25:24 2023-01-27 07:59:35 1:34:11 1:24:43 0:09:28 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{rhel_8} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T06:44:58.268789+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139473 2023-01-27 00:55:34 2023-01-27 06:28:25 2023-01-27 07:01:31 0:33:06 0:19:17 0:13:49 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} 1
fail 7139474 2023-01-27 00:55:35 2023-01-27 06:31:35 2023-01-27 07:00:23 0:28:48 0:20:40 0:08:08 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/fsx} 1
Failure Reason:

SELinux denials found on ubuntu@smithi142.front.sepia.ceph.com: ['type=AVC msg=audit(1674801937.182:16995): avc: denied { read } for pid=94041 comm="rpm" name="Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.965:14064): avc: denied { lock } for pid=77528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801816.097:14036): avc: denied { search } for pid=6271 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525252 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674801573.393:215): avc: denied { map } for pid=6384 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16995): avc: denied { open } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801936.830:16964): avc: denied { read } for pid=720 comm="sssd" name="resolv.conf" dev="sda1" ino=395818 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.964:14063): avc: denied { read } for pid=77528 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16997): avc: denied { map } for pid=94041 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525266 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801937.182:16996): avc: denied { lock } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525265 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.964:14063): avc: denied { open } for pid=77528 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14041): avc: denied { map } for pid=77431 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.362:213): avc: denied { read } for pid=6384 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14039): avc: denied { open } for pid=77431 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14040): avc: denied { lock } for pid=77431 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.386:214): avc: denied { lock } for pid=6384 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.181:14039): avc: denied { read } for pid=77431 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801573.362:213): avc: denied { open } for pid=6384 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674801817.965:14065): avc: denied { map } for pid=77528 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7139475 2023-01-27 00:55:36 2023-01-27 06:31:36 2023-01-27 06:56:35 0:24:59 0:14:52 0:10:07 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} 2
Failure Reason:

"2023-01-27T06:51:56.186028+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139476 2023-01-27 00:55:37 2023-01-27 06:35:36 2023-01-27 07:16:03 0:40:27 0:29:53 0:10:34 smithi main centos 8.stream rbd/singleton/{all/qos objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

"2023-01-27T07:03:09.453712+0000 mon.a (mon.0) 94 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139477 2023-01-27 00:55:38 2023-01-27 06:35:37 2023-01-27 07:16:15 0:40:38 0:20:52 0:19:46 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
fail 7139478 2023-01-27 00:55:38 2023-01-27 06:43:58 2023-01-27 09:03:08 2:19:10 2:12:45 0:06:25 smithi main rhel 8.4 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} 3
Failure Reason:

"2023-01-27T07:00:29.908284+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139479 2023-01-27 00:55:39 2023-01-27 06:43:58 2023-01-27 07:18:57 0:34:59 0:24:26 0:10:33 smithi main centos 8.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-minimum} 2
Failure Reason:

SELinux denials found on ubuntu@smithi156.front.sepia.ceph.com: ['type=AVC msg=audit(1674802705.448:14059): avc: denied { map } for pid=77491 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14039): avc: denied { map } for pid=77416 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.733:215): avc: denied { map } for pid=6374 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.727:214): avc: denied { lock } for pid=6374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14037): avc: denied { open } for pid=77416 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16995): avc: denied { read } for pid=94032 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.057:16964): avc: denied { read } for pid=703 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16997): avc: denied { map } for pid=94032 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16995): avc: denied { open } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.701:213): avc: denied { read } for pid=6374 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802827.415:16996): avc: denied { lock } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802703.402:14034): avc: denied { search } for pid=6261 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674802705.448:14058): avc: denied { lock } for pid=77491 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802456.701:213): avc: denied { open } for pid=6374 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14038): avc: denied { lock } for pid=77416 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802705.448:14057): avc: denied { open } for pid=77491 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802704.686:14037): avc: denied { read } for pid=77416 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802705.448:14057): avc: denied { read } for pid=77491 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139480 2023-01-27 00:55:40 2023-01-27 06:45:39 2023-01-27 07:08:22 0:22:43 0:09:14 0:13:29 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} 1
fail 7139481 2023-01-27 00:55:41 2023-01-27 06:48:09 2023-01-27 07:27:09 0:39:00 0:30:42 0:08:18 smithi main rhel 8.4 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
Failure Reason:

"2023-01-27T07:07:16.582975+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139482 2023-01-27 00:55:42 2023-01-27 06:49:40 2023-01-27 07:52:24 1:02:44 0:55:55 0:06:49 smithi main rhel 8.4 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

SELinux denials found on ubuntu@smithi012.front.sepia.ceph.com: ['type=AVC msg=audit(1674805803.738:19790): avc: denied { read } for pid=81126 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805803.738:19791): avc: denied { lock } for pid=81126 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805803.738:19790): avc: denied { open } for pid=81126 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15013): avc: denied { read } for pid=61309 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15015): avc: denied { map } for pid=61309 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15013): avc: denied { open } for pid=61309 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802749.715:14982): avc: denied { search } for pid=6938 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674805803.738:19792): avc: denied { map } for pid=81126 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802750.069:15014): avc: denied { lock } for pid=61309 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674805802.002:19785): avc: denied { search } for pid=6938 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1']

fail 7139483 2023-01-27 00:55:43 2023-01-27 06:49:40 2023-01-27 10:24:36 3:34:56 3:27:22 0:07:34 smithi main rhel 8.4 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_xfstests_luks1} 3
Failure Reason:

"2023-01-27T07:08:21.523379+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139484 2023-01-27 00:55:44 2023-01-27 06:51:21 2023-01-27 07:11:59 0:20:38 0:09:01 0:11:37 smithi main ubuntu 20.04 rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
fail 7139485 2023-01-27 00:55:45 2023-01-27 06:51:21 2023-01-27 07:12:52 0:21:31 0:13:06 0:08:25 smithi main rhel 8.4 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} 1
Failure Reason:

SELinux denials found on ubuntu@smithi080.front.sepia.ceph.com: ['type=AVC msg=audit(1674803102.553:17339): avc: denied { map } for pid=69995 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.477:15002): avc: denied { search } for pid=6913 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1674803007.823:15023): avc: denied { read } for pid=61360 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:418): avc: denied { read } for pid=7003 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17337): avc: denied { open } for pid=69995 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:418): avc: denied { open } for pid=7003 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.195:17306): avc: denied { read } for pid=877 comm="sssd" name="resolv.conf" dev="sda1" ino=394967 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15025): avc: denied { map } for pid=61360 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15023): avc: denied { open } for pid=61360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17337): avc: denied { read } for pid=69995 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803007.823:15024): avc: denied { lock } for pid=61360 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674803102.553:17338): avc: denied { lock } for pid=69995 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:419): avc: denied { lock } for pid=7003 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1674802743.080:420): avc: denied { map } for pid=7003 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7139486 2023-01-27 00:55:46 2023-01-27 06:54:02 2023-01-27 07:19:18 0:25:16 0:10:36 0:14:40 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
fail 7139487 2023-01-27 00:55:47 2023-01-27 06:59:33 2023-01-27 07:22:25 0:22:52 0:17:26 0:05:26 smithi main rhel 8.4 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
Failure Reason:

"2023-01-27T07:15:49.837208+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139488 2023-01-27 00:55:48 2023-01-27 06:59:33 2023-01-27 08:51:15 1:51:42 1:43:53 0:07:49 smithi main rhel 8.4 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{rhel_8} 5-pool/ec-data-pool 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

"2023-01-27T07:16:49.039201+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139489 2023-01-27 00:55:49 2023-01-27 06:59:53 2023-01-27 07:31:11 0:31:18 0:22:20 0:08:58 smithi main centos 8.stream rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_api_tests_old_format} 1
Failure Reason:

"2023-01-27T07:25:23.620975+0000 mon.a (mon.0) 517 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139490 2023-01-27 00:55:50 2023-01-27 07:00:24 2023-01-27 07:44:44 0:44:20 0:32:48 0:11:32 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests} 1
Failure Reason:

"2023-01-27T07:28:19.909247+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139491 2023-01-27 00:55:51 2023-01-27 07:01:34 2023-01-27 08:11:45 1:10:11 0:59:58 0:10:13 smithi main rhel 8.4 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} 2
Failure Reason:

"2023-01-27T07:20:37.809194+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139492 2023-01-27 00:55:52 2023-01-27 07:04:45 2023-01-27 07:57:43 0:52:58 0:44:48 0:08:10 smithi main centos 8.stream rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{centos_8}} 1
Failure Reason:

"2023-01-27T07:29:36.773987+0000 mon.a (mon.0) 677 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log