Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7138906 2023-01-26 03:05:51 2023-01-30 03:15:23 2023-01-30 04:05:50 0:50:27 0:33:17 0:17:10 smithi main rhel 8.4 rgw/cloud-transition/{cluster overrides supported-random-distro$/{rhel_8} tasks/cloud_transition_s3tests} 1
Failure Reason:

"2023-01-30T03:48:53.258680+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7138907 2023-01-26 03:05:52 2023-01-30 03:26:15 2023-01-30 04:09:17 0:43:02 0:30:44 0:12:18 smithi main ubuntu 20.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

'NoneType' object has no attribute 'makefile'

fail 7138908 2023-01-26 03:05:53 2023-01-30 03:26:15 2023-01-30 03:45:09 0:18:54 0:06:42 0:12:12 smithi main rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6b3a5180976335120a739cd84efb1ce5e73e19f9

fail 7138909 2023-01-26 03:05:55 2023-01-30 03:26:16 2023-01-30 04:06:11 0:39:55 0:28:28 0:11:27 smithi main centos 8.stream rgw/lifecycle/{cluster overrides supported-random-distro$/{centos_8} tasks/rgw_s3tests} 1
Failure Reason:

"2023-01-30T03:54:16.931404+0000 mon.a (mon.0) 170 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7138910 2023-01-26 03:05:56 2023-01-30 03:29:06 2023-01-30 03:49:17 0:20:11 0:10:38 0:09:33 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota ubuntu_latest} 2
fail 7138911 2023-01-26 03:05:57 2023-01-30 03:29:07 2023-01-30 05:29:19 2:00:12 1:45:18 0:14:54 smithi main centos 8.stream rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi} 2
Failure Reason:

rgw multisite test failures

fail 7138912 2023-01-26 03:05:58 2023-01-30 03:34:38 2023-01-30 04:16:13 0:41:35 0:32:15 0:09:20 smithi main centos 8.stream rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} 2
Failure Reason:

"2023-01-30T03:54:09.456032+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138913 2023-01-26 03:05:59 2023-01-30 03:34:58 2023-01-30 03:58:12 0:23:14 0:13:46 0:09:28 smithi main centos 8.stream rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} 2
Failure Reason:

SELinux denials found on ubuntu@smithi089.front.sepia.ceph.com: ['type=AVC msg=audit(1675050468.386:14036): avc: denied { open } for pid=77408 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050222.020:214): avc: denied { read } for pid=6372 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050222.030:215): avc: denied { lock } for pid=6372 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050222.035:216): avc: denied { map } for pid=6372 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050222.020:214): avc: denied { open } for pid=6372 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050468.387:14038): avc: denied { map } for pid=77408 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050468.387:14037): avc: denied { lock } for pid=77408 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050468.386:14036): avc: denied { read } for pid=77408 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675050467.994:14035): avc: denied { search } for pid=6259 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1']

fail 7138914 2023-01-26 03:06:00 2023-01-30 03:34:58 2023-01-30 04:12:55 0:37:57 0:31:16 0:06:41 smithi main rhel 8.4 rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{rhel_8} tasks/{0-install first ststests}} 2
Failure Reason:

"2023-01-30T03:52:31.939921+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138915 2023-01-26 03:06:01 2023-01-30 03:34:58 2023-01-30 04:11:55 0:36:57 0:20:38 0:16:19 smithi main ubuntu 20.04 rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} 1
Failure Reason:

Command failed on smithi029 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest'

pass 7138916 2023-01-26 03:06:03 2023-01-30 03:38:29 2023-01-30 04:05:11 0:26:42 0:13:51 0:12:51 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} 2
fail 7138917 2023-01-26 03:06:04 2023-01-30 03:41:20 2023-01-30 06:36:26 2:55:06 2:46:02 0:09:04 smithi main centos 8.stream rgw/tools/{centos_latest cluster tasks} 1
Failure Reason:

"2023-01-30T04:06:13.664054+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7138918 2023-01-26 03:06:05 2023-01-30 03:41:20 2023-01-30 04:25:01 0:43:41 0:33:00 0:10:41 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:01:44.668249+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138919 2023-01-26 03:06:06 2023-01-30 03:41:20 2023-01-30 04:12:51 0:31:31 0:17:52 0:13:39 smithi main ubuntu 20.04 rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} 2
fail 7138920 2023-01-26 03:06:07 2023-01-30 03:45:11 2023-01-30 04:56:39 1:11:28 0:58:24 0:13:04 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:08:11.139154+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138921 2023-01-26 03:06:08 2023-01-30 03:49:22 2023-01-30 04:14:57 0:25:35 0:09:11 0:16:24 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload ubuntu_latest} 2
fail 7138922 2023-01-26 03:06:09 2023-01-30 03:54:43 2023-01-30 04:35:58 0:41:15 0:31:07 0:10:08 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:13:36.164017+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138923 2023-01-26 03:06:10 2023-01-30 03:54:43 2023-01-30 05:05:18 1:10:35 0:58:16 0:12:19 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:16:16.957239+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138924 2023-01-26 03:06:11 2023-01-30 03:58:14 2023-01-30 04:23:10 0:24:56 0:08:57 0:15:59 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi179 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

fail 7138925 2023-01-26 03:06:13 2023-01-30 04:05:15 2023-01-30 04:50:01 0:44:46 0:32:58 0:11:48 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:25:47.114760+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138926 2023-01-26 03:06:14 2023-01-30 04:05:56 2023-01-30 04:33:19 0:27:23 0:13:42 0:13:41 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests ubuntu_latest} 2
fail 7138927 2023-01-26 03:06:15 2023-01-30 04:09:26 2023-01-30 05:16:55 1:07:29 0:55:20 0:12:09 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:30:56.057239+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138928 2023-01-26 03:06:16 2023-01-30 04:11:37 2023-01-30 04:37:15 0:25:38 0:13:12 0:12:26 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} 2
fail 7138929 2023-01-26 03:06:17 2023-01-30 04:11:57 2023-01-30 04:56:31 0:44:34 0:32:56 0:11:38 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:32:36.835408+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138930 2023-01-26 03:06:18 2023-01-30 04:12:58 2023-01-30 04:32:53 0:19:55 0:09:53 0:10:02 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota ubuntu_latest} 2
fail 7138931 2023-01-26 03:06:19 2023-01-30 04:12:58 2023-01-30 05:11:56 0:58:58 0:47:38 0:11:20 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:33:16.676819+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138932 2023-01-26 03:06:21 2023-01-30 04:14:48 2023-01-30 04:39:57 0:25:09 0:16:18 0:08:51 smithi main centos 8.stream rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: ['type=AVC msg=audit(1675052965.029:16990): avc: denied { open } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=395812 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052839.568:14034): avc: denied { search } for pid=6272 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=525252 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675052840.974:14039): avc: denied { map } for pid=77430 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052840.974:14038): avc: denied { lock } for pid=77430 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052591.717:215): avc: denied { map } for pid=6388 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052840.974:14037): avc: denied { read } for pid=77430 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052965.030:16992): avc: denied { map } for pid=94041 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=395813 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052591.700:213): avc: denied { open } for pid=6388 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052840.974:14037): avc: denied { open } for pid=77430 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052965.029:16990): avc: denied { read } for pid=94041 comm="rpm" name="Packages" dev="sda1" ino=395812 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052591.711:214): avc: denied { lock } for pid=6388 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052965.030:16991): avc: denied { lock } for pid=94041 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=395812 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052591.700:213): avc: denied { read } for pid=6388 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675052964.679:16959): avc: denied { read } for pid=703 comm="sssd" name="resolv.conf" dev="sda1" ino=395843 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1']

pass 7138933 2023-01-26 03:06:22 2023-01-30 04:14:49 2023-01-30 04:35:12 0:20:23 0:09:59 0:10:24 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota ubuntu_latest} 2
pass 7138934 2023-01-26 03:06:23 2023-01-30 04:14:59 2023-01-30 04:36:13 0:21:14 0:10:41 0:10:33 smithi main ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} 2
fail 7138935 2023-01-26 03:06:24 2023-01-30 04:16:19 2023-01-30 04:59:00 0:42:41 0:32:28 0:10:13 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:36:48.240928+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138936 2023-01-26 03:06:25 2023-01-30 04:17:50 2023-01-30 05:14:58 0:57:08 0:48:03 0:09:05 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:36:33.035639+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138937 2023-01-26 03:06:26 2023-01-30 04:17:50 2023-01-30 04:42:10 0:24:20 0:09:54 0:14:26 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest} 2
fail 7138938 2023-01-26 03:06:27 2023-01-30 04:22:11 2023-01-30 05:05:31 0:43:20 0:32:49 0:10:31 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:41:19.855609+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138939 2023-01-26 03:06:28 2023-01-30 04:22:12 2023-01-30 05:21:32 0:59:20 0:49:21 0:09:59 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:41:24.322360+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138940 2023-01-26 03:06:30 2023-01-30 04:22:12 2023-01-30 04:41:00 0:18:48 0:08:28 0:10:20 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi179 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 7138941 2023-01-26 03:06:31 2023-01-30 04:23:12 2023-01-30 04:56:18 0:33:06 0:22:23 0:10:43 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} 2
fail 7138942 2023-01-26 03:06:32 2023-01-30 04:24:13 2023-01-30 05:02:51 0:38:38 0:30:47 0:07:51 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:42:08.287095+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138943 2023-01-26 03:06:33 2023-01-30 04:24:13 2023-01-30 04:52:45 0:28:32 0:14:49 0:13:43 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest} 2
fail 7138944 2023-01-26 03:06:34 2023-01-30 04:25:04 2023-01-30 05:38:07 1:13:03 0:56:32 0:16:31 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:58:08.463212+0000 mon.a (mon.0) 466 : cluster [WRN] Health check failed: 2 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7138945 2023-01-26 03:06:35 2023-01-30 04:32:55 2023-01-30 05:12:44 0:39:49 0:30:14 0:09:35 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:52:11.705156+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138946 2023-01-26 03:06:36 2023-01-30 04:33:25 2023-01-30 04:55:38 0:22:13 0:09:05 0:13:08 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest} 2
fail 7138947 2023-01-26 03:06:37 2023-01-30 04:35:16 2023-01-30 05:43:15 1:07:59 0:58:20 0:09:39 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T04:55:11.702232+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138948 2023-01-26 03:06:38 2023-01-30 04:36:06 2023-01-30 05:00:12 0:24:06 0:13:15 0:10:51 smithi main ubuntu 20.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} 1
pass 7138949 2023-01-26 03:06:40 2023-01-30 04:36:16 2023-01-30 05:00:46 0:24:30 0:11:51 0:12:39 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} 2
fail 7138950 2023-01-26 03:06:41 2023-01-30 04:37:17 2023-01-30 05:03:20 0:26:03 0:14:04 0:11:59 smithi main centos 8.stream rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} 2
Failure Reason:

SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: ['type=AVC msg=audit(1675054504.428:17058): avc: denied { map } for pid=94339 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054128.415:215): avc: denied { map } for pid=6368 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054128.398:213): avc: denied { read } for pid=6368 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054128.409:214): avc: denied { lock } for pid=6368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054379.616:14039): avc: denied { open } for pid=77412 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054504.428:17057): avc: denied { lock } for pid=94339 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054378.262:14036): avc: denied { search } for pid=6255 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393230 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675054379.616:14040): avc: denied { lock } for pid=77412 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054503.631:16993): avc: denied { lock } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054504.428:17056): avc: denied { read } for pid=94339 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054128.398:213): avc: denied { open } for pid=6368 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054503.631:16992): avc: denied { read } for pid=94032 comm="rpm" name="Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054503.631:16992): avc: denied { open } for pid=94032 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054379.616:14039): avc: denied { read } for pid=77412 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054503.278:16961): avc: denied { read } for pid=743 comm="sssd" name="resolv.conf" dev="sda1" ino=525302 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054503.631:16994): avc: denied { map } for pid=94032 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525270 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054504.428:17056): avc: denied { open } for pid=94339 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525269 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675054379.616:14041): avc: denied { map } for pid=77412 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7138951 2023-01-26 03:06:42 2023-01-30 04:40:07 2023-01-30 05:19:50 0:39:43 0:29:21 0:10:22 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T04:59:11.438432+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138952 2023-01-26 03:06:43 2023-01-30 04:41:08 2023-01-30 05:49:35 1:08:27 0:58:20 0:10:07 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:01:21.590692+0000 mgr.x (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138953 2023-01-26 03:06:44 2023-01-30 04:42:18 2023-01-30 05:02:10 0:19:52 0:09:25 0:10:27 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} 2
pass 7138954 2023-01-26 03:06:45 2023-01-30 04:42:19 2023-01-30 05:04:18 0:21:59 0:12:33 0:09:26 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} 2
fail 7138955 2023-01-26 03:06:46 2023-01-30 04:42:19 2023-01-30 05:30:31 0:48:12 0:31:41 0:16:31 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:08:19.249070+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138956 2023-01-26 03:06:48 2023-01-30 04:49:10 2023-01-30 05:50:27 1:01:17 0:50:32 0:10:45 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:08:43.186378+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138957 2023-01-26 03:06:49 2023-01-30 04:49:10 2023-01-30 05:10:40 0:21:30 0:09:00 0:12:30 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi023 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

fail 7138958 2023-01-26 03:06:50 2023-01-30 04:50:11 2023-01-30 05:34:50 0:44:39 0:31:37 0:13:02 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:12:50.228606+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138959 2023-01-26 03:06:51 2023-01-30 04:52:51 2023-01-30 05:19:53 0:27:02 0:13:44 0:13:18 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests ubuntu_latest} 2
fail 7138960 2023-01-26 03:06:52 2023-01-30 04:55:42 2023-01-30 05:57:30 1:01:48 0:51:28 0:10:20 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:15:25.815871+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138961 2023-01-26 03:06:53 2023-01-30 04:56:22 2023-01-30 05:38:20 0:41:58 0:31:18 0:10:40 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:16:17.953015+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138962 2023-01-26 03:06:54 2023-01-30 04:56:33 2023-01-30 05:16:44 0:20:11 0:09:33 0:10:38 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota ubuntu_latest} 2
fail 7138963 2023-01-26 03:06:55 2023-01-30 04:56:43 2023-01-30 05:56:00 0:59:17 0:48:07 0:11:10 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:17:53.014157+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138964 2023-01-26 03:06:56 2023-01-30 04:58:44 2023-01-30 05:22:22 0:23:38 0:16:36 0:07:02 smithi main rhel 8.4 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi088.front.sepia.ceph.com: ['type=AVC msg=audit(1675055073.016:420): avc: denied { lock } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055338.856:15023): avc: denied { lock } for pid=61334 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055338.856:15024): avc: denied { map } for pid=61334 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055437.317:17382): avc: denied { lock } for pid=70101 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055436.540:17308): avc: denied { read } for pid=69861 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055073.016:419): avc: denied { open } for pid=6993 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055073.016:419): avc: denied { read } for pid=6993 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055073.016:421): avc: denied { map } for pid=6993 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055436.183:17277): avc: denied { read } for pid=891 comm="sssd" name="resolv.conf" dev="sda1" ino=394966 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055437.317:17381): avc: denied { read } for pid=70101 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055436.540:17308): avc: denied { open } for pid=69861 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055338.856:15022): avc: denied { read } for pid=61334 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055338.856:15022): avc: denied { open } for pid=61334 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055338.508:15001): avc: denied { search } for pid=6903 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675055437.317:17383): avc: denied { map } for pid=70101 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055437.317:17381): avc: denied { open } for pid=70101 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055436.540:17309): avc: denied { lock } for pid=69861 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055436.540:17310): avc: denied { map } for pid=69861 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7138965 2023-01-26 03:06:57 2023-01-30 04:58:44 2023-01-30 05:17:48 0:19:04 0:07:00 0:12:04 smithi main rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6b3a5180976335120a739cd84efb1ce5e73e19f9

pass 7138966 2023-01-26 03:06:59 2023-01-30 04:58:44 2023-01-30 05:19:01 0:20:17 0:10:20 0:09:57 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota ubuntu_latest} 2
fail 7138967 2023-01-26 03:07:00 2023-01-30 04:59:04 2023-01-30 06:36:12 1:37:08 1:25:58 0:11:10 smithi main centos 8.stream rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8} tasks/test_multi} 2
Failure Reason:

rgw multisite test failures

fail 7138968 2023-01-26 03:07:01 2023-01-30 05:00:55 2023-01-30 05:22:18 0:21:23 0:14:30 0:06:53 smithi main rhel 8.4 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} 2
Failure Reason:

SELinux denials found on ubuntu@smithi123.front.sepia.ceph.com: ['type=AVC msg=audit(1675055523.754:16119): avc: denied { map } for pid=65369 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055460.314:15027): avc: denied { lock } for pid=61341 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.397:16012): avc: denied { lock } for pid=64940 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.755:16015): avc: denied { read } for pid=64999 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055520.031:16018): avc: denied { read } for pid=64940 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.755:16015): avc: denied { open } for pid=64999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.755:16016): avc: denied { lock } for pid=64999 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055520.031:16018): avc: denied { open } for pid=64940 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.397:16011): avc: denied { open } for pid=64940 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055523.754:16118): avc: denied { lock } for pid=65369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055460.314:15028): avc: denied { map } for pid=61341 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055460.314:15026): avc: denied { open } for pid=61341 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055460.314:15026): avc: denied { read } for pid=61341 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.397:16014): avc: denied { map } for pid=64940 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055459.961:14997): avc: denied { search } for pid=6909 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675055519.755:16017): avc: denied { map } for pid=64999 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394931 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.397:16011): avc: denied { read write } for pid=64940 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394949 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055523.754:16117): avc: denied { read } for pid=65369 comm="rpm" name="Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055519.397:16013): avc: denied { getattr } for pid=64940 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394950 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675055523.754:16117): avc: denied { open } for pid=65369 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394930 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7138969 2023-01-26 03:07:02 2023-01-30 05:01:05 2023-01-30 05:25:19 0:24:14 0:13:08 0:11:06 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} 2
fail 7138970 2023-01-26 03:07:03 2023-01-30 05:01:05 2023-01-30 05:41:58 0:40:53 0:32:20 0:08:33 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:19:36.761666+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138971 2023-01-26 03:07:04 2023-01-30 05:01:06 2023-01-30 06:07:24 1:06:18 0:56:25 0:09:53 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:20:46.298870+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138972 2023-01-26 03:07:05 2023-01-30 05:02:16 2023-01-30 05:22:05 0:19:49 0:10:02 0:09:47 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload ubuntu_latest} 2
fail 7138973 2023-01-26 03:07:07 2023-01-30 05:02:57 2023-01-30 05:44:33 0:41:36 0:32:18 0:09:18 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:22:33.909955+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138974 2023-01-26 03:07:08 2023-01-30 05:03:27 2023-01-30 06:11:16 1:07:49 0:58:10 0:09:39 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:29:45.873624+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 2 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7138975 2023-01-26 03:07:09 2023-01-30 05:04:27 2023-01-30 05:23:24 0:18:57 0:08:28 0:10:29 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi089 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

fail 7138976 2023-01-26 03:07:10 2023-01-30 05:05:28 2023-01-30 05:46:47 0:41:19 0:32:42 0:08:37 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:24:21.518677+0000 mgr.x (mgr.4123) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138977 2023-01-26 03:07:11 2023-01-30 05:05:38 2023-01-30 05:37:19 0:31:41 0:15:08 0:16:33 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests ubuntu_latest} 2
fail 7138978 2023-01-26 03:07:12 2023-01-30 05:10:49 2023-01-30 06:16:59 1:06:10 0:55:39 0:10:31 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:30:09.939551+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138979 2023-01-26 03:07:13 2023-01-30 05:12:00 2023-01-30 05:36:35 0:24:35 0:13:20 0:11:15 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} 2
fail 7138980 2023-01-26 03:07:15 2023-01-30 05:12:50 2023-01-30 05:57:48 0:44:58 0:32:56 0:12:02 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:33:47.012614+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138981 2023-01-26 03:07:16 2023-01-30 05:15:01 2023-01-30 05:37:08 0:22:07 0:09:10 0:12:57 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota ubuntu_latest} 2
fail 7138982 2023-01-26 03:07:17 2023-01-30 05:16:51 2023-01-30 06:14:29 0:57:38 0:48:06 0:09:32 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:35:44.427667+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138983 2023-01-26 03:07:18 2023-01-30 05:17:01 2023-01-30 05:46:19 0:29:18 0:16:18 0:13:00 smithi main centos 8.stream rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} 1
Failure Reason:

SELinux denials found on ubuntu@smithi066.front.sepia.ceph.com: ['type=AVC msg=audit(1675056733.868:14037): avc: denied { search } for pid=4608 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=393279 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675056477.509:212): avc: denied { lock } for pid=5593 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056477.501:211): avc: denied { read } for pid=5593 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056477.501:211): avc: denied { open } for pid=5593 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056862.969:16993): avc: denied { open } for pid=94019 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056735.099:14041): avc: denied { lock } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056862.969:16994): avc: denied { lock } for pid=94019 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056735.099:14040): avc: denied { read } for pid=77407 comm="rpm" name="Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056735.099:14042): avc: denied { map } for pid=77407 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056862.969:16995): avc: denied { map } for pid=94019 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=525262 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056862.602:16962): avc: denied { read } for pid=732 comm="sssd" name="resolv.conf" dev="sda1" ino=525289 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056477.514:213): avc: denied { map } for pid=5593 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=98535 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056862.969:16993): avc: denied { read } for pid=94019 comm="rpm" name="Packages" dev="sda1" ino=525261 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056735.099:14040): avc: denied { open } for pid=77407 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=98534 scontext=system_u:system_r:setroubleshootd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

pass 7138984 2023-01-26 03:07:19 2023-01-30 05:17:52 2023-01-30 05:40:57 0:23:05 0:10:46 0:12:19 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota ubuntu_latest} 2
fail 7138985 2023-01-26 03:07:20 2023-01-30 05:19:02 2023-01-30 05:40:43 0:21:41 0:14:42 0:06:59 smithi main rhel 8.4 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} 2
Failure Reason:

SELinux denials found on ubuntu@smithi179.front.sepia.ceph.com: ['type=AVC msg=audit(1675057037.735:19094): avc: denied { read write } for pid=81039 comm="rhsmcertd-worke" name=".dbenv.lock" dev="sda1" ino=394957 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056658.593:17277): avc: denied { read } for pid=888 comm="sssd" name="resolv.conf" dev="sda1" ino=394932 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057038.110:19098): avc: denied { open } for pid=81096 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057038.110:19099): avc: denied { lock } for pid=81096 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056562.025:15001): avc: denied { search } for pid=6925 comm=72733A6D61696E20513A526567 name="cephtest" dev="sda1" ino=262168 scontext=system_u:system_r:syslogd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=dir permissive=1', 'type=AVC msg=audit(1675057038.110:19100): avc: denied { map } for pid=81096 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394939 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056659.718:17381): avc: denied { read } for pid=70131 comm="rpm" name="Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057037.735:19097): avc: denied { map } for pid=81039 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394958 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056295.921:420): avc: denied { lock } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056659.718:17382): avc: denied { lock } for pid=70131 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056658.939:17308): avc: denied { read } for pid=69887 comm="rpm" name="Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056562.371:15022): avc: denied { read } for pid=61356 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057038.467:19101): avc: denied { open } for pid=81039 comm="rhsmcertd-worke" path="/etc/dnf/modules.d/python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056562.372:15023): avc: denied { lock } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056658.939:17310): avc: denied { map } for pid=69887 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394939 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056658.939:17308): avc: denied { open } for pid=69887 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056295.921:421): avc: denied { map } for pid=7015 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056295.921:419): avc: denied { open } for pid=7015 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056562.372:15024): avc: denied { map } for pid=61356 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=73849 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057037.735:19095): avc: denied { lock } for pid=81039 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394957 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056658.939:17309): avc: denied { lock } for pid=69887 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057037.735:19094): avc: denied { open } for pid=81039 comm="rhsmcertd-worke" path="/var/lib/rpm/.dbenv.lock" dev="sda1" ino=394957 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056659.718:17381): avc: denied { open } for pid=70131 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057037.735:19096): avc: denied { getattr } for pid=81039 comm="rhsmcertd-worke" path="/var/lib/rpm/__db.001" dev="sda1" ino=394958 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056659.718:17383): avc: denied { map } for pid=70131 comm="rpm" path="/var/lib/rpm/Name" dev="sda1" ino=394939 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056295.921:419): avc: denied { read } for pid=7015 comm="rpm" name="Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057038.467:19101): avc: denied { read } for pid=81039 comm="rhsmcertd-worke" name="python36.module" dev="sda1" ino=76230 scontext=system_u:system_r:rhsmcertd_t:s0 tcontext=system_u:object_r:root_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675056562.371:15022): avc: denied { open } for pid=61356 comm="rpm" path="/var/lib/rpm/Packages" dev="sda1" ino=73848 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1675057038.110:19098): avc: denied { read } for pid=81096 comm="rpm" name="Packages" dev="sda1" ino=394938 scontext=system_u:system_r:setroubleshootd_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:var_lib_t:s0 tclass=file permissive=1']

fail 7138986 2023-01-26 03:07:21 2023-01-30 05:19:53 2023-01-30 06:03:33 0:43:40 0:32:50 0:10:50 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:39:20.639268+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138987 2023-01-26 03:07:22 2023-01-30 05:20:03 2023-01-30 06:20:48 1:00:45 0:49:30 0:11:15 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:40:19.655430+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138988 2023-01-26 03:07:23 2023-01-30 05:21:43 2023-01-30 05:41:54 0:20:11 0:09:16 0:10:55 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest} 2
fail 7138989 2023-01-26 03:07:25 2023-01-30 05:22:14 2023-01-30 06:05:56 0:43:42 0:33:41 0:10:01 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:41:52.144359+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138990 2023-01-26 03:07:26 2023-01-30 05:22:24 2023-01-30 06:19:16 0:56:52 0:47:18 0:09:34 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:40:37.833385+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138991 2023-01-26 03:07:27 2023-01-30 05:22:24 2023-01-30 05:43:18 0:20:54 0:08:49 0:12:05 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi178 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

pass 7138992 2023-01-26 03:07:28 2023-01-30 05:22:55 2023-01-30 05:50:46 0:27:51 0:17:05 0:10:46 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} 2
fail 7138993 2023-01-26 03:07:29 2023-01-30 05:22:55 2023-01-30 06:04:32 0:41:37 0:30:41 0:10:56 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:41:41.026601+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138994 2023-01-26 03:07:30 2023-01-30 05:23:25 2023-01-30 05:49:44 0:26:19 0:13:09 0:13:10 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest} 2
fail 7138995 2023-01-26 03:07:31 2023-01-30 05:25:26 2023-01-30 06:36:02 1:10:36 0:57:19 0:13:17 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:48:13.985277+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7138996 2023-01-26 03:07:33 2023-01-30 05:29:27 2023-01-30 06:09:55 0:40:28 0:29:38 0:10:50 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:49:19.411103+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138997 2023-01-26 03:07:34 2023-01-30 05:30:37 2023-01-30 05:54:06 0:23:29 0:09:29 0:14:00 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest} 2
fail 7138998 2023-01-26 03:07:35 2023-01-30 05:34:08 2023-01-30 06:39:11 1:05:03 0:56:16 0:08:47 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:52:34.475513+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7138999 2023-01-26 03:07:36 2023-01-30 05:34:08 2023-01-30 05:57:21 0:23:13 0:13:24 0:09:49 smithi main ubuntu 20.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} 1
pass 7139000 2023-01-26 03:07:37 2023-01-30 05:34:08 2023-01-30 05:56:31 0:22:23 0:10:16 0:12:07 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} 2
pass 7139001 2023-01-26 03:07:38 2023-01-30 05:34:59 2023-01-30 05:58:44 0:23:45 0:10:51 0:12:54 smithi main ubuntu 20.04 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} 2
fail 7139002 2023-01-26 03:07:39 2023-01-30 05:36:39 2023-01-30 06:18:24 0:41:45 0:32:04 0:09:41 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T06:03:06.118233+0000 mon.a (mon.0) 478 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

fail 7139003 2023-01-26 03:07:40 2023-01-30 05:37:10 2023-01-30 06:47:11 1:10:01 0:59:16 0:10:45 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:57:32.807119+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139004 2023-01-26 03:07:41 2023-01-30 05:37:20 2023-01-30 05:58:01 0:20:41 0:09:48 0:10:53 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} 2
pass 7139005 2023-01-26 03:07:43 2023-01-30 05:38:10 2023-01-30 06:03:00 0:24:50 0:13:13 0:11:37 smithi main ubuntu 20.04 rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} 2
fail 7139006 2023-01-26 03:07:44 2023-01-30 05:38:21 2023-01-30 06:23:39 0:45:18 0:33:55 0:11:23 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T05:58:41.905164+0000 mgr.x (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139007 2023-01-26 03:07:45 2023-01-30 05:40:51 2023-01-30 06:40:09 0:59:18 0:49:51 0:09:27 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T05:59:28.076868+0000 mgr.y (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139008 2023-01-26 03:07:46 2023-01-30 05:41:02 2023-01-30 05:59:54 0:18:52 0:08:23 0:10:29 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed ubuntu_latest} 2
Failure Reason:

Command failed on smithi037 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap'

fail 7139009 2023-01-26 03:07:47 2023-01-30 05:42:02 2023-01-30 06:26:23 0:44:21 0:33:12 0:11:09 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T06:08:45.398021+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH)" in cluster log

pass 7139010 2023-01-26 03:07:48 2023-01-30 05:42:02 2023-01-30 06:07:38 0:25:36 0:14:47 0:10:49 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests ubuntu_latest} 2
fail 7139011 2023-01-26 03:07:49 2023-01-30 05:43:23 2023-01-30 06:42:31 0:59:08 0:49:22 0:09:46 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T06:02:17.951626+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

fail 7139012 2023-01-26 03:07:50 2023-01-30 05:43:23 2023-01-30 06:25:50 0:42:27 0:31:43 0:10:44 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} 2
Failure Reason:

"2023-01-30T06:03:26.853739+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log

pass 7139013 2023-01-26 03:07:51 2023-01-30 05:44:44 2023-01-30 06:07:01 0:22:17 0:09:11 0:13:06 smithi main ubuntu 20.04 rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota ubuntu_latest} 2
fail 7139014 2023-01-26 03:07:53 2023-01-30 05:46:54 2023-01-30 06:47:01 1:00:07 0:48:25 0:11:42 smithi main centos 8.stream rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

"2023-01-30T06:08:45.879207+0000 mgr.y (mgr.4122) 1 : cluster [ERR] Failed to load ceph-mgr modules: prometheus" in cluster log