teuthology-2020-11-14_17:03:37-upgrade:mimic-x-nautilus-distro-basic-smithi

5623335

FAIL

nautilus

nautilus

master

smithi

centos 7.8

smithi062 smithi083 smithi122 smithi139 smithi193

upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health}

failed to recover before timeout expired

5623342

FAIL

nautilus

nautilus

master

smithi

centos 7.8

smithi012 smithi023 smithi089 smithi197

upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/filestore-xfs supported-all-distro/centos_latest}

Command failed (workunit test rbd/test_librbd_python.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=mimic TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'

5623353

FAIL

nautilus

nautilus

master

smithi

rhel 7.8

smithi037 smithi067 smithi091 smithi179

upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/filestore-xfs supported-all-distro/rhel_7}

SELinux denials found on ubuntu@smithi067.front.sepia.ceph.com: ['type=AVC msg=audit(1605376201.489:8006): avc: denied { read } for pid=43983 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382502.827:9105): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384601.445:14070): avc: denied { read } for pid=140398 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605383102.833:10570): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605385802.819:15756): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378002.840:8092): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605383102.833:10571): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378001.617:8088): avc: denied { open } for pid=93033 comm="sadc" path="/proc/93033/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384602.840:14074): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384001.369:12610): avc: denied { read } for pid=129624 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381002.835:8382): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382801.301:9922): avc: denied { getattr } for pid=109276 comm="sadc" path="/proc/109276/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378601.645:8102): avc: denied { getattr } for pid=93551 comm="sadc" path="/proc/93551/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605377402.877:8079): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375602.858:7975): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378002.840:8093): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378001.617:8088): avc: denied { read } for pid=93033 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381002.835:8382): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382502.827:9105): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381001.191:8355): avc: denied { getattr } for pid=97081 comm="sadc" path="/proc/97081/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375601.455:7971): avc: denied { read } for pid=43314 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381001.191:8354): avc: denied { open } for pid=97081 comm="sadc" path="/proc/97081/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605383102.833:10570): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375602.858:7975): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384602.840:14074): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384001.369:12610): avc: denied { open } for pid=129624 comm="sadc" path="/proc/129624/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381002.835:8383): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605376201.489:8006): avc: denied { open } for pid=43983 comm="sadc" path="/proc/43983/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382801.300:9921): avc: denied { open } for pid=109276 comm="sadc" path="/proc/109276/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605385802.820:15757): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605376201.490:8007): avc: denied { getattr } for pid=43983 comm="sadc" path="/proc/43983/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384602.840:14075): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605377402.877:8079): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382502.827:9106): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378001.617:8089): avc: denied { getattr } for pid=93033 comm="sadc" path="/proc/93033/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605385802.819:15756): avc: denied { read } for pid=30648 comm="ntpd" name="if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378002.840:8092): avc: denied { open } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375602.858:7976): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384001.369:12611): avc: denied { getattr } for pid=129624 comm="sadc" path="/proc/129624/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375601.455:7971): avc: denied { open } for pid=43314 comm="sadc" path="/proc/43314/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378601.645:8101): avc: denied { open } for pid=93551 comm="sadc" path="/proc/93551/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605382801.300:9921): avc: denied { read } for pid=109276 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384601.445:14070): avc: denied { open } for pid=140398 comm="sadc" path="/proc/140398/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605384601.445:14071): avc: denied { getattr } for pid=140398 comm="sadc" path="/proc/140398/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605377402.877:8080): avc: denied { getattr } for pid=30648 comm="ntpd" path="/proc/30648/net/if_inet6" dev="proc" ino=4026532226 scontext=system_u:system_r:ntpd_t:s0 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605381001.191:8354): avc: denied { read } for pid=97081 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605378601.645:8101): avc: denied { read } for pid=93551 comm="sadc" name="dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1605375601.455:7972): avc: denied { getattr } for pid=43314 comm="sadc" path="/proc/43314/net/dev" dev="proc" ino=4026531982 scontext=system_u:system_r:sysstat_t:s0-s0:c0.c1023 tcontext=system_u:object_r:devtty_t:s0 tclass=file permissive=1']

5623355

FAIL

nautilus

nautilus

master

smithi

rhel 7.8

smithi047 smithi123 smithi145 smithi154 smithi170

upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/rhel_7 thrashosds-health}

Command failed (workunit test rbd/test_librbd_python.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=mimic TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'

5623374

FAIL

nautilus

nautilus

master

smithi

centos 7.8

smithi005 smithi008 smithi018 smithi180 smithi204

upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health}

failed to recover before timeout expired

5623385

FAIL

nautilus

nautilus

master

smithi

ubuntu 16.04

smithi029 smithi033 smithi079 smithi084 smithi141

upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 7-final-workload objectstore/bluestore-bitmap supported-all-distro/ubuntu_16.04 thrashosds-health}

"2020-11-14 18:31:39.964571 mon.c (mon.0) 345 : cluster [ERR] Health check failed: 3 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log

5623411

FAIL

nautilus

nautilus

master

smithi

ubuntu 18.04

smithi003 smithi039 smithi069 smithi089 smithi095

upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 7-final-workload objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health}

"2020-11-14 20:49:19.329953 mon.c (mon.0) 206 : cluster [ERR] Health check failed: 3 mgr modules have failed (MGR_MODULE_ERROR)" in cluster log