Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 4607872 2019-12-16 07:09:21 2019-12-16 07:31:01 2019-12-16 08:11:00 0:39:59 0:17:48 0:22:11 smithi master rhel 7.7 upgrade/mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml} 4
Failure Reason:

"2019-12-16 08:04:04.972758 mon.a mon.0 172.21.15.37:6789/0 84 : cluster [WRN] Health check failed: too few PGs per OSD (2 < min 30) (TOO_FEW_PGS)" in cluster log

fail 4607873 2019-12-16 07:09:22 2019-12-16 07:32:57 2019-12-16 09:10:58 1:38:01 0:13:00 1:25:01 smithi master rhel 7.7 upgrade/nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml octopus.yaml supported-all-distro/rhel_7.yaml} 4
Failure Reason:

Command failed on smithi116 with status 1: 'sudo yum -y install cephadm'

pass 4607874 2019-12-16 07:09:23 2019-12-16 07:36:53 2019-12-16 08:18:53 0:42:00 0:23:50 0:18:10 smithi master upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-compat_client/mimic.yaml}} 3
pass 4607875 2019-12-16 07:09:24 2019-12-16 07:40:36 2019-12-16 10:12:39 2:32:03 1:35:46 0:56:17 smithi master centos 7.6 upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} thrashosds-health.yaml} 4
pass 4607876 2019-12-16 07:09:25 2019-12-16 07:40:53 2019-12-16 10:14:55 2:34:02 1:37:48 0:56:14 smithi master centos 7.6 upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} thrashosds-health.yaml} 4
fail 4607877 2019-12-16 07:09:26 2019-12-16 07:42:47 2019-12-16 08:14:46 0:31:59 0:18:26 0:13:33 smithi master rhel 7.7 upgrade/mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi184 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607878 2019-12-16 07:09:27 2019-12-16 07:42:48 2019-12-16 09:14:54 1:32:06 0:10:04 1:22:02 smithi master rhel 7.7 upgrade/nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi109 with status 1: 'sudo yum -y install cephadm'

fail 4607879 2019-12-16 07:09:28 2019-12-16 07:47:57 2019-12-16 16:26:07 8:38:10 0:19:49 8:18:21 smithi master rhel 7.7 upgrade/mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi158 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607880 2019-12-16 07:09:29 2019-12-16 07:48:36 2019-12-16 08:42:36 0:54:00 0:09:57 0:44:03 smithi master rhel 7.7 upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/bluestore-bitmap.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 7-final-workload.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi076 with status 1: 'sudo yum -y install cephadm'

pass 4607881 2019-12-16 07:09:30 2019-12-16 07:48:37 2019-12-16 08:20:36 0:31:59 0:16:49 0:15:10 smithi master upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} 3
fail 4607882 2019-12-16 07:09:32 2019-12-16 07:48:39 2019-12-16 08:28:39 0:40:00 0:11:40 0:28:20 smithi master ubuntu 18.04 upgrade/mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml} 4
Failure Reason:

"2019-12-16 08:20:44.684124 mon.a mon.0 172.21.15.37:6789/0 127 : cluster [WRN] Health check failed: too few PGs per OSD (2 < min 30) (TOO_FEW_PGS)" in cluster log

fail 4607883 2019-12-16 07:09:33 2019-12-16 07:50:56 2019-12-16 09:32:56 1:42:00 0:02:40 1:39:20 smithi master ubuntu 18.04 upgrade/nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml octopus.yaml supported-all-distro/ubuntu_latest.yaml} 4
Failure Reason:

Command failed on smithi176 with status 100: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.5-12-g4af73bf-1bionic cephadm=14.2.5-12-g4af73bf-1bionic ceph-mds=14.2.5-12-g4af73bf-1bionic ceph-mgr=14.2.5-12-g4af73bf-1bionic ceph-common=14.2.5-12-g4af73bf-1bionic ceph-fuse=14.2.5-12-g4af73bf-1bionic ceph-test=14.2.5-12-g4af73bf-1bionic radosgw=14.2.5-12-g4af73bf-1bionic python-ceph=14.2.5-12-g4af73bf-1bionic libcephfs2=14.2.5-12-g4af73bf-1bionic libcephfs-dev=14.2.5-12-g4af73bf-1bionic librados2=14.2.5-12-g4af73bf-1bionic librbd1=14.2.5-12-g4af73bf-1bionic rbd-fuse=14.2.5-12-g4af73bf-1bionic'

fail 4607884 2019-12-16 07:09:34 2019-12-16 07:50:56 2019-12-16 11:26:59 3:36:03 0:12:00 3:24:03 smithi master ubuntu 18.04 upgrade/mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi121 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607885 2019-12-16 07:09:35 2019-12-16 07:52:45 2019-12-16 08:42:44 0:49:59 0:02:59 0:47:00 smithi master ubuntu 18.04 upgrade/nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi193 with status 100: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.5-12-g4af73bf-1bionic cephadm=14.2.5-12-g4af73bf-1bionic ceph-mds=14.2.5-12-g4af73bf-1bionic ceph-mgr=14.2.5-12-g4af73bf-1bionic ceph-common=14.2.5-12-g4af73bf-1bionic ceph-fuse=14.2.5-12-g4af73bf-1bionic ceph-test=14.2.5-12-g4af73bf-1bionic radosgw=14.2.5-12-g4af73bf-1bionic python-ceph=14.2.5-12-g4af73bf-1bionic libcephfs2=14.2.5-12-g4af73bf-1bionic libcephfs-dev=14.2.5-12-g4af73bf-1bionic librados2=14.2.5-12-g4af73bf-1bionic librbd1=14.2.5-12-g4af73bf-1bionic rbd-fuse=14.2.5-12-g4af73bf-1bionic'

pass 4607886 2019-12-16 07:09:36 2019-12-16 07:54:37 2019-12-16 08:48:36 0:53:59 0:33:08 0:20:51 smithi master upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-compat_client/no.yaml}} 3
fail 4607887 2019-12-16 07:09:37 2019-12-16 07:54:37 2019-12-16 14:14:44 6:20:07 0:11:51 6:08:16 smithi master ubuntu 18.04 upgrade/mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi200 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607888 2019-12-16 07:09:38 2019-12-16 07:54:39 2019-12-16 08:52:38 0:57:59 0:03:09 0:54:50 smithi master ubuntu 18.04 upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 7-final-workload.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi190 with status 100: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.5-12-g4af73bf-1bionic cephadm=14.2.5-12-g4af73bf-1bionic ceph-mds=14.2.5-12-g4af73bf-1bionic ceph-mgr=14.2.5-12-g4af73bf-1bionic ceph-common=14.2.5-12-g4af73bf-1bionic ceph-fuse=14.2.5-12-g4af73bf-1bionic ceph-test=14.2.5-12-g4af73bf-1bionic radosgw=14.2.5-12-g4af73bf-1bionic python-ceph=14.2.5-12-g4af73bf-1bionic libcephfs2=14.2.5-12-g4af73bf-1bionic libcephfs-dev=14.2.5-12-g4af73bf-1bionic librados2=14.2.5-12-g4af73bf-1bionic librbd1=14.2.5-12-g4af73bf-1bionic rbd-fuse=14.2.5-12-g4af73bf-1bionic'

fail 4607889 2019-12-16 07:09:39 2019-12-16 07:55:30 2019-12-16 09:05:30 1:10:00 0:15:22 0:54:38 smithi master centos 7.6 upgrade/mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_7.yaml} 4
Failure Reason:

"2019-12-16 08:57:51.324966 mon.b mon.0 172.21.15.44:6789/0 78 : cluster [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)" in cluster log

fail 4607890 2019-12-16 07:09:40 2019-12-16 07:57:46 2019-12-16 09:23:49 1:26:03 0:07:29 1:18:34 smithi master centos 7.6 upgrade/nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml octopus.yaml supported-all-distro/centos_7.yaml} 4
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install cephadm'

pass 4607891 2019-12-16 07:09:41 2019-12-16 07:58:17 2019-12-16 08:50:17 0:52:00 0:22:54 0:29:06 smithi master upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-compat_client/mimic.yaml}} 3
fail 4607892 2019-12-16 07:09:42 2019-12-16 07:58:37 2019-12-16 10:58:40 3:00:03 0:16:09 2:43:54 smithi master centos 7.6 upgrade/mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi148 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607893 2019-12-16 07:09:43 2019-12-16 07:59:16 2019-12-16 09:43:18 1:44:02 0:07:42 1:36:20 smithi master centos 7.6 upgrade/nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install cephadm'

fail 4607894 2019-12-16 07:09:44 2019-12-16 07:59:16 2019-12-16 10:11:18 2:12:02 0:16:40 1:55:22 smithi master centos 7.6 upgrade/mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/centos_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi134 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607895 2019-12-16 07:09:45 2019-12-16 08:00:40 2019-12-16 10:32:42 2:32:02 0:07:46 2:24:16 smithi master centos 7.6 upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/bluestore-bitmap.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 7-final-workload.yaml supported-all-distro/centos_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi151 with status 1: 'sudo yum -y install cephadm'

pass 4607896 2019-12-16 07:09:47 2019-12-16 08:00:46 2019-12-16 08:24:45 0:23:59 0:16:58 0:07:01 smithi master upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} 3
fail 4607897 2019-12-16 07:09:48 2019-12-16 08:01:00 2019-12-16 08:28:59 0:27:59 0:17:37 0:10:22 smithi master rhel 7.7 upgrade/mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml} 4
Failure Reason:

"2019-12-16 08:20:11.035489 mon.c mon.0 172.21.15.84:6789/0 86 : cluster [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)" in cluster log

fail 4607898 2019-12-16 07:09:49 2019-12-16 08:02:33 2019-12-16 08:40:32 0:37:59 0:09:51 0:28:08 smithi master rhel 7.7 upgrade/nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml octopus.yaml supported-all-distro/rhel_7.yaml} 4
Failure Reason:

Command failed on smithi199 with status 1: 'sudo yum -y install cephadm'

fail 4607899 2019-12-16 07:09:50 2019-12-16 08:02:41 2019-12-16 11:06:44 3:04:03 0:19:22 2:44:41 smithi master rhel 7.7 upgrade/mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi060 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607900 2019-12-16 07:09:51 2019-12-16 08:04:47 2019-12-16 11:08:49 3:04:02 0:10:41 2:53:21 smithi master rhel 7.7 upgrade/nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi145 with status 1: 'sudo yum -y install cephadm'

pass 4607901 2019-12-16 07:09:52 2019-12-16 08:04:47 2019-12-16 08:50:46 0:45:59 0:33:08 0:12:51 smithi master upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-compat_client/no.yaml}} 3
fail 4607902 2019-12-16 07:09:53 2019-12-16 08:05:01 2019-12-16 12:31:05 4:26:04 0:18:42 4:07:22 smithi master rhel 7.7 upgrade/mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi190 with status 22: "sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog"

fail 4607903 2019-12-16 07:09:54 2019-12-16 08:07:21 2019-12-16 11:49:25 3:42:04 0:10:59 3:31:05 smithi master rhel 7.7 upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 7-final-workload.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} 5
Failure Reason:

Command failed on smithi070 with status 1: 'sudo yum -y install cephadm'