Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 3550276 2019-02-04 20:36:41 2019-02-05 01:34:17 2019-02-05 03:44:18 2:10:01 1:56:15 0:13:46 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml} 3
pass 3550277 2019-02-04 20:36:41 2019-02-05 01:35:36 2019-02-05 04:03:37 2:28:01 2:06:11 0:21:50 smithi master centos 7.4 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
fail 3550278 2019-02-04 20:36:42 2019-02-05 01:35:36 2019-02-05 02:45:36 1:10:00 0:50:00 0:20:00 smithi master centos 7.4 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 02:07:15.783230 osd.5 osd.5 172.21.15.79:6805/32785 84 : cluster [WRN] slow request 30.312434 seconds old, received at 2019-02-05 02:06:45.470729: osd_op(client.54285.0:1712 2.ds0 2:b20eb99e:::smithi02930302-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [copy-from ver 172] snapc 7b=[7b,70,6e,6c,6b,67,65,59,53,35] ondisk+write+known_if_redirected e154) currently waiting for peered" in cluster log

pass 3550279 2019-02-04 20:36:43 2019-02-05 01:35:38 2019-02-05 03:41:39 2:06:01 1:55:13 0:10:48 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550280 2019-02-04 20:36:44 2019-02-05 01:36:12 2019-02-05 03:42:13 2:06:01 1:51:33 0:14:28 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550281 2019-02-04 20:36:45 2019-02-05 01:37:24 2019-02-05 03:29:25 1:52:01 1:42:57 0:09:04 smithi master rhel 7.5 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
pass 3550282 2019-02-04 20:36:45 2019-02-05 01:37:29 2019-02-05 04:41:31 3:04:02 0:51:18 2:12:44 smithi master rhel 7.5 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
pass 3550283 2019-02-04 20:36:46 2019-02-05 01:37:42 2019-02-05 03:47:43 2:10:01 1:49:14 0:20:47 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550284 2019-02-04 20:36:47 2019-02-05 01:37:45 2019-02-05 03:51:47 2:14:02 1:57:24 0:16:38 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml} 3
pass 3550285 2019-02-04 20:36:48 2019-02-05 01:39:38 2019-02-05 03:55:39 2:16:01 2:00:31 0:15:30 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
fail 3550286 2019-02-04 20:36:49 2019-02-05 01:39:38 2019-02-05 02:35:38 0:56:00 0:43:01 0:12:59 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 02:13:47.972423 osd.6 osd.6 172.21.15.77:6810/12743 566 : cluster [WRN] slow request 30.847290 seconds old, received at 2019-02-05 02:13:17.125081: osd_op(client.64297.0:8356 2.3as0 2:5c2fb553:::smithi10612200-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [copy-from ver 1669] snapc 2ad=[2ad,2ac,2aa,2a8,2a7,29e,29d,292,290,289,27d] ondisk+write+known_if_redirected e817) currently started" in cluster log

pass 3550287 2019-02-04 20:36:50 2019-02-05 01:39:38 2019-02-05 03:45:39 2:06:01 1:55:34 0:10:27 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550288 2019-02-04 20:36:51 2019-02-05 01:39:40 2019-02-05 03:47:42 2:08:02 1:49:59 0:18:03 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550289 2019-02-04 20:36:51 2019-02-05 01:39:41 2019-02-05 03:27:42 1:48:01 1:34:38 0:13:23 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
pass 3550290 2019-02-04 20:36:52 2019-02-05 01:39:43 2019-02-05 02:47:43 1:08:00 0:41:54 0:26:06 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
pass 3550291 2019-02-04 20:36:53 2019-02-05 01:41:45 2019-02-05 03:47:46 2:06:01 1:52:18 0:13:43 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550292 2019-02-04 20:36:54 2019-02-05 01:41:45 2019-02-05 05:51:48 4:10:03 1:56:48 2:13:15 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml} 3
fail 3550293 2019-02-04 20:36:55 2019-02-05 01:42:05 2019-02-05 05:34:08 3:52:03 1:44:14 2:07:49 smithi master centos 7.4 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 04:53:19.255539 osd.4 osd.4 172.21.15.130:6804/267647 18 : cluster [WRN] slow request 30.098736 seconds old, received at 2019-02-05 04:52:49.156739: osd_op(client.53848.0:6891 34.32 34.838aff2 (undecoded) ondisk+retry+write+known_if_redirected e2105) currently queued_for_pg" in cluster log

fail 3550294 2019-02-04 20:36:56 2019-02-05 01:42:34 2019-02-05 03:44:35 2:02:01 0:48:16 1:13:45 smithi master centos 7.4 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 03:20:32.465037 osd.6 osd.6 172.21.15.79:6804/93006 390 : cluster [WRN] slow request 31.639912 seconds old, received at 2019-02-05 03:20:00.825088: osd_op(client.24309.0:7912 2.22s0 2.adc34d22 (undecoded) ondisk+write+known_if_redirected e766) currently waiting for peered" in cluster log

pass 3550295 2019-02-04 20:36:57 2019-02-05 01:43:15 2019-02-05 05:45:18 4:02:03 1:55:26 2:06:37 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550296 2019-02-04 20:36:57 2019-02-05 01:43:21 2019-02-05 04:41:22 2:58:01 1:51:15 1:06:46 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550297 2019-02-04 20:36:58 2019-02-05 01:43:31 2019-02-05 04:47:33 3:04:02 2:05:17 0:58:45 smithi master rhel 7.5 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
fail 3550298 2019-02-04 20:36:59 2019-02-05 01:43:36 2019-02-05 04:49:38 3:06:02 0:56:13 2:09:49 smithi master rhel 7.5 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 04:11:30.582692 osd.7 osd.7 172.21.15.143:6812/35889 241 : cluster [WRN] slow request 31.270766 seconds old, received at 2019-02-05 04:10:59.311891: osd_op(client.54305.0:3258 2.2as0 2:55a8988a:::smithi02233297-14:head [copy-from ver 308] snapc f8=[f8,f6,f5,f4,f3,f1,ee] ondisk+write+known_if_redirected e314) currently started" in cluster log

pass 3550299 2019-02-04 20:37:00 2019-02-05 10:20:41 2019-02-05 12:20:42 2:00:01 1:48:34 0:11:27 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550300 2019-02-04 20:37:01 2019-02-05 10:20:41 2019-02-05 12:30:42 2:10:01 1:55:11 0:14:50 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml} 3
fail 3550301 2019-02-04 20:37:02 2019-02-05 10:21:21 2019-02-05 12:09:22 1:48:01 1:37:19 0:10:42 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 10:46:25.800490 osd.4 osd.4 172.21.15.145:6804/18852 38 : cluster [WRN] slow request 31.828448 seconds old, received at 2019-02-05 10:45:53.971994: osd_op(client.56037.0:182 6.12 6.f04edf72 (undecoded) ondisk+retry+write+known_if_redirected e273) currently queued_for_pg" in cluster log

pass 3550302 2019-02-04 20:37:03 2019-02-05 10:22:30 2019-02-05 11:14:30 0:52:00 0:42:01 0:09:59 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
pass 3550303 2019-02-04 20:37:04 2019-02-05 10:22:30 2019-02-05 12:30:31 2:08:01 1:56:49 0:11:12 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550304 2019-02-04 20:37:04 2019-02-05 10:22:30 2019-02-05 12:24:31 2:02:01 1:48:29 0:13:32 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550305 2019-02-04 20:37:05 2019-02-05 10:22:31 2019-02-05 12:34:33 2:12:02 1:55:04 0:16:58 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
fail 3550306 2019-02-04 20:37:06 2019-02-05 10:22:39 2019-02-05 11:22:39 1:00:00 0:46:47 0:13:13 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 10:50:04.273959 osd.4 osd.4 172.21.15.3:6800/10916 279 : cluster [WRN] slow request 31.481241 seconds old, received at 2019-02-05 10:49:32.792676: osd_op(client.74275.0:3542 2.5s0 2.64eb18c5 (undecoded) ondisk+retry+write+peerstat_old+known_if_redirected e443) currently waiting for peered" in cluster log

pass 3550307 2019-02-04 20:37:07 2019-02-05 10:24:44 2019-02-05 12:28:45 2:04:01 1:51:02 0:12:59 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550308 2019-02-04 20:37:08 2019-02-05 10:24:44 2019-02-05 12:34:45 2:10:01 1:53:41 0:16:20 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml} 3
pass 3550309 2019-02-04 20:37:09 2019-02-05 10:24:44 2019-02-05 12:44:45 2:20:01 2:04:24 0:15:37 smithi master centos 7.4 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
fail 3550310 2019-02-04 20:37:10 2019-02-05 10:26:39 2019-02-05 11:52:40 1:26:01 0:49:27 0:36:34 smithi master centos 7.4 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 11:25:29.314268 osd.6 osd.6 172.21.15.68:6808/33064 531 : cluster [WRN] slow request 31.848931 seconds old, received at 2019-02-05 11:24:57.465288: osd_op(client.74294.0:7896 2.14s0 2:29dd5c29:::smithi16430102-24:head [copy-from ver 831] snapc 286=[286,285,284,27d,271,26f,26a,263,243] ondisk+write+known_if_redirected e741) currently started" in cluster log

pass 3550311 2019-02-04 20:37:11 2019-02-05 10:26:40 2019-02-05 12:50:41 2:24:01 1:55:34 0:28:27 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550312 2019-02-04 20:37:11 2019-02-05 10:28:32 2019-02-05 12:32:33 2:04:01 1:51:26 0:12:35 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550313 2019-02-04 20:37:12 2019-02-05 10:28:33 2019-02-05 12:26:33 1:58:00 1:44:16 0:13:44 smithi master rhel 7.5 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
fail 3550314 2019-02-04 20:37:13 2019-02-05 10:28:56 2019-02-05 11:26:56 0:58:00 0:49:37 0:08:23 smithi master rhel 7.5 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 11:01:52.558718 osd.7 osd.7 172.21.15.125:6809/35361 498 : cluster [WRN] slow request 32.173183 seconds old, received at 2019-02-05 11:01:20.385504: osd_op(client.44278.0:7053 2.5as1 2:5a18f454:::smithi14132863-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [copy-from ver 1012] snapc 257=[257,256,255,254,251,24f,24d,24b,248,247,244,243,23c,23b,239,238,22e,22b,229,226,219,20c,20a,205,202,200,1fe,1f2,1f1,1dd,1bf] ondisk+write+known_if_redirected e727) currently waiting for peered" in cluster log

pass 3550315 2019-02-04 20:37:14 2019-02-05 10:29:06 2019-02-05 12:33:08 2:04:02 1:49:31 0:14:31 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml} 3
fail 3550316 2019-02-04 20:37:15 2019-02-05 10:30:04 2019-02-05 11:18:04 0:48:00 0:15:10 0:32:50 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml} 3
Failure Reason:

Command failed on smithi089 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2'

pass 3550317 2019-02-04 20:37:16 2019-02-05 10:30:28 2019-02-05 12:50:29 2:20:01 1:58:46 0:21:15 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
fail 3550318 2019-02-04 20:37:17 2019-02-05 10:30:31 2019-02-05 11:48:32 1:18:01 0:47:05 0:30:56 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 11:11:29.352215 osd.7 osd.7 172.21.15.184:6800/12802 194 : cluster [WRN] slow request 30.640702 seconds old, received at 2019-02-05 11:10:58.711454: osd_op(client.54277.0:2805 2.2s0 2.a278ec02 (undecoded) ondisk+write+known_if_redirected e310) currently waiting for peered" in cluster log

pass 3550319 2019-02-04 20:37:18 2019-02-05 10:30:33 2019-02-05 12:40:34 2:10:01 1:56:44 0:13:17 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550320 2019-02-04 20:37:19 2019-02-05 10:31:17 2019-02-05 12:39:18 2:08:01 1:48:59 0:19:02 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550321 2019-02-04 20:37:20 2019-02-05 10:32:41 2019-02-05 12:34:42 2:02:01 1:32:56 0:29:05 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
pass 3550322 2019-02-04 20:37:20 2019-02-05 10:32:41 2019-02-05 11:46:42 1:14:01 0:44:24 0:29:37 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
pass 3550323 2019-02-04 20:37:21 2019-02-05 10:32:44 2019-02-05 12:40:45 2:08:01 1:51:30 0:16:31 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550324 2019-02-04 20:37:23 2019-02-05 10:36:41 2019-02-05 12:46:42 2:10:01 1:54:27 0:15:34 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/centos_latest.yaml} 3
pass 3550325 2019-02-04 20:37:24 2019-02-05 10:36:41 2019-02-05 12:40:43 2:04:02 1:43:52 0:20:10 smithi master centos 7.4 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
pass 3550326 2019-02-04 20:37:25 2019-02-05 10:38:50 2019-02-05 11:50:50 1:12:00 0:46:48 0:25:12 smithi master centos 7.4 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} 3
pass 3550327 2019-02-04 20:37:25 2019-02-05 10:38:50 2019-02-05 12:52:51 2:14:01 1:57:12 0:16:49 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550328 2019-02-04 20:37:26 2019-02-05 10:40:30 2019-02-05 12:54:31 2:14:01 1:53:30 0:20:31 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550329 2019-02-04 20:37:27 2019-02-05 10:40:30 2019-02-05 13:04:32 2:24:02 2:07:24 0:16:38 smithi master rhel 7.5 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
pass 3550330 2019-02-04 20:37:28 2019-02-05 10:40:33 2019-02-05 11:50:33 1:10:00 0:52:39 0:17:21 smithi master rhel 7.5 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml thrashosds-health.yaml} 3
pass 3550331 2019-02-04 20:37:29 2019-02-05 10:40:38 2019-02-05 12:54:39 2:14:01 1:52:26 0:21:35 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml} 3
pass 3550332 2019-02-04 20:37:30 2019-02-05 10:40:39 2019-02-05 12:58:40 2:18:01 1:54:33 0:23:28 smithi master centos 7.4 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml} 3
pass 3550333 2019-02-04 20:37:31 2019-02-05 10:40:55 2019-02-05 12:38:56 1:58:01 1:38:18 0:19:43 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
fail 3550334 2019-02-04 20:37:32 2019-02-05 10:44:29 2019-02-05 11:48:29 1:04:00 0:46:06 0:17:54 smithi master ubuntu 16.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 11:17:34.509409 osd.6 osd.6 172.21.15.101:6800/12791 237 : cluster [WRN] slow request 30.592437 seconds old, received at 2019-02-05 11:17:03.916912: osd_op(client.44288.0:4218 2.35s0 2.cd5af9b5 (undecoded) ondisk+write+known_if_redirected e458) currently waiting for peered" in cluster log

pass 3550335 2019-02-04 20:37:33 2019-02-05 10:46:51 2019-02-05 12:54:52 2:08:01 1:58:35 0:09:26 smithi master rhel 7.5 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/rhel_7.5.yaml} 3
pass 3550336 2019-02-04 20:37:34 2019-02-05 10:49:44 2019-02-05 12:51:45 2:02:01 1:50:25 0:11:36 smithi master ubuntu 16.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml} 3
pass 3550337 2019-02-04 20:37:35 2019-02-05 10:49:44 2019-02-05 14:33:47 3:44:03 1:57:12 1:46:51 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
fail 3550338 2019-02-04 20:37:36 2019-02-05 10:49:43 2019-02-05 11:49:44 1:00:01 0:45:47 0:14:14 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} 3
Failure Reason:

"2019-02-05 11:12:35.462355 osd.7 osd.7 172.21.15.102:6804/10937 152 : cluster [WRN] slow request 32.004456 seconds old, received at 2019-02-05 11:12:03.457838: osd_op(client.54299.0:1884 2.2s0 2:427b0d40:::smithi10010159-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head [read 0~1982464,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected e201) currently waiting for peered" in cluster log

pass 3550339 2019-02-04 20:37:36 2019-02-05 10:49:47 2019-02-05 13:21:49 2:32:02 1:50:15 0:41:47 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore.yaml supported-all-distro/ubuntu_latest.yaml} 3