User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|
teuthology | 2017-08-04 02:25:04 | 2017-08-04 08:36:56 | 2017-08-04 21:12:36 | 12:35:40 | upgrade:kraken-x | master | vps | d89af4a | 23 | 1 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 1480653 | 2017-08-04 02:25:29 | 2017-08-04 08:10:31 | 2017-08-04 14:12:38 | 6:02:07 | 1:52:42 | 4:09:25 | vps | master | centos | 7.3 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
fail | 1480654 | 2017-08-04 02:25:29 | 2017-08-04 08:10:31 | 2017-08-04 11:00:34 | 2:50:03 | 1:36:15 | 1:13:48 | vps | master | centos | 7.3 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after osd.0 restart |
||||||||||||||
fail | 1480655 | 2017-08-04 02:25:30 | 2017-08-04 08:10:41 | 2017-08-04 10:54:44 | 2:44:03 | 1:18:03 | 1:26:00 | vps | master | centos | 7.3 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/centos_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-08-04 09:51:05.844734 mon.a mon.0 172.21.2.31:6789/0 41 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1480656 | 2017-08-04 02:25:30 | 2017-08-04 08:13:55 | 2017-08-04 13:24:00 | 5:10:05 | 2:19:25 | 2:50:40 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480657 | 2017-08-04 02:25:31 | 2017-08-04 08:15:39 | 2017-08-04 08:35:39 | 0:20:00 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |||
Failure Reason:
Could not reconnect to ubuntu@vpm093.front.sepia.ceph.com |
||||||||||||||
fail | 1480658 | 2017-08-04 02:25:32 | 2017-08-04 08:21:55 | 2017-08-04 11:45:58 | 3:24:03 | 2:09:41 | 1:14:22 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480659 | 2017-08-04 02:25:32 | 2017-08-04 08:36:56 | 2017-08-04 10:18:57 | 1:42:01 | 1:02:20 | 0:39:41 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-08-04 09:26:42.127862 mon.a mon.0 172.21.2.127:6789/0 69 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1480660 | 2017-08-04 02:25:33 | 2017-08-04 09:08:59 | 2017-08-04 09:40:58 | 0:31:59 | 0:17:40 | 0:14:19 | vps | master | centos | 7.3 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
Command failed on vpm073 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' |
||||||||||||||
dead | 1480661 | 2017-08-04 02:25:34 | 2017-08-04 09:10:14 | 2017-08-04 21:12:36 | 12:02:22 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |||
fail | 1480662 | 2017-08-04 02:25:34 | 2017-08-04 09:10:14 | 2017-08-04 11:28:16 | 2:18:02 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |||
Failure Reason:
Could not reconnect to ubuntu@vpm031.front.sepia.ceph.com |
||||||||||||||
fail | 1480663 | 2017-08-04 02:25:35 | 2017-08-04 09:11:27 | 2017-08-04 11:39:29 | 2:28:02 | 1:07:17 | 1:20:45 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-08-04 10:48:29.105134 mon.a mon.0 172.21.2.67:6789/0 27 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1480664 | 2017-08-04 02:25:36 | 2017-08-04 09:13:01 | 2017-08-04 11:23:03 | 2:10:02 | 0:21:16 | 1:48:46 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
Command failed on vpm029 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' |
||||||||||||||
fail | 1480665 | 2017-08-04 02:25:37 | 2017-08-04 09:19:37 | 2017-08-04 10:23:37 | 1:04:00 | 0:20:48 | 0:43:12 | vps | master | centos | 7.3 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed on vpm073 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' |
||||||||||||||
fail | 1480666 | 2017-08-04 02:25:37 | 2017-08-04 09:27:42 | 2017-08-04 15:45:49 | 6:18:07 | 2:14:05 | 4:04:02 | vps | master | centos | 7.3 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480667 | 2017-08-04 02:25:38 | 2017-08-04 09:28:18 | 2017-08-04 10:50:18 | 1:22:00 | 1:05:15 | 0:16:45 | vps | master | centos | 7.3 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/centos_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-08-04 10:01:41.890015 mon.a mon.0 172.21.2.121:6789/0 51 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1480668 | 2017-08-04 02:25:39 | 2017-08-04 09:31:01 | 2017-08-04 15:39:09 | 6:08:08 | 2:19:49 | 3:48:19 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480669 | 2017-08-04 02:25:39 | 2017-08-04 09:34:49 | 2017-08-04 12:14:52 | 2:40:03 | 2:27:13 | 0:12:50 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480670 | 2017-08-04 02:25:40 | 2017-08-04 09:35:04 | 2017-08-04 11:51:06 | 2:16:02 | 1:43:53 | 0:32:09 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after osd.4 restart |
||||||||||||||
fail | 1480671 | 2017-08-04 02:25:41 | 2017-08-04 09:41:00 | 2017-08-04 17:31:11 | 7:50:11 | 1:27:42 | 6:22:29 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-08-04 16:12:50.119534 mon.a mon.0 172.21.2.45:6789/0 60 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1480672 | 2017-08-04 02:25:41 | 2017-08-04 09:52:47 | 2017-08-04 13:22:52 | 3:30:05 | 2:27:57 | 1:02:08 | vps | master | centos | 7.3 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480673 | 2017-08-04 02:25:42 | 2017-08-04 09:56:51 | 2017-08-04 14:18:56 | 4:22:05 | 0:12:43 | 4:09:22 | vps | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed on vpm037 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' |
||||||||||||||
fail | 1480674 | 2017-08-04 02:25:43 | 2017-08-04 10:00:18 | 2017-08-04 12:20:21 | 2:20:03 | 2:04:32 | 0:15:31 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |
||||||||||||||
fail | 1480675 | 2017-08-04 02:25:43 | 2017-08-04 10:04:56 | 2017-08-04 11:34:57 | 1:30:01 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |||
Failure Reason:
Command failed on vpm163 with status 100: 'sudo apt-get update' |
||||||||||||||
fail | 1480676 | 2017-08-04 02:25:44 | 2017-08-04 10:18:59 | 2017-08-04 14:17:03 | 3:58:04 | 2:17:44 | 1:40:20 | vps | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'default_idle_timeout' |