User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail |
---|---|---|---|---|---|---|---|---|---|
teuthology | 2017-07-15 03:25:03 | 2017-07-15 03:25:26 | 2017-07-15 06:11:37 | 2:46:11 | upgrade:kraken-x | master | ovh | d52763c | 16 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
fail | 1401861 | 2017-07-15 03:25:22 | 2017-07-15 03:25:24 | 2017-07-15 05:25:25 | 2:00:01 | 1:48:52 | 0:11:09 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
fail | 1401864 | 2017-07-15 03:25:22 | 2017-07-15 03:25:25 | 2017-07-15 06:05:27 | 2:40:02 | 2:25:49 | 0:14:13 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:58:01.653755 mon.b mon.0 158.69.69.16:6789/0 99 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
fail | 1401868 | 2017-07-15 03:25:23 | 2017-07-15 03:25:26 | 2017-07-15 05:57:27 | 2:32:01 | 2:22:19 | 0:09:42 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:44:00.217825 mon.a mon.0 158.69.69.144:6789/0 82 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1401871 | 2017-07-15 03:25:24 | 2017-07-15 03:25:26 | 2017-07-15 04:39:26 | 1:14:00 | 1:01:16 | 0:12:44 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:47:16.569660 mon.a mon.0 158.69.69.200:6789/0 58 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1401874 | 2017-07-15 03:25:24 | 2017-07-15 03:25:27 | 2017-07-15 05:57:29 | 2:32:02 | 2:18:28 | 0:13:34 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:53:40.230896 mon.a mon.0 158.69.69.14:6789/0 108 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
fail | 1401877 | 2017-07-15 03:25:25 | 2017-07-15 03:25:27 | 2017-07-15 05:21:28 | 1:56:01 | 1:44:00 | 0:12:01 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after osd.0 restart |
||||||||||||||
fail | 1401880 | 2017-07-15 03:25:26 | 2017-07-15 03:25:28 | 2017-07-15 03:53:27 | 0:27:59 | 0:11:01 | 0:16:58 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed on ovh034 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' |
||||||||||||||
fail | 1401883 | 2017-07-15 03:25:27 | 2017-07-15 03:25:29 | 2017-07-15 05:59:32 | 2:34:03 | 2:19:28 | 0:14:35 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-07-15 04:01:45.519084 mon.b mon.0 158.69.69.165:6789/0 210 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
fail | 1401886 | 2017-07-15 03:25:27 | 2017-07-15 03:25:29 | 2017-07-15 03:57:28 | 0:31:59 | 0:15:36 | 0:16:23 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
Command failed on ovh069 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' |
||||||||||||||
fail | 1401889 | 2017-07-15 03:25:28 | 2017-07-15 03:25:31 | 2017-07-15 04:37:31 | 1:12:00 | 0:58:20 | 0:13:40 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed (workunit test cls/test_cls_lock.sh) on ovh027 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=kraken TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh' |
||||||||||||||
fail | 1401892 | 2017-07-15 03:25:29 | 2017-07-15 03:25:32 | 2017-07-15 06:11:37 | 2:46:05 | 2:33:48 | 0:12:17 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:47:10.197470 mon.a mon.0 158.69.69.171:6789/0 62 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
fail | 1401895 | 2017-07-15 03:25:29 | 2017-07-15 03:25:31 | 2017-07-15 03:47:31 | 0:22:00 | 0:09:02 | 0:12:58 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed on ovh057 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' |
||||||||||||||
fail | 1401898 | 2017-07-15 03:25:30 | 2017-07-15 03:25:34 | 2017-07-15 05:21:36 | 1:56:02 | 1:42:02 | 0:14:00 | ovh | master | ubuntu | 14.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} | 3 | |
Failure Reason:
Command failed on ovh015 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' |
||||||||||||||
fail | 1401901 | 2017-07-15 03:25:31 | 2017-07-15 03:25:35 | 2017-07-15 04:01:32 | 0:35:57 | 0:24:31 | 0:11:26 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
fail | 1401904 | 2017-07-15 03:25:32 | 2017-07-15 03:25:33 | 2017-07-15 04:43:35 | 1:18:02 | 1:08:44 | 0:09:18 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:53:30.287831 mon.a mon.0 158.69.69.210:6789/0 83 : cluster [WRN] Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
fail | 1401907 | 2017-07-15 03:25:32 | 2017-07-15 03:25:38 | 2017-07-15 05:47:37 | 2:21:59 | 2:09:22 | 0:12:37 | ovh | master | ubuntu | 16.04 | upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} | 3 | |
Failure Reason:
"2017-07-15 03:50:30.780568 mon.b mon.0 158.69.69.17:6789/0 122 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |