Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 1401861 2017-07-15 03:25:22 2017-07-15 03:25:24 2017-07-15 05:25:25 2:00:01 1:48:52 0:11:09 ovh master ubuntu 14.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 1401864 2017-07-15 03:25:22 2017-07-15 03:25:25 2017-07-15 06:05:27 2:40:02 2:25:49 0:14:13 ovh master ubuntu 16.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} 3
Failure Reason:

"2017-07-15 03:58:01.653755 mon.b mon.0 158.69.69.16:6789/0 99 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1401868 2017-07-15 03:25:23 2017-07-15 03:25:26 2017-07-15 05:57:27 2:32:01 2:22:19 0:09:42 ovh master ubuntu 14.04 upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

"2017-07-15 03:44:00.217825 mon.a mon.0 158.69.69.144:6789/0 82 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 1401871 2017-07-15 03:25:24 2017-07-15 03:25:26 2017-07-15 04:39:26 1:14:00 1:01:16 0:12:44 ovh master ubuntu 14.04 upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

"2017-07-15 03:47:16.569660 mon.a mon.0 158.69.69.200:6789/0 58 : cluster [WRN] Health check update: 3 osds down (OSD_DOWN)" in cluster log

fail 1401874 2017-07-15 03:25:24 2017-07-15 03:25:27 2017-07-15 05:57:29 2:32:02 2:18:28 0:13:34 ovh master ubuntu 14.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} 3
Failure Reason:

"2017-07-15 03:53:40.230896 mon.a mon.0 158.69.69.14:6789/0 108 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1401877 2017-07-15 03:25:25 2017-07-15 03:25:27 2017-07-15 05:21:28 1:56:01 1:44:00 0:12:01 ovh master ubuntu 16.04 upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} 3
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

fail 1401880 2017-07-15 03:25:26 2017-07-15 03:25:28 2017-07-15 03:53:27 0:27:59 0:11:01 0:16:58 ovh master ubuntu 16.04 upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/bluestore.yaml} 3
Failure Reason:

Command failed on ovh034 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3'

fail 1401883 2017-07-15 03:25:27 2017-07-15 03:25:29 2017-07-15 05:59:32 2:34:03 2:19:28 0:14:35 ovh master ubuntu 16.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

"2017-07-15 04:01:45.519084 mon.b mon.0 158.69.69.165:6789/0 210 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1401886 2017-07-15 03:25:27 2017-07-15 03:25:29 2017-07-15 03:57:28 0:31:59 0:15:36 0:16:23 ovh master ubuntu 14.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

Command failed on ovh069 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3'

fail 1401889 2017-07-15 03:25:28 2017-07-15 03:25:31 2017-07-15 04:37:31 1:12:00 0:58:20 0:13:40 ovh master ubuntu 16.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/bluestore.yaml} 3
Failure Reason:

Command failed (workunit test cls/test_cls_lock.sh) on ovh027 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=kraken TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh'

fail 1401892 2017-07-15 03:25:29 2017-07-15 03:25:32 2017-07-15 06:11:37 2:46:05 2:33:48 0:12:17 ovh master ubuntu 14.04 upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} 3
Failure Reason:

"2017-07-15 03:47:10.197470 mon.a mon.0 158.69.69.171:6789/0 62 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 1401895 2017-07-15 03:25:29 2017-07-15 03:25:31 2017-07-15 03:47:31 0:22:00 0:09:02 0:12:58 ovh master ubuntu 14.04 upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} 3
Failure Reason:

Command failed on ovh057 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3'

fail 1401898 2017-07-15 03:25:30 2017-07-15 03:25:34 2017-07-15 05:21:36 1:56:02 1:42:02 0:14:00 ovh master ubuntu 14.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml objectstore/bluestore.yaml} 3
Failure Reason:

Command failed on ovh015 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2'

fail 1401901 2017-07-15 03:25:31 2017-07-15 03:25:35 2017-07-15 04:01:32 0:35:57 0:24:31 0:11:26 ovh master ubuntu 16.04 upgrade:kraken-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

reached maximum tries (50) after waiting for 300 seconds

fail 1401904 2017-07-15 03:25:32 2017-07-15 03:25:33 2017-07-15 04:43:35 1:18:02 1:08:44 0:09:18 ovh master ubuntu 16.04 upgrade:kraken-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 6-luminous-with-mgr.yaml 7-final-workload.yaml distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

"2017-07-15 03:53:30.287831 mon.a mon.0 158.69.69.210:6789/0 83 : cluster [WRN] Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY)" in cluster log

fail 1401907 2017-07-15 03:25:32 2017-07-15 03:25:38 2017-07-15 05:47:37 2:21:59 2:09:22 0:12:37 ovh master ubuntu 16.04 upgrade:kraken-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-kraken-install/kraken.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-luminous-with-mgr.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml objectstore/filestore-xfs.yaml} 3
Failure Reason:

"2017-07-15 03:50:30.780568 mon.b mon.0 158.69.69.17:6789/0 122 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log