| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2017-07-16 04:23:02 | 2017-07-16 04:24:49 | 2017-07-16 16:51:22 | 12:26:33 | upgrade:jewel-x | master | ovh | 171104c | 46 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| dead | 1405575 |
|
2017-07-16 04:23:52 | 2017-07-16 04:24:48 | 2017-07-16 16:27:31 | 12:02:43 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 | ||
| fail | 1405578 |
|
2017-07-16 04:23:53 | 2017-07-16 04:24:50 | 2017-07-16 06:40:51 | 2:16:01 | 1:32:02 | 0:43:59 | ovh | master | centos | 7.3 | upgrade:jewel-x/point-to-point-x/{distros/centos_7.3.yaml point-to-point-upgrade.yaml} | 3 |
Failure Reason:
'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
| fail | 1405581 |
|
2017-07-16 04:23:54 | 2017-07-16 04:24:51 | 2017-07-16 05:56:50 | 1:31:59 | 0:10:43 | 1:21:16 | ovh | master | centos | 7.3 | upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh067 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.3 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405584 |
|
2017-07-16 04:23:54 | 2017-07-16 04:24:49 | 2017-07-16 05:56:48 | 1:31:59 | 0:59:11 | 0:32:48 | ovh | master | centos | 7.3 | upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 05:04:15.601296 mon.a mon.0 158.69.74.157:6789/0 43 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 1405587 |
|
2017-07-16 04:23:55 | 2017-07-16 04:24:49 | 2017-07-16 04:46:48 | 0:21:59 | 0:12:08 | 0:09:51 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
Command failed on ovh012 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405590 |
|
2017-07-16 04:23:56 | 2017-07-16 04:25:03 | 2017-07-16 06:28:51 | 2:03:48 | 1:24:44 | 0:39:04 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 05:14:52.667489 mon.a mon.0 158.69.74.72:6789/0 156 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405593 |
|
2017-07-16 04:23:56 | 2017-07-16 04:24:52 | 2017-07-16 05:54:48 | 1:29:56 | 1:10:58 | 0:18:58 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 04:58:23.126185 mon.b mon.0 158.69.74.128:6789/0 257 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405596 |
|
2017-07-16 04:23:57 | 2017-07-16 04:24:49 | 2017-07-16 06:58:50 | 2:34:01 | 1:59:21 | 0:34:40 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 05:10:28.162860 mon.a mon.0 158.69.74.5:6789/0 42 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405599 |
|
2017-07-16 04:23:58 | 2017-07-16 04:24:49 | 2017-07-16 06:08:48 | 1:43:59 | 1:18:42 | 0:25:17 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 05:05:04.293257 mon.a mon.0 158.69.74.226:6789/0 515 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405602 |
|
2017-07-16 04:23:58 | 2017-07-16 04:24:47 | 2017-07-16 06:02:48 | 1:38:01 | 1:17:37 | 0:20:24 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 04:54:42.348299 mon.a mon.0 158.69.74.1:6789/0 80 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| dead | 1405605 |
|
2017-07-16 04:23:59 | 2017-07-16 04:24:47 | 2017-07-16 16:27:27 | 12:02:40 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 | ||
| fail | 1405608 |
|
2017-07-16 04:24:00 | 2017-07-16 04:24:49 | 2017-07-16 07:00:51 | 2:36:02 | 0:13:47 | 2:22:15 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh030 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405611 |
|
2017-07-16 04:24:01 | 2017-07-16 04:24:50 | 2017-07-16 04:54:48 | 0:29:58 | 0:08:48 | 0:21:10 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh010 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405614 |
|
2017-07-16 04:24:01 | 2017-07-16 04:24:51 | 2017-07-16 06:38:51 | 2:14:00 | 1:29:39 | 0:44:21 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 05:17:21.442961 mon.b mon.0 158.69.74.75:6789/0 58 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405617 |
|
2017-07-16 04:24:02 | 2017-07-16 04:24:47 | 2017-07-16 04:48:46 | 0:23:59 | 0:11:07 | 0:12:52 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh044 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405620 |
|
2017-07-16 04:24:03 | 2017-07-16 04:24:50 | 2017-07-16 06:00:51 | 1:36:01 | 1:15:49 | 0:20:12 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 04:54:14.203461 mon.a mon.0 158.69.74.10:6789/0 75 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405623 |
|
2017-07-16 04:24:03 | 2017-07-16 04:24:49 | 2017-07-16 07:22:52 | 2:58:03 | 0:09:56 | 2:48:07 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
Command failed on ovh074 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| dead | 1405626 |
|
2017-07-16 04:24:04 | 2017-07-16 04:24:49 | 2017-07-16 16:27:24 | 12:02:35 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 | ||
| fail | 1405629 |
|
2017-07-16 04:24:05 | 2017-07-16 04:24:51 | 2017-07-16 07:42:52 | 3:18:01 | 2:42:45 | 0:35:16 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 05:13:39.064795 mon.a mon.0 158.69.74.51:6789/0 51 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 1405632 |
|
2017-07-16 04:24:06 | 2017-07-16 04:24:49 | 2017-07-16 05:32:48 | 1:07:59 | 0:57:16 | 0:10:43 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
Scrubbing terminated -- not all pgs were active and clean. |
||||||||||||||
| fail | 1405635 |
|
2017-07-16 04:24:06 | 2017-07-16 04:24:48 | 2017-07-16 04:54:46 | 0:29:58 | 0:10:14 | 0:19:44 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh046 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405638 |
|
2017-07-16 04:24:07 | 2017-07-16 04:24:49 | 2017-07-16 05:02:47 | 0:37:58 | 0:22:53 | 0:15:05 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 1405641 |
|
2017-07-16 04:24:08 | 2017-07-16 04:24:48 | 2017-07-16 04:46:47 | 0:21:59 | 0:11:51 | 0:10:08 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh035 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405644 |
|
2017-07-16 04:24:08 | 2017-07-16 04:24:49 | 2017-07-16 08:06:52 | 3:42:03 | 3:19:19 | 0:22:44 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
Command failed (workunit test rados/load-gen-big.sh) on ovh085 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=jewel TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-big.sh' |
||||||||||||||
| fail | 1405646 |
|
2017-07-16 04:24:09 | 2017-07-16 04:24:50 | 2017-07-16 06:12:51 | 1:48:01 | 1:15:11 | 0:32:50 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 05:11:18.978786 mon.b mon.0 158.69.74.47:6789/0 119 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET)" in cluster log |
||||||||||||||
| fail | 1405649 |
|
2017-07-16 04:24:10 | 2017-07-16 04:24:49 | 2017-07-16 04:50:47 | 0:25:58 | 0:11:23 | 0:14:35 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh070 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405652 |
|
2017-07-16 04:24:10 | 2017-07-16 04:24:48 | 2017-07-16 06:34:49 | 2:10:01 | 1:16:37 | 0:53:24 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 05:32:48.648642 mon.a mon.0 158.69.75.114:6789/0 254 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405655 |
|
2017-07-16 04:24:11 | 2017-07-16 04:25:43 | 2017-07-16 06:17:45 | 1:52:02 | 1:26:18 | 0:25:44 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/point-to-point-x/{distros/ubuntu_14.04.yaml point-to-point-upgrade.yaml} | 3 |
Failure Reason:
"2017-07-16 05:26:52.491871 mon.a mon.0 158.69.74.32:6789/0 9 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log |
||||||||||||||
| fail | 1405658 |
|
2017-07-16 04:24:12 | 2017-07-16 04:25:44 | 2017-07-16 09:47:51 | 5:22:07 | 1:23:56 | 3:58:11 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 08:35:35.479856 mon.a mon.0 158.69.78.92:6789/0 95 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405661 |
|
2017-07-16 04:24:13 | 2017-07-16 04:27:41 | 2017-07-16 05:55:42 | 1:28:01 | 0:12:06 | 1:15:55 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh088 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405664 |
|
2017-07-16 04:24:14 | 2017-07-16 04:40:06 | 2017-07-16 06:24:07 | 1:44:01 | 1:07:38 | 0:36:23 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 05:27:13.739718 mon.a mon.0 158.69.74.73:6789/0 94 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405667 |
|
2017-07-16 04:24:15 | 2017-07-16 04:41:43 | 2017-07-16 06:49:43 | 2:08:00 | 0:40:07 | 1:27:53 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
| fail | 1405670 |
|
2017-07-16 04:24:15 | 2017-07-16 04:47:15 | 2017-07-16 07:31:18 | 2:44:03 | 1:19:35 | 1:24:28 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:22:25.075276 mon.b mon.0 158.69.76.17:6789/0 84 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405673 |
|
2017-07-16 04:24:16 | 2017-07-16 04:47:15 | 2017-07-16 05:59:16 | 1:12:01 | 0:08:27 | 1:03:34 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
Command failed on ovh087 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| dead | 1405676 |
|
2017-07-16 04:24:17 | 2017-07-16 04:49:02 | 2017-07-16 16:51:22 | 12:02:20 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 | ||
| fail | 1405679 |
|
2017-07-16 04:24:17 | 2017-07-16 04:50:50 | 2017-07-16 10:14:56 | 5:24:06 | 2:23:33 | 3:00:33 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 08:00:16.105245 mon.a mon.0 158.69.78.200:6789/0 41 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 1405682 |
|
2017-07-16 04:24:18 | 2017-07-16 04:55:21 | 2017-07-16 07:11:23 | 2:16:02 | 1:08:23 | 1:07:39 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:12:16.561288 mon.a mon.0 158.69.75.89:6789/0 49 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
| fail | 1405685 |
|
2017-07-16 04:24:19 | 2017-07-16 04:55:22 | 2017-07-16 07:15:23 | 2:20:01 | 1:32:38 | 0:47:23 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:03:31.969810 mon.b mon.0 158.69.75.197:6789/0 366 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405688 |
|
2017-07-16 04:24:19 | 2017-07-16 04:55:51 | 2017-07-16 06:39:52 | 1:44:01 | 0:24:22 | 1:19:39 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
reached maximum tries (50) after waiting for 300 seconds |
||||||||||||||
| fail | 1405691 |
|
2017-07-16 04:24:20 | 2017-07-16 05:03:47 | 2017-07-16 07:25:47 | 2:22:00 | 1:12:41 | 1:09:19 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 06:26:56.874052 mon.a mon.0 158.69.76.110:6789/0 358 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405694 |
|
2017-07-16 04:24:21 | 2017-07-16 05:29:34 | 2017-07-16 07:59:36 | 2:30:02 | 1:51:50 | 0:38:12 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:19:55.419252 mon.a mon.0 158.69.75.9:6789/0 72 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405697 |
|
2017-07-16 04:24:21 | 2017-07-16 05:31:50 | 2017-07-16 07:27:51 | 1:56:01 | 1:09:56 | 0:46:05 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:30:13.208134 mon.a mon.0 158.69.76.131:6789/0 528 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405700 |
|
2017-07-16 04:24:22 | 2017-07-16 05:32:58 | 2017-07-16 07:24:59 | 1:52:01 | 1:20:48 | 0:31:13 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 06:15:26.882848 mon.b mon.0 158.69.75.7:6789/0 71 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405703 |
|
2017-07-16 04:24:24 | 2017-07-16 05:33:40 | 2017-07-16 07:33:42 | 2:00:02 | 1:21:52 | 0:38:10 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:26:28.828576 mon.b mon.0 158.69.76.112:6789/0 129 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405706 |
|
2017-07-16 04:24:24 | 2017-07-16 05:55:30 | 2017-07-16 07:41:31 | 1:46:01 | 1:26:28 | 0:19:33 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:25:59.796905 mon.b mon.0 158.69.75.74:6789/0 105 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405710 |
|
2017-07-16 04:24:25 | 2017-07-16 05:55:55 | 2017-07-16 06:47:54 | 0:51:59 | 0:10:39 | 0:41:20 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
Command failed on ovh046 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default' |
||||||||||||||
| fail | 1405714 |
|
2017-07-16 04:24:26 | 2017-07-16 05:55:57 | 2017-07-16 08:29:59 | 2:34:02 | 1:39:20 | 0:54:42 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 07:03:08.854588 mon.a mon.0 158.69.76.92:6789/0 65 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405717 |
|
2017-07-16 04:24:26 | 2017-07-16 05:56:57 | 2017-07-16 07:10:52 | 1:13:55 | 0:41:29 | 0:32:26 | ovh | master | centos | 7.3 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} | 3 |
Failure Reason:
'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds |
||||||||||||||
| fail | 1405720 |
|
2017-07-16 04:24:27 | 2017-07-16 05:56:52 | 2017-07-16 07:42:53 | 1:46:01 | 1:13:25 | 0:32:36 | ovh | master | ubuntu | 14.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} | 3 |
Failure Reason:
"2017-07-16 06:39:05.401042 mon.b mon.0 158.69.76.226:6789/0 76 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
| fail | 1405723 |
|
2017-07-16 04:24:28 | 2017-07-16 05:59:38 | 2017-07-16 07:41:38 | 1:42:00 | 1:21:02 | 0:20:58 | ovh | master | ubuntu | 16.04 | upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} | 3 |
Failure Reason:
"2017-07-16 06:34:28.680747 mon.a mon.0 158.69.76.188:6789/0 534 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log |
||||||||||||||
Pulpito