Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 1405573 2017-07-16 04:23:52 2017-07-16 12:41:13 2017-07-17 00:46:23 12:05:10 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
dead 1405576 2017-07-16 04:23:52 2017-07-16 12:41:43 2017-07-17 00:47:20 12:05:37 smithi master centos 7.3 upgrade:jewel-x/point-to-point-x/{distros/centos_7.3.yaml point-to-point-upgrade.yaml} 3
fail 1405579 2017-07-16 04:23:53 2017-07-16 12:41:48 2017-07-16 12:59:42 0:17:54 0:06:43 0:11:11 smithi master centos 7.3 upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_latest.yaml} 3
Failure Reason:

Command failed on smithi012 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.3 1.0 host=localhost root=default'

fail 1405582 2017-07-16 04:23:54 2017-07-16 12:41:44 2017-07-16 14:59:46 2:18:02 1:14:47 1:03:15 smithi master centos 7.3 upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:49:13.479892 mon.a mon.0 172.21.15.129:6789/0 89 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS)" in cluster log

fail 1405585 2017-07-16 04:23:54 2017-07-16 12:41:56 2017-07-16 16:16:01 3:34:05 1:05:01 2:29:04 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 15:15:59.503187 mon.a mon.0 172.21.15.47:6789/0 542 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405588 2017-07-16 04:23:55 2017-07-16 12:41:55 2017-07-16 14:51:55 2:10:00 1:12:18 0:57:42 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:42:49.025461 mon.b mon.0 172.21.15.184:6789/0 101 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405591 2017-07-16 04:23:56 2017-07-16 12:42:03 2017-07-16 14:08:04 1:26:01 1:03:38 0:22:23 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:13:59.115307 mon.a mon.0 172.21.15.18:6789/0 356 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405594 2017-07-16 04:23:57 2017-07-16 12:42:27 2017-07-16 15:40:31 2:58:04 0:34:32 2:23:32 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

Command failed on smithi062 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client luminous'"

fail 1405597 2017-07-16 04:23:57 2017-07-16 12:43:49 2017-07-16 14:05:49 1:22:00 1:02:19 0:19:41 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:11:22.259143 mon.a mon.0 172.21.15.83:6789/0 565 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405600 2017-07-16 04:23:58 2017-07-16 12:43:49 2017-07-16 14:35:50 1:52:01 1:27:58 0:24:03 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:14:55.175089 mon.b mon.0 172.21.15.27:6789/0 70 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

dead 1405603 2017-07-16 04:23:59 2017-07-16 12:43:58 2017-07-17 00:51:01 12:07:03 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
fail 1405606 2017-07-16 04:23:59 2017-07-16 12:44:15 2017-07-16 14:58:13 2:13:58 1:24:51 0:49:07 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

Command failed on smithi194 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

fail 1405609 2017-07-16 04:24:00 2017-07-16 12:45:43 2017-07-16 16:03:45 3:18:02 1:15:09 2:02:53 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 14:57:58.537577 mon.b mon.0 172.21.15.21:6789/0 175 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1405612 2017-07-16 04:24:01 2017-07-16 12:45:46 2017-07-16 12:59:42 0:13:56 0:05:35 0:08:21 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

Command failed on smithi074 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

fail 1405615 2017-07-16 04:24:01 2017-07-16 12:45:47 2017-07-16 13:33:46 0:47:59 0:35:31 0:12:28 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

Command failed on smithi200 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client luminous'"

fail 1405618 2017-07-16 04:24:02 2017-07-16 12:45:58 2017-07-16 14:03:57 1:17:59 1:03:05 0:14:54 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:05:31.587346 mon.a mon.0 172.21.15.24:6789/0 65 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405621 2017-07-16 04:24:03 2017-07-16 12:46:07 2017-07-16 15:26:05 2:39:58 1:10:46 1:29:12 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 14:20:23.689986 mon.b mon.0 172.21.15.160:6789/0 347 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

dead 1405624 2017-07-16 04:24:04 2017-07-16 12:47:12 2017-07-17 00:53:19 12:06:07 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
fail 1405627 2017-07-16 04:24:04 2017-07-16 12:47:46 2017-07-16 13:27:44 0:39:58 0:05:49 0:34:09 smithi master ubuntu 14.04 upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

Command failed on smithi062 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.3 1.0 host=localhost root=default'

fail 1405630 2017-07-16 04:24:05 2017-07-16 12:48:45 2017-07-16 15:06:48 2:18:03 0:54:51 1:23:12 smithi master ubuntu 14.04 upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 14:13:28.721362 mon.a mon.0 172.21.15.171:6789/0 30 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

fail 1405633 2017-07-16 04:24:06 2017-07-16 12:49:41 2017-07-16 13:17:39 0:27:58 0:07:34 0:20:24 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

Command failed on smithi030 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

fail 1405636 2017-07-16 04:24:06 2017-07-16 12:49:59 2017-07-16 14:09:59 1:20:00 1:12:12 0:07:48 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 13:03:10.454997 mon.a mon.0 172.21.15.158:6789/0 168 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 1405639 2017-07-16 04:24:07 2017-07-16 12:50:28 2017-07-16 13:32:26 0:41:58 0:05:14 0:36:44 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

Command failed on smithi184 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

fail 1405642 2017-07-16 04:24:08 2017-07-16 12:50:31 2017-07-16 15:06:33 2:16:02 1:55:15 0:20:47 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:33:02.694609 mon.a mon.0 172.21.15.15:6789/0 213 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405645 2017-07-16 04:24:08 2017-07-16 12:51:48 2017-07-16 13:11:47 0:19:59 0:05:36 0:14:23 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

Command failed on smithi054 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

fail 1405648 2017-07-16 04:24:09 2017-07-16 12:51:49 2017-07-16 14:37:49 1:46:00 1:25:44 0:20:16 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:14:57.265672 mon.a mon.0 172.21.15.97:6789/0 64 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405650 2017-07-16 04:24:10 2017-07-16 12:51:49 2017-07-16 14:29:48 1:37:59 1:18:11 0:19:48 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:19:52.012222 mon.b mon.0 172.21.15.19:6789/0 55 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1405653 2017-07-16 04:24:10 2017-07-16 12:51:49 2017-07-16 14:07:48 1:15:59 0:48:53 0:27:06 smithi master ubuntu 14.04 upgrade:jewel-x/point-to-point-x/{distros/ubuntu_14.04.yaml point-to-point-upgrade.yaml} 3
Failure Reason:

Command failed on smithi054 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client luminous'"

fail 1405657 2017-07-16 04:24:11 2017-07-16 12:51:57 2017-07-16 16:05:59 3:14:02 1:13:03 2:00:59 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 14:57:27.456205 mon.b mon.0 172.21.15.55:6789/0 420 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405659 2017-07-16 04:24:12 2017-07-16 12:54:04 2017-07-16 14:34:03 1:39:59 1:13:17 0:26:42 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:27:00.896058 mon.b mon.0 172.21.15.80:6789/0 348 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405662 2017-07-16 04:24:13 2017-07-16 12:54:25 2017-07-16 14:34:26 1:40:01 0:58:21 0:41:40 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:41:41.742365 mon.a mon.0 172.21.15.26:6789/0 52 : cluster [WRN] Health check failed: 4 osds down (OSD_DOWN)" in cluster log

fail 1405665 2017-07-16 04:24:14 2017-07-16 12:55:17 2017-07-16 15:45:19 2:50:02 1:30:25 1:19:37 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 14:36:56.849587 mon.a mon.0 172.21.15.158:6789/0 417 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405669 2017-07-16 04:24:15 2017-07-16 12:55:31 2017-07-16 14:33:31 1:38:00 1:02:36 0:35:24 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:34:05.632286 mon.a mon.0 172.21.15.106:6789/0 95 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405672 2017-07-16 04:24:16 2017-07-16 12:55:49 2017-07-16 13:11:46 0:15:57 0:06:42 0:09:15 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

Command failed on smithi130 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

dead 1405675 2017-07-16 04:24:16 2017-07-16 12:57:45 2017-07-17 01:08:38 12:10:53 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
fail 1405678 2017-07-16 04:24:17 2017-07-16 12:57:46 2017-07-16 15:27:48 2:30:02 2:19:41 0:10:21 smithi master ubuntu 16.04 upgrade:jewel-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:11:14.923099 mon.a mon.0 172.21.15.183:6789/0 28 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1405681 2017-07-16 04:24:18 2017-07-16 12:57:48 2017-07-16 13:59:48 1:02:00 0:53:47 0:08:13 smithi master ubuntu 16.04 upgrade:jewel-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/ec-rados-default.yaml 5-finish-upgrade.yaml 6-luminous.yaml 7-final-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:06:54.393173 mon.a mon.0 172.21.15.92:6789/0 25 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1405684 2017-07-16 04:24:18 2017-07-16 12:57:50 2017-07-16 15:37:51 2:40:01 1:10:45 1:29:16 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 14:34:39.053643 mon.b mon.0 172.21.15.83:6789/0 326 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405687 2017-07-16 04:24:19 2017-07-16 12:59:47 2017-07-16 14:43:48 1:44:01 1:17:11 0:26:50 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:32:01.792056 mon.b mon.0 172.21.15.21:6789/0 138 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405690 2017-07-16 04:24:20 2017-07-16 12:59:47 2017-07-16 14:13:48 1:14:01 0:58:50 0:15:11 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 13:19:20.749326 mon.b mon.0 172.21.15.47:6789/0 268 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405693 2017-07-16 04:24:20 2017-07-16 12:59:47 2017-07-16 15:49:49 2:50:02 1:17:18 1:32:44 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 14:36:22.353031 mon.a mon.0 172.21.15.84:6789/0 70 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405696 2017-07-16 04:24:21 2017-07-16 12:59:48 2017-07-16 14:47:48 1:48:00 1:04:59 0:43:01 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:51:38.174398 mon.a mon.0 172.21.15.3:6789/0 566 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405699 2017-07-16 04:24:22 2017-07-16 12:59:48 2017-07-16 15:27:49 2:28:01 1:24:41 1:03:20 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 14:05:22.953994 mon.b mon.0 172.21.15.72:6789/0 78 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405702 2017-07-16 04:24:23 2017-07-16 12:59:47 2017-07-16 14:27:47 1:28:00 1:04:47 0:23:13 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/blogbench.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:30:20.321546 mon.b mon.0 172.21.15.84:6789/0 166 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405705 2017-07-16 04:24:24 2017-07-16 12:59:47 2017-07-16 14:59:48 2:00:01 1:13:41 0:46:20 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/cache-pool-snaps.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:50:30.591453 mon.b mon.0 172.21.15.17:6789/0 99 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405708 2017-07-16 04:24:24 2017-07-16 13:01:59 2017-07-16 14:28:04 1:26:05 1:16:15 0:09:50 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/ec-rados-default.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 13:17:45.983437 mon.b mon.0 172.21.15.41:6789/0 186 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 1405711 2017-07-16 04:24:25 2017-07-16 13:01:55 2017-07-16 13:57:54 0:55:59 0:05:13 0:50:46 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

Command failed on smithi085 with status 2: 'sudo ceph --cluster ceph osd crush create-or-move osd.2 1.0 host=localhost root=default'

fail 1405713 2017-07-16 04:24:26 2017-07-16 13:01:55 2017-07-16 14:45:55 1:44:00 1:18:32 0:25:28 smithi master centos 7.3 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/rados_loadgenbig.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/centos_latest.yaml} 3
Failure Reason:

"2017-07-16 13:40:24.638571 mon.a mon.0 172.21.15.28:6789/0 499 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405716 2017-07-16 04:24:26 2017-07-16 13:01:58 2017-07-16 15:02:00 2:00:02 1:28:24 0:31:38 smithi master ubuntu 14.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2017-07-16 13:35:12.753515 mon.a mon.0 172.21.15.48:6789/0 65 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log

fail 1405719 2017-07-16 04:24:27 2017-07-16 13:03:16 2017-07-16 14:37:15 1:33:59 1:13:42 0:20:17 smithi master ubuntu 16.04 upgrade:jewel-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 1.5-final-scrub.yaml 2-workload/test_rbd_python.yaml 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-luminous.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_latest.yaml} 3
Failure Reason:

"2017-07-16 13:29:53.457521 mon.b mon.0 172.21.15.187:6789/0 315 : cluster [ERR] Health check failed: 1 mds daemon down (MDS_FAILED)" in cluster log