Pulpito

sage-2015-08-17_18:08:42-upgrade:hammer-x-wip-newstore-sort---basic-multi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Fail Dead
sage 2015-08-18 01:08:42 2015-08-18 01:16:49 2015-08-19 13:25:31 1 day, 12:08:42 upgrade:hammer-x wip-newstore-sort mira,burnupi,plana — 5 1

Average wait time: 7:56:12

See other runs of suite 'upgrade:hammer-x' on branch 'wip-newstore-sort'?

See other runs on branch 'wip-newstore-sort'?

See other runs scheduled on 2015-08-18?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
fail 1019638 2015-08-18 01:08:48 2015-08-18 01:10:15 2015-08-18 04:28:32 3:18:17 0:33:02 2:45:15 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/parallel/{0-cluster/start.yaml 1-hammer-install/hammer.yaml 2-workload/{ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

dead 1019639 2015-08-18 01:08:49 2015-08-18 01:16:49 2015-08-19 13:25:31 1 day, 12:08:42 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/stress-split-erasure-code-x86_64/{0-cluster/start.yaml 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-rados-plugin=isa-k=2-m=1.yaml distros/ubuntu_14.04.yaml} 3
fail 1019640 2015-08-18 01:08:50 2015-08-18 01:18:53 2015-08-18 16:32:09 15:13:16 2:03:19 13:09:57 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/point-to-point-x/{point-to-point.yaml distros/ubuntu_14.04.yaml} 3
Failure Reason:

'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds

fail 1019641 2015-08-18 01:08:50 2015-08-18 01:20:28 2015-08-18 12:49:25 11:28:57 1:37:05 9:51:52 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/stress-split/{0-cluster/start.yaml 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 6-next-mon/monb.yaml 7-workload/{radosbench.yaml rbd_api.yaml} 8-next-mon/monc.yaml 9-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2015-08-18 04:48:12.813789 osd.10 10.214.131.12:6800/17911 2883 : cluster [ERR] be_compare_scrubmaps: 6.12 shard 6 missing 2101e952/benchmark_data_burnupi13_54629_object2652/head//6be_compare_scrubmaps: 6.12 shard 6 missing c5843a52/benchmark_data_burnupi13_54629_object1419/head//6be_compare_scrubmaps: 6.12 shard 6 missing cbe75a52/benchmark_data_burnupi13_54629_object3604/head//6be_compare_scrubmaps: 6.12 shard 6 missing 5c145b52/benchmark_data_burnupi13_54629_object11742/head//6be_compare_scrubmaps: 6.12 shard 6 missing feda5c52/benchmark_data_burnupi13_54629_object1654/head//6be_compare_scrubmaps: 6.12 shard 6 missing a57c7c52/benchmark_data_burnupi13_54629_object5642/head//6be_compare_scrubmaps: 6.12 shard 6 missing 43868c52/benchmark_data_burnupi13_54629_object8050/head//6be_compare_scrubmaps: 6.12 shard 6 missing 2183ac52/benchmark_data_burnupi13_54629_object5706/head//6be_compare_scrubmaps: 6.12 shard 6 missing 40ff0d52/benchmark_data_burnupi13_54629_object3067/head//6be_compare_scrubmaps: 6.12 shard 6 missing ce6d5d52/benchmark_data_burnupi13_54629_object1307/head//6be_compare_scrubmaps: 6.12 shard 6 missing a3f9d52/benchmark_data_burnupi13_54629_object7099/head//6be_compare_scrubmaps: 6.12 shard 6 missing 291acd52/benchmark_data_burnupi13_54629_object4980/head//6be_compare_scrubmaps: 6.12 shard 6 missing e336ed52/benchmark_data_burnupi13_54629_object8740/head//6be_compare_scrubmaps: 6.12 shard 6 missing 33e9ed52/benchmark_data_burnupi13_54629_object338/head//6be_compare_scrubmaps: 6.12 shard 6 missing b4d32e52/benchmark_data_burnupi13_54629_object5280/head//6be_compare_scrubmaps: 6.12 shard 6 missing d6ab2e52/benchmark_data_burnupi13_54629_object1105/head//6be_compare_scrubmaps: 6.12 shard 6 missing 92c43e52/benchmark_data_burnupi13_54629_object8308/head//6be_compare_scrubmaps: 6.12 shard 6 missing 2665be52/benchmark_data_burnupi13_54629_object4655/head//6be_compare_scrubmaps: 6.12 shard 6 missing 81d9ce52/benchmark_data_burnupi13_54629_object1953/head//6be_compare_scrubmaps: 6.12 shard 6 missing ef758f52/benchmark_data_burnupi13_54629_object709/head//6be_compare_scrubmaps: 6.12 shard 6 missing 9b959f52/benchmark_data_burnupi13_54629_object10262/head//6be_compare_scrubmaps: 6.12 shard 6 missing 4596df52/benchmark_data_burnupi13_54629_object5221/head//6be_compare_scrubmaps: 6.12 shard 6 missing f03cef52/benchmark_data_burnupi13_54629_object12228/head//6" in cluster log

fail 1019642 2015-08-18 01:08:51 2015-08-18 01:24:24 2015-08-18 10:45:10 9:20:46 1:07:55 8:12:51 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/stress-split-erasure-code/{0-cluster/start.yaml 1-hammer-install/hammer.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/ec-rados-default.yaml 6-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml distros/ubuntu_14.04.yaml} 3
Failure Reason:

"2015-08-18 02:40:25.499973 osd.0 10.214.134.132:6829/11648 1 : cluster [WRN] failed to encode map e7 with expected crc" in cluster log

fail 1019643 2015-08-18 01:08:52 2015-08-18 01:24:54 2015-08-18 08:59:32 7:34:38 1:53:29 5:41:09 mira,burnupi,plana master ubuntu 14.04 upgrade:hammer-x/parallel/{0-cluster/start.yaml 1-hammer-install/hammer.yaml 2-workload/{ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-final-workload/{rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw_swift.yaml} distros/ubuntu_14.04.yaml} 3
Failure Reason:

Command failed on plana25 with status 1: "SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.1.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw'"