| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| nojha | 2019-03-04 15:19:36 | 2019-03-04 15:24:36 | 2019-03-04 18:52:38 | 3:28:02 | rados:thrash-erasure-code | wip-2-36739-2019-03-03 | smithi | ebbd429 | 43 | 57 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 3667939 |
|
2019-03-04 15:19:40 | 2019-03-04 15:20:54 | 2019-03-04 16:42:55 | 1:22:01 | 1:04:33 | 0:17:28 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:07:56.048712 osd.2 (osd.2) 364 : cluster [ERR] osd.2 pg 4.18s0 found obsolete rollback obj 0#4:1802f990:::benchmark_data_smithi193_85538_object24442:head#1a69 generation < trimmed_to 453'8812...repaired" in cluster log |
||||||||||||||
| pass | 3667940 |
|
2019-03-04 15:19:40 | 2019-03-04 15:22:34 | 2019-03-04 16:36:35 | 1:14:01 | 1:00:13 | 0:13:48 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667941 |
|
2019-03-04 15:19:41 | 2019-03-04 15:22:35 | 2019-03-04 16:42:35 | 1:20:00 | 1:02:46 | 0:17:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667942 |
|
2019-03-04 15:19:41 | 2019-03-04 15:24:36 | 2019-03-04 16:28:36 | 1:04:00 | 0:57:11 | 0:06:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:03:44.372214 osd.2 (osd.2) 447 : cluster [ERR] osd.2 pg 5.10s0 found obsolete rollback obj 0#5:080c3e29:::benchmark_data_smithi097_157592_object66724:head#1474 generation < trimmed_to 602'5398...repaired" in cluster log |
||||||||||||||
| fail | 3667943 |
|
2019-03-04 15:19:41 | 2019-03-04 15:24:36 | 2019-03-04 16:24:36 | 1:00:00 | 0:52:08 | 0:07:52 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 15:56:33.344469 osd.4 (osd.4) 344 : cluster [ERR] osd.4 pg 4.cs0 found obsolete rollback obj 0#4:300d92d3:::benchmark_data_smithi046_117799_object5941:head#dd7 generation < trimmed_to 403'5637...repaired" in cluster log |
||||||||||||||
| pass | 3667944 |
|
2019-03-04 15:19:41 | 2019-03-04 15:24:36 | 2019-03-04 16:34:36 | 1:10:00 | 0:57:28 | 0:12:32 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667945 |
|
2019-03-04 15:19:41 | 2019-03-04 15:24:36 | 2019-03-04 16:34:36 | 1:10:00 | 0:55:45 | 0:14:15 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667946 |
|
2019-03-04 15:19:41 | 2019-03-04 15:24:36 | 2019-03-04 16:38:36 | 1:14:00 | 0:59:07 | 0:14:53 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:06:14.267033 osd.4 (osd.4) 302 : cluster [ERR] osd.4 pg 3.ds1 found obsolete rollback obj 1#3:b0158022:::benchmark_data_smithi135_92323_object33477:head#1253 generation < trimmed_to 352'4954...repaired" in cluster log |
||||||||||||||
| pass | 3667947 |
|
2019-03-04 15:19:41 | 2019-03-04 15:26:33 | 2019-03-04 16:42:33 | 1:16:00 | 1:09:33 | 0:06:27 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667948 |
|
2019-03-04 15:19:41 | 2019-03-04 15:26:33 | 2019-03-04 16:46:33 | 1:20:00 | 1:07:29 | 0:12:31 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667949 |
|
2019-03-04 15:19:41 | 2019-03-04 15:26:33 | 2019-03-04 16:30:33 | 1:04:00 | 0:51:56 | 0:12:04 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:08:00.765192 osd.0 (osd.0) 375 : cluster [ERR] osd.0 pg 4.6s0 found obsolete rollback obj 0#4:600c860a:::benchmark_data_smithi201_118248_object57805:head#1e70 generation < trimmed_to 400'8119...repaired" in cluster log |
||||||||||||||
| pass | 3667950 |
|
2019-03-04 15:19:41 | 2019-03-04 15:26:33 | 2019-03-04 16:38:33 | 1:12:00 | 1:02:06 | 0:09:54 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667951 |
|
2019-03-04 15:19:41 | 2019-03-04 15:26:35 | 2019-03-04 16:32:35 | 1:06:00 | 0:55:06 | 0:10:54 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:08:08.089013 osd.7 (osd.7) 455 : cluster [ERR] osd.7 pg 5.4s0 found obsolete rollback obj 0#5:2002d223:::benchmark_data_smithi121_122529_object32168:head#18d8 generation < trimmed_to 518'7801...repaired" in cluster log |
||||||||||||||
| pass | 3667952 |
|
2019-03-04 15:19:41 | 2019-03-04 15:28:38 | 2019-03-04 17:36:39 | 2:08:01 | 1:46:12 | 0:21:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667953 |
|
2019-03-04 15:19:41 | 2019-03-04 15:28:38 | 2019-03-04 16:36:38 | 1:08:00 | 1:00:38 | 0:07:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 15:52:50.168809 osd.0 (osd.0) 128 : cluster [ERR] osd.0 pg 2.10s2 found obsolete rollback obj 2#2:080d46d8:::benchmark_data_smithi158_40854_object14598:head#103c generation < trimmed_to 176'5568...repaired" in cluster log |
||||||||||||||
| pass | 3667954 |
|
2019-03-04 15:19:41 | 2019-03-04 15:30:34 | 2019-03-04 16:46:34 | 1:16:00 | 1:07:43 | 0:08:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667955 |
|
2019-03-04 15:19:41 | 2019-03-04 15:30:34 | 2019-03-04 16:38:34 | 1:08:00 | 0:58:59 | 0:09:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 15:57:39.344092 osd.2 (osd.2) 107 : cluster [ERR] osd.2 pg 2.1ds0 found obsolete rollback obj 0#2:b8c7467c:::benchmark_data_smithi118_41282_object47250:head#18db generation < trimmed_to 145'6634...repaired" in cluster log |
||||||||||||||
| fail | 3667956 |
|
2019-03-04 15:19:41 | 2019-03-04 15:30:37 | 2019-03-04 16:48:38 | 1:18:01 | 1:07:27 | 0:10:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 15:59:43.590333 osd.0 (osd.0) 136 : cluster [ERR] osd.0 pg 2.21s1 found obsolete rollback obj 1#2:84085a7e:::benchmark_data_smithi109_9276_object47749:head#1fb5 generation < trimmed_to 226'8902...repaired" in cluster log |
||||||||||||||
| fail | 3667957 |
|
2019-03-04 15:19:41 | 2019-03-04 15:30:48 | 2019-03-04 16:50:49 | 1:20:01 | 1:01:10 | 0:18:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:07:47.448200 osd.4 (osd.4) 138 : cluster [ERR] osd.4 pg 2.10s0 found obsolete rollback obj 0#2:08018bb5:::benchmark_data_smithi012_9608_object25839:head#1867 generation < trimmed_to 174'8300...repaired" in cluster log |
||||||||||||||
| pass | 3667958 |
|
2019-03-04 15:19:41 | 2019-03-04 15:32:36 | 2019-03-04 16:42:36 | 1:10:00 | 1:01:13 | 0:08:47 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667959 |
|
2019-03-04 15:19:41 | 2019-03-04 15:32:36 | 2019-03-04 16:46:36 | 1:14:00 | 1:06:05 | 0:07:55 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667960 |
|
2019-03-04 15:19:41 | 2019-03-04 15:32:36 | 2019-03-04 16:44:36 | 1:12:00 | 0:58:39 | 0:13:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667961 |
|
2019-03-04 15:19:41 | 2019-03-04 15:32:43 | 2019-03-04 16:36:44 | 1:04:01 | 0:54:55 | 0:09:06 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:07:34.100232 osd.5 (osd.5) 318 : cluster [ERR] osd.5 pg 4.5s1 found obsolete rollback obj 1#4:a76ac48d:::benchmark_data_smithi200_79990_object3100:head#19cf generation < trimmed_to 332'8255...repaired" in cluster log |
||||||||||||||
| fail | 3667962 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:33 | 2019-03-04 17:30:34 | 1:56:01 | 1:48:42 | 0:07:19 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:00:06.988014 osd.6 (osd.6) 118 : cluster [ERR] osd.6 pg 2.ds2 found obsolete rollback obj 2#2:b005996c:::benchmark_data_smithi085_9314_object36527:head#2244 generation < trimmed_to 176'11379...repaired" in cluster log |
||||||||||||||
| pass | 3667963 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:34 | 2019-03-04 16:48:34 | 1:14:00 | 0:57:16 | 0:16:44 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667964 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:34 | 2019-03-04 17:34:35 | 2:00:01 | 1:50:40 | 0:09:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:02:38.671720 osd.2 (osd.2) 150 : cluster [ERR] osd.2 pg 2.17s1 found obsolete rollback obj 1#2:e833a845:::benchmark_data_smithi189_41456_object34774:head#110b generation < trimmed_to 214'5937...repaired" in cluster log |
||||||||||||||
| fail | 3667965 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:34 | 2019-03-04 17:34:36 | 2:00:02 | 1:39:51 | 0:20:11 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:11:30.712215 osd.1 (osd.1) 129 : cluster [ERR] osd.1 pg 2.7s1 found obsolete rollback obj 1#2:e02a59b9:::benchmark_data_smithi165_9666_object28134:head#16c5 generation < trimmed_to 184'7486...repaired" in cluster log |
||||||||||||||
| fail | 3667966 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:34 | 2019-03-04 17:36:35 | 2:02:01 | 1:46:25 | 0:15:36 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:10:14.832827 osd.2 (osd.2) 140 : cluster [ERR] osd.2 pg 2.es0 found obsolete rollback obj 0#2:702f5281:::benchmark_data_smithi037_9100_object42310:head#17a3 generation < trimmed_to 150'6461...repaired" in cluster log |
||||||||||||||
| pass | 3667967 |
|
2019-03-04 15:19:41 | 2019-03-04 15:34:48 | 2019-03-04 17:34:54 | 2:00:06 | 1:45:56 | 0:14:10 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667968 |
|
2019-03-04 15:19:41 | 2019-03-04 15:35:09 | 2019-03-04 17:37:10 | 2:02:01 | 1:35:32 | 0:26:29 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667969 |
|
2019-03-04 15:19:41 | 2019-03-04 15:36:07 | 2019-03-04 17:30:08 | 1:54:01 | 1:47:53 | 0:06:08 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667970 |
|
2019-03-04 15:19:41 | 2019-03-04 15:36:29 | 2019-03-04 16:46:29 | 1:10:00 | 0:55:38 | 0:14:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667971 |
|
2019-03-04 15:19:41 | 2019-03-04 15:36:32 | 2019-03-04 16:44:33 | 1:08:01 | 1:02:12 | 0:05:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667972 |
|
2019-03-04 15:19:41 | 2019-03-04 15:36:34 | 2019-03-04 17:36:36 | 2:00:02 | 1:44:31 | 0:15:31 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:27:59.474577 osd.7 (osd.7) 48 : cluster [ERR] osd.7 pg 5.2s1 found obsolete rollback obj 1#5:40289ff4:::benchmark_data_smithi051_133533_object1930:head#d46 generation < trimmed_to 644'4300...repaired" in cluster log |
||||||||||||||
| pass | 3667973 |
|
2019-03-04 15:19:41 | 2019-03-04 15:38:15 | 2019-03-04 17:34:16 | 1:56:01 | 1:42:03 | 0:13:58 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667974 |
|
2019-03-04 15:19:41 | 2019-03-04 15:38:28 | 2019-03-04 16:44:28 | 1:06:00 | 0:57:39 | 0:08:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:10:37.147845 osd.0 (osd.0) 271 : cluster [ERR] osd.0 pg 3.10s1 found obsolete rollback obj 1#3:08887abe:::benchmark_data_smithi156_64647_object2069:head#138e generation < trimmed_to 290'6609...repaired" in cluster log |
||||||||||||||
| fail | 3667975 |
|
2019-03-04 15:19:41 | 2019-03-04 15:38:30 | 2019-03-04 17:48:32 | 2:10:02 | 1:36:30 | 0:33:32 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:26:13.664841 osd.6 (osd.6) 109 : cluster [ERR] osd.6 pg 2.9s2 found obsolete rollback obj 2#2:9000d7f0:::benchmark_data_smithi197_41284_object48865:head#206c generation < trimmed_to 137'9851...repaired" in cluster log |
||||||||||||||
| fail | 3667976 |
|
2019-03-04 15:19:41 | 2019-03-04 15:40:49 | 2019-03-04 17:38:50 | 1:58:01 | 1:50:25 | 0:07:36 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:06:42.565967 osd.7 (osd.7) 184 : cluster [ERR] osd.7 pg 2.1bs2 found obsolete rollback obj 2#2:d802e3ac:::benchmark_data_smithi060_40973_object23821:head#1a4b generation < trimmed_to 195'8933...repaired" in cluster log |
||||||||||||||
| fail | 3667977 |
|
2019-03-04 15:19:41 | 2019-03-04 15:42:37 | 2019-03-04 17:36:38 | 1:54:01 | 1:46:02 | 0:07:59 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:08:34.446911 osd.1 (osd.1) 111 : cluster [ERR] osd.1 pg 2.es2 found obsolete rollback obj 2#2:70011eaf:::benchmark_data_smithi198_9572_object64212:head#26ae generation < trimmed_to 167'10686...repaired" in cluster log |
||||||||||||||
| fail | 3667978 |
|
2019-03-04 15:19:41 | 2019-03-04 15:42:37 | 2019-03-04 16:50:37 | 1:08:00 | 1:00:06 | 0:07:54 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:08:15.663556 osd.2 (osd.2) 120 : cluster [ERR] osd.2 pg 2.18s1 found obsolete rollback obj 1#2:180fb9c5:::benchmark_data_smithi132_9149_object46217:head#f9f generation < trimmed_to 146'4396...repaired" in cluster log |
||||||||||||||
| fail | 3667979 |
|
2019-03-04 15:19:41 | 2019-03-04 15:44:37 | 2019-03-04 17:38:38 | 1:54:01 | 1:43:14 | 0:10:47 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:18:39.831392 osd.1 (osd.1) 292 : cluster [ERR] osd.1 pg 3.16s2 found obsolete rollback obj 2#3:680b10ed:::benchmark_data_smithi072_75134_object9982:head#139a generation < trimmed_to 359'6001...repaired" in cluster log |
||||||||||||||
| fail | 3667980 |
|
2019-03-04 15:19:41 | 2019-03-04 15:44:37 | 2019-03-04 17:38:38 | 1:54:01 | 1:39:00 | 0:15:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:15:25.675531 osd.5 (osd.5) 146 : cluster [ERR] osd.5 pg 2.bs0 found obsolete rollback obj 0#2:d0f3948d:::benchmark_data_smithi083_41469_object1459:head#1159 generation < trimmed_to 200'7690...repaired" in cluster log |
||||||||||||||
| fail | 3667981 |
|
2019-03-04 15:19:41 | 2019-03-04 15:44:37 | 2019-03-04 17:38:38 | 1:54:01 | 1:33:58 | 0:20:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:19:32.429351 osd.2 (osd.2) 119 : cluster [ERR] osd.2 pg 2.14s0 found obsolete rollback obj 0#2:281a0127:::benchmark_data_smithi183_40961_object7226:head#1246 generation < trimmed_to 206'5922...repaired" in cluster log |
||||||||||||||
| pass | 3667982 |
|
2019-03-04 15:19:41 | 2019-03-04 15:44:37 | 2019-03-04 17:46:39 | 2:02:02 | 1:44:39 | 0:17:23 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667983 |
|
2019-03-04 15:19:41 | 2019-03-04 15:46:37 | 2019-03-04 17:34:38 | 1:48:01 | 1:39:31 | 0:08:30 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:26:36.200480 osd.2 (osd.2) 400 : cluster [ERR] osd.2 pg 5.9s2 found obsolete rollback obj 2#5:902b64b5:::benchmark_data_smithi172_111384_object10579:head#13b5 generation < trimmed_to 517'8156...repaired" in cluster log |
||||||||||||||
| fail | 3667984 |
|
2019-03-04 15:19:41 | 2019-03-04 15:46:38 | 2019-03-04 17:34:38 | 1:48:00 | 1:35:01 | 0:12:59 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:19:14.121676 osd.5 (osd.5) 238 : cluster [ERR] osd.5 pg 3.0s0 found obsolete rollback obj 0#3:0001ef65:::benchmark_data_smithi073_44121_object34880:head#1303 generation < trimmed_to 248'5243...repaired" in cluster log |
||||||||||||||
| fail | 3667985 |
|
2019-03-04 15:19:42 | 2019-03-04 15:46:37 | 2019-03-04 17:38:38 | 1:52:01 | 1:42:47 | 0:09:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:20:17.386778 osd.7 (osd.7) 293 : cluster [ERR] osd.7 pg 3.0s1 found obsolete rollback obj 1#3:0042528d:::benchmark_data_smithi014_53604_object35315:head#1259 generation < trimmed_to 347'4958...repaired" in cluster log |
||||||||||||||
| pass | 3667986 |
|
2019-03-04 15:19:42 | 2019-03-04 15:48:38 | 2019-03-04 17:38:39 | 1:50:01 | 1:35:56 | 0:14:05 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667987 |
|
2019-03-04 15:19:42 | 2019-03-04 15:48:43 | 2019-03-04 17:38:45 | 1:50:02 | 1:37:36 | 0:12:26 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667988 |
|
2019-03-04 15:19:42 | 2019-03-04 15:52:43 | 2019-03-04 17:48:44 | 1:56:01 | 1:30:36 | 0:25:25 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:47:51.732990 osd.0 (osd.0) 415 : cluster [ERR] osd.0 pg 4.bs0 found obsolete rollback obj 0#4:d05295bf:::benchmark_data_smithi059_138985_object36412:head#14c6 generation < trimmed_to 439'6119...repaired" in cluster log |
||||||||||||||
| pass | 3667989 |
|
2019-03-04 15:19:42 | 2019-03-04 15:54:46 | 2019-03-04 17:36:47 | 1:42:01 | 1:35:24 | 0:06:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667990 |
|
2019-03-04 15:19:42 | 2019-03-04 15:54:47 | 2019-03-04 17:36:47 | 1:42:00 | 1:36:23 | 0:05:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667991 |
|
2019-03-04 15:19:42 | 2019-03-04 15:56:24 | 2019-03-04 17:50:25 | 1:54:01 | 1:23:30 | 0:30:31 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667992 |
|
2019-03-04 15:19:42 | 2019-03-04 15:56:24 | 2019-03-04 18:20:26 | 2:24:02 | 1:39:40 | 0:44:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:56:58.300187 osd.6 (osd.6) 678 : cluster [ERR] osd.6 pg 6.2s1 found obsolete rollback obj 1#6:40010416:::benchmark_data_smithi091_256383_object27293:head#1c79 generation < trimmed_to 824'8421...repaired" in cluster log |
||||||||||||||
| fail | 3667993 |
|
2019-03-04 15:19:42 | 2019-03-04 15:56:30 | 2019-03-04 17:54:30 | 1:58:00 | 1:43:54 | 0:14:06 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:26:27.668983 osd.5 (osd.5) 140 : cluster [ERR] osd.5 pg 2.28s0 found obsolete rollback obj 0#2:142e4a4b:::benchmark_data_smithi003_41321_object25943:head#15bd generation < trimmed_to 198'6630...repaired" in cluster log |
||||||||||||||
| pass | 3667994 |
|
2019-03-04 15:19:42 | 2019-03-04 15:58:37 | 2019-03-04 17:52:38 | 1:54:01 | 1:45:44 | 0:08:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667995 |
|
2019-03-04 15:19:42 | 2019-03-04 15:58:38 | 2019-03-04 17:56:39 | 1:58:01 | 1:46:47 | 0:11:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:32:37.096138 osd.0 (osd.0) 267 : cluster [ERR] osd.0 pg 3.bs0 found obsolete rollback obj 0#3:d001d246:::benchmark_data_smithi187_57504_object15410:head#1871 generation < trimmed_to 322'10178...repaired" in cluster log |
||||||||||||||
| pass | 3667996 |
|
2019-03-04 15:19:42 | 2019-03-04 16:00:49 | 2019-03-04 17:52:50 | 1:52:01 | 1:43:24 | 0:08:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3667997 |
|
2019-03-04 15:19:42 | 2019-03-04 16:04:35 | 2019-03-04 17:48:36 | 1:44:01 | 1:24:14 | 0:19:47 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3667998 |
|
2019-03-04 15:19:42 | 2019-03-04 16:04:35 | 2019-03-04 18:06:36 | 2:02:01 | 1:36:48 | 0:25:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:45:38.749743 osd.6 (osd.6) 125 : cluster [ERR] osd.6 pg 2.21s1 found obsolete rollback obj 1#2:845a3302:::benchmark_data_smithi099_40797_object302:head#161d generation < trimmed_to 255'6834...repaired" in cluster log |
||||||||||||||
| fail | 3667999 |
|
2019-03-04 15:19:42 | 2019-03-04 16:04:35 | 2019-03-04 17:44:36 | 1:40:01 | 1:26:33 | 0:13:28 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 16:51:00.860260 osd.6 (osd.6) 452 : cluster [ERR] osd.6 pg 5.16s1 found obsolete rollback obj 1#5:68340295:::benchmark_data_smithi145_159736_object51988:head#1b4f generation < trimmed_to 559'7328...repaired" in cluster log |
||||||||||||||
| pass | 3668000 |
|
2019-03-04 15:19:42 | 2019-03-04 16:12:47 | 2019-03-04 18:28:48 | 2:16:01 | 1:43:59 | 0:32:02 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668001 |
|
2019-03-04 15:19:42 | 2019-03-04 16:12:47 | 2019-03-04 18:18:48 | 2:06:01 | 1:38:08 | 0:27:53 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:54:27.997321 osd.3 (osd.3) 584 : cluster [ERR] osd.3 pg 5.1s0 found obsolete rollback obj 0#5:801c78fd:::benchmark_data_smithi204_191070_object223:head#1a37 generation < trimmed_to 632'9620...repaired" in cluster log |
||||||||||||||
| fail | 3668002 |
|
2019-03-04 15:19:42 | 2019-03-04 16:20:41 | 2019-03-04 17:58:42 | 1:38:01 | 1:29:02 | 0:08:59 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:31:54.930735 osd.3 (osd.3) 283 : cluster [ERR] osd.3 pg 5.0s2 found obsolete rollback obj 2#5:0000733e:::benchmark_data_smithi171_170454_object6175:head#160f generation < trimmed_to 362'7754...repaired" in cluster log |
||||||||||||||
| pass | 3668003 |
|
2019-03-04 15:19:42 | 2019-03-04 16:20:41 | 2019-03-04 17:48:42 | 1:28:01 | 1:19:21 | 0:08:40 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668004 |
|
2019-03-04 15:19:42 | 2019-03-04 16:22:39 | 2019-03-04 18:10:40 | 1:48:01 | 1:33:16 | 0:14:45 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:33:10.053101 osd.0 (osd.0) 275 : cluster [ERR] osd.0 pg 3.10s1 found obsolete rollback obj 1#3:0807e7af:::benchmark_data_smithi097_33626_object8385:head#186a generation < trimmed_to 268'9260...repaired" in cluster log |
||||||||||||||
| fail | 3668005 |
|
2019-03-04 15:19:42 | 2019-03-04 16:24:49 | 2019-03-04 18:24:50 | 2:00:01 | 1:41:56 | 0:18:05 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:41:43.394690 osd.4 (osd.4) 281 : cluster [ERR] osd.4 pg 3.27s1 found obsolete rollback obj 1#3:e4323c7d:::benchmark_data_smithi158_104724_object30652:head#e9b generation < trimmed_to 327'4438...repaired" in cluster log |
||||||||||||||
| pass | 3668006 |
|
2019-03-04 15:19:42 | 2019-03-04 16:28:49 | 2019-03-04 18:14:50 | 1:46:01 | 1:31:29 | 0:14:32 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3668007 |
|
2019-03-04 15:19:42 | 2019-03-04 16:30:46 | 2019-03-04 18:14:47 | 1:44:01 | 1:38:10 | 0:05:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3668008 |
|
2019-03-04 15:19:42 | 2019-03-04 16:32:49 | 2019-03-04 18:22:50 | 1:50:01 | 0:51:05 | 0:58:56 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668009 |
|
2019-03-04 15:19:42 | 2019-03-04 16:34:19 | 2019-03-04 18:32:26 | 1:58:07 | 1:00:24 | 0:57:43 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:48:10.349517 osd.2 (osd.2) 135 : cluster [ERR] osd.2 pg 2.3ds2 found obsolete rollback obj 2#2:bc3792fc:::benchmark_data_smithi100_24597_object57670:head#13c9 generation < trimmed_to 198'5219...repaired" in cluster log |
||||||||||||||
| pass | 3668010 |
|
2019-03-04 15:19:42 | 2019-03-04 16:34:37 | 2019-03-04 18:36:38 | 2:02:01 | 1:54:37 | 0:07:24 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668011 |
|
2019-03-04 15:19:42 | 2019-03-04 16:34:37 | 2019-03-04 18:24:39 | 1:50:02 | 1:32:41 | 0:17:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 18:03:31.200285 osd.0 (osd.0) 680 : cluster [ERR] osd.0 pg 6.cs0 found obsolete rollback obj 0#6:31372647:::benchmark_data_smithi133_193530_object46399:head#1774 generation < trimmed_to 798'6025...repaired" in cluster log |
||||||||||||||
| pass | 3668012 |
|
2019-03-04 15:19:42 | 2019-03-04 16:36:54 | 2019-03-04 18:37:10 | 2:00:16 | 1:45:27 | 0:14:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3668013 |
|
2019-03-04 15:19:42 | 2019-03-04 16:36:54 | 2019-03-04 18:13:09 | 1:36:15 | 1:29:21 | 0:06:54 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668014 |
|
2019-03-04 15:19:42 | 2019-03-04 16:36:54 | 2019-03-04 18:31:10 | 1:54:16 | 1:45:55 | 0:08:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:39:09.218449 osd.7 (osd.7) 110 : cluster [ERR] osd.7 pg 2.19s2 found obsolete rollback obj 2#2:981e5bee:::benchmark_data_smithi150_10619_object44387:head#f73 generation < trimmed_to 147'4530...repaired" in cluster log |
||||||||||||||
| fail | 3668015 |
|
2019-03-04 15:19:42 | 2019-03-04 16:39:09 | 2019-03-04 18:35:10 | 1:56:01 | 1:43:48 | 0:12:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 18:16:29.112035 osd.1 (osd.1) 940 : cluster [ERR] osd.1 pg 6.20s0 found obsolete rollback obj 0#6:04c17588:::benchmark_data_smithi137_288475_object29606:head#1747 generation < trimmed_to 939'6260...repaired" in cluster log |
||||||||||||||
| pass | 3668016 |
|
2019-03-04 15:19:42 | 2019-03-04 16:39:09 | 2019-03-04 18:17:09 | 1:38:00 | 1:26:47 | 0:11:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3668017 |
|
2019-03-04 15:19:42 | 2019-03-04 16:39:09 | 2019-03-04 18:41:10 | 2:02:01 | 1:00:06 | 1:01:55 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3668018 |
|
2019-03-04 15:19:42 | 2019-03-04 16:42:58 | 2019-03-04 18:18:59 | 1:36:01 | 1:28:31 | 0:07:30 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668019 |
|
2019-03-04 15:19:42 | 2019-03-04 16:42:58 | 2019-03-04 18:26:59 | 1:44:01 | 1:35:57 | 0:08:04 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:39:15.109321 osd.3 (osd.3) 120 : cluster [ERR] osd.3 pg 2.15s2 found obsolete rollback obj 2#2:a8116cef:::benchmark_data_smithi006_10728_object9164:head#1637 generation < trimmed_to 150'7330...repaired" in cluster log |
||||||||||||||
| fail | 3668020 |
|
2019-03-04 15:19:42 | 2019-03-04 16:42:58 | 2019-03-04 18:28:59 | 1:46:01 | 1:36:54 | 0:09:07 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:59:04.510799 osd.0 (osd.0) 564 : cluster [ERR] osd.0 pg 5.bs0 found obsolete rollback obj 0#5:d0085fc3:::benchmark_data_smithi193_181143_object44257:head#1d5e generation < trimmed_to 609'9139...repaired" in cluster log |
||||||||||||||
| fail | 3668021 |
|
2019-03-04 15:19:42 | 2019-03-04 16:42:58 | 2019-03-04 18:16:59 | 1:34:01 | 1:25:44 | 0:08:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:39:23.522153 osd.1 (osd.1) 113 : cluster [ERR] osd.1 pg 2.es0 found obsolete rollback obj 0#2:701bae93:::benchmark_data_smithi173_24312_object52055:head#1d32 generation < trimmed_to 142'7677...repaired" in cluster log |
||||||||||||||
| fail | 3668022 |
|
2019-03-04 15:19:42 | 2019-03-04 16:44:49 | 2019-03-04 18:28:49 | 1:44:00 | 1:31:29 | 0:12:31 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:41:49.329315 osd.4 (osd.4) 156 : cluster [ERR] osd.4 pg 2.2s1 found obsolete rollback obj 1#2:41892175:::benchmark_data_smithi182_23597_object1194:head#1109 generation < trimmed_to 199'5021...repaired" in cluster log |
||||||||||||||
| fail | 3668023 |
|
2019-03-04 15:19:42 | 2019-03-04 16:44:49 | 2019-03-04 18:34:50 | 1:50:01 | 1:04:00 | 0:46:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:58:45.044614 osd.0 (osd.0) 393 : cluster [ERR] osd.0 pg 4.1as2 found obsolete rollback obj 2#4:581d9731:::benchmark_data_smithi109_112649_object7822:head#126a generation < trimmed_to 423'6119...repaired" in cluster log |
||||||||||||||
| pass | 3668024 |
|
2019-03-04 15:19:42 | 2019-03-04 16:44:49 | 2019-03-04 18:20:49 | 1:36:00 | 0:49:38 | 0:46:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668025 |
|
2019-03-04 15:19:42 | 2019-03-04 16:46:45 | 2019-03-04 18:35:44 | 1:48:59 | 1:05:02 | 0:43:57 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:47:33.325231 osd.2 (osd.2) 21 : cluster [ERR] osd.2 pg 2.17s2 found obsolete rollback obj 2#2:e805a437:::benchmark_data_smithi153_24925_object37897:head#14ae generation < trimmed_to 140'5645...repaired" in cluster log |
||||||||||||||
| fail | 3668026 |
|
2019-03-04 15:19:42 | 2019-03-04 16:46:46 | 2019-03-04 18:46:47 | 2:00:01 | 1:05:58 | 0:54:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:57:12.599612 osd.2 (osd.2) 107 : cluster [ERR] osd.2 pg 2.as1 found obsolete rollback obj 1#2:50184dea:::benchmark_data_smithi067_41019_object21898:head#19ed generation < trimmed_to 141'8705...repaired" in cluster log |
||||||||||||||
| fail | 3668027 |
|
2019-03-04 15:19:43 | 2019-03-04 16:46:45 | 2019-03-04 18:33:43 | 1:46:58 | 1:02:32 | 0:44:26 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 18:00:07.393452 osd.3 (osd.3) 99 : cluster [ERR] osd.3 pg 4.1fs0 found obsolete rollback obj 0#4:f8138184:::benchmark_data_smithi188_116454_object50114:head#1952 generation < trimmed_to 546'6542...repaired" in cluster log |
||||||||||||||
| pass | 3668028 |
|
2019-03-04 15:19:43 | 2019-03-04 16:46:45 | 2019-03-04 18:40:46 | 1:54:01 | 1:00:19 | 0:53:42 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668029 |
|
2019-03-04 15:19:43 | 2019-03-04 16:49:43 | 2019-03-04 18:33:34 | 1:43:51 | 0:57:35 | 0:46:16 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:52:54.188109 osd.7 (osd.7) 58 : cluster [ERR] osd.7 pg 2.bs2 found obsolete rollback obj 2#2:d00c3bdf:::benchmark_data_smithi049_40989_object58506:head#2071 generation < trimmed_to 168'8902...repaired" in cluster log |
||||||||||||||
| pass | 3668030 |
|
2019-03-04 15:19:43 | 2019-03-04 16:49:43 | 2019-03-04 18:49:35 | 1:59:52 | 1:09:28 | 0:50:24 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668031 |
|
2019-03-04 15:19:43 | 2019-03-04 16:55:45 | 2019-03-04 18:41:49 | 1:46:04 | 1:05:15 | 0:40:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:53:24.994895 osd.5 (osd.5) 182 : cluster [ERR] osd.5 pg 2.17s1 found obsolete rollback obj 1#2:e80761e6:::benchmark_data_smithi132_41126_object72811:head#2b61 generation < trimmed_to 218'12184...repaired" in cluster log |
||||||||||||||
| fail | 3668032 |
|
2019-03-04 15:19:43 | 2019-03-04 16:55:45 | 2019-03-04 18:43:49 | 1:48:04 | 1:02:56 | 0:45:08 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:58:14.197786 osd.2 (osd.2) 134 : cluster [ERR] osd.2 pg 2.1s0 found obsolete rollback obj 0#2:8003d549:::benchmark_data_smithi172_40910_object4109:head#1c78 generation < trimmed_to 160'10025...repaired" in cluster log |
||||||||||||||
| pass | 3668033 |
|
2019-03-04 15:19:43 | 2019-03-04 17:30:17 | 2019-03-04 18:32:18 | 1:02:01 | 0:51:52 | 0:10:09 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3668034 |
|
2019-03-04 15:19:43 | 2019-03-04 17:30:38 | 2019-03-04 18:38:36 | 1:07:58 | 0:58:20 | 0:09:38 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 18:00:38.208310 osd.2 (osd.2) 191 : cluster [ERR] osd.2 pg 3.21s0 found obsolete rollback obj 0#3:8474f212:::benchmark_data_smithi012_68569_object10663:head#f2f generation < trimmed_to 289'4834...repaired" in cluster log |
||||||||||||||
| fail | 3668035 |
|
2019-03-04 15:19:43 | 2019-03-04 17:34:37 | 2019-03-04 18:50:37 | 1:16:00 | 1:07:15 | 0:08:45 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:58:29.189093 osd.7 (osd.7) 103 : cluster [ERR] osd.7 pg 2.18s2 found obsolete rollback obj 2#2:185de91d:::benchmark_data_smithi202_41262_object2153:head#149a generation < trimmed_to 133'6337...repaired" in cluster log |
||||||||||||||
| fail | 3668036 |
|
2019-03-04 15:19:43 | 2019-03-04 17:34:37 | 2019-03-04 18:50:37 | 1:16:00 | 1:08:43 | 0:07:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:59:11.826223 osd.3 (osd.3) 135 : cluster [ERR] osd.3 pg 2.14s2 found obsolete rollback obj 2#2:28628c33:::benchmark_data_smithi198_40928_object69515:head#18bc generation < trimmed_to 175'6639...repaired" in cluster log |
||||||||||||||
| fail | 3668037 |
|
2019-03-04 15:19:43 | 2019-03-04 17:34:37 | 2019-03-04 18:52:38 | 1:18:01 | 1:09:55 | 0:08:06 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 18:04:30.986539 osd.6 (osd.6) 258 : cluster [ERR] osd.6 pg 3.20s0 found obsolete rollback obj 0#3:040976b4:::benchmark_data_smithi005_44186_object34965:head#1a41 generation < trimmed_to 315'7523...repaired" in cluster log |
||||||||||||||
| fail | 3668038 |
|
2019-03-04 15:19:43 | 2019-03-04 17:34:39 | 2019-03-04 18:48:40 | 1:14:01 | 1:06:32 | 0:07:29 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-03-04 17:59:41.468160 osd.7 (osd.7) 134 : cluster [ERR] osd.7 pg 2.es2 found obsolete rollback obj 2#2:7008cd2b:::benchmark_data_smithi181_40796_object27885:head#1f90 generation < trimmed_to 168'11795...repaired" in cluster log |
||||||||||||||
Pulpito