| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| nojha | 2019-02-23 05:02:39 | 2019-02-23 05:04:03 | 2019-02-23 08:31:29 | 3:27:26 | rados:thrash-erasure-code | wip-3-36739-2019-02-22 | smithi | f3882dc | 55 | 45 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 3630271 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:02 | 2019-02-23 06:10:01 | 1:05:59 | 0:58:21 | 0:07:38 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630272 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:03 | 2019-02-23 06:16:02 | 1:11:59 | 1:05:08 | 0:06:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630273 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:03 | 2019-02-23 06:06:02 | 1:01:59 | 0:55:43 | 0:06:16 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630274 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:03 | 2019-02-23 06:18:03 | 1:14:00 | 1:06:55 | 0:07:05 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630275 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:03 | 2019-02-23 06:14:03 | 1:10:00 | 1:03:23 | 0:06:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:48:37.775765 osd.6 (osd.6) 586 : cluster [ERR] osd.6 pg 5.fs2 found obsolete rollback obj 2#5:fb046967:::benchmark_data_smithi059_189035_object56828:head#2825 generation < trimmed_to 720'12724...repaired" in cluster log |
||||||||||||||
| fail | 3630276 |
|
2019-02-23 05:02:44 | 2019-02-23 05:04:02 | 2019-02-23 06:20:02 | 1:16:00 | 1:10:02 | 0:05:58 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:34:13.869062 osd.2 (osd.2) 264 : cluster [ERR] osd.2 pg 3.0s2 found obsolete rollback obj 2#3:0c34f340:::benchmark_data_smithi179_88617_object31110:head#14b3 generation < trimmed_to 318'5820...repaired" in cluster log |
||||||||||||||
| fail | 3630277 |
|
2019-02-23 05:02:44 | 2019-02-23 05:05:36 | 2019-02-23 06:17:36 | 1:12:00 | 1:05:56 | 0:06:04 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:29:09.800703 osd.7 (osd.7) 116 : cluster [ERR] osd.7 pg 2.es0 found obsolete rollback obj 0#2:77c2da72:::benchmark_data_smithi129_41686_object10124:head#1616 generation < trimmed_to 170'8889...repaired" in cluster log |
||||||||||||||
| fail | 3630278 |
|
2019-02-23 05:02:44 | 2019-02-23 05:05:36 | 2019-02-23 06:37:37 | 1:32:01 | 1:24:51 | 0:07:10 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:30:59.731169 osd.0 (osd.0) 151 : cluster [ERR] osd.0 pg 2.2as1 found obsolete rollback obj 1#2:568ea7a9:::benchmark_data_smithi002_8980_object47321:head#1737 generation < trimmed_to 211'6201...repaired" in cluster log |
||||||||||||||
| pass | 3630279 |
|
2019-02-23 05:02:44 | 2019-02-23 05:07:27 | 2019-02-23 06:25:28 | 1:18:01 | 1:10:50 | 0:07:11 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630280 |
|
2019-02-23 05:02:44 | 2019-02-23 05:07:27 | 2019-02-23 06:09:27 | 1:02:00 | 0:54:52 | 0:07:08 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630281 |
|
2019-02-23 05:02:44 | 2019-02-23 05:07:28 | 2019-02-23 06:13:28 | 1:06:00 | 0:59:23 | 0:06:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630282 |
|
2019-02-23 05:02:44 | 2019-02-23 05:07:28 | 2019-02-23 06:15:28 | 1:08:00 | 1:00:31 | 0:07:29 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630283 |
|
2019-02-23 05:02:44 | 2019-02-23 05:09:26 | 2019-02-23 06:21:26 | 1:12:00 | 1:05:18 | 0:06:42 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630284 |
|
2019-02-23 05:02:44 | 2019-02-23 05:09:26 | 2019-02-23 06:19:26 | 1:10:00 | 1:03:46 | 0:06:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630285 |
|
2019-02-23 05:02:44 | 2019-02-23 05:09:26 | 2019-02-23 06:27:26 | 1:18:00 | 1:11:45 | 0:06:15 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:41:30.749655 osd.2 (osd.2) 256 : cluster [ERR] osd.2 pg 3.cs2 found obsolete rollback obj 2#3:35aa5b59:::benchmark_data_smithi203_58485_object520:head#194a generation < trimmed_to 302'11091...repaired" in cluster log |
||||||||||||||
| pass | 3630286 |
|
2019-02-23 05:02:44 | 2019-02-23 05:09:26 | 2019-02-23 06:15:26 | 1:06:00 | 0:58:18 | 0:07:42 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630287 |
|
2019-02-23 05:02:44 | 2019-02-23 05:09:26 | 2019-02-23 06:11:27 | 1:02:01 | 0:56:40 | 0:05:21 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630288 |
|
2019-02-23 05:02:44 | 2019-02-23 05:11:27 | 2019-02-23 06:15:27 | 1:04:00 | 0:56:26 | 0:07:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630289 |
|
2019-02-23 05:02:44 | 2019-02-23 05:11:27 | 2019-02-23 06:21:27 | 1:10:00 | 1:04:47 | 0:05:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630290 |
|
2019-02-23 05:02:44 | 2019-02-23 05:11:27 | 2019-02-23 06:41:27 | 1:30:00 | 1:23:15 | 0:06:45 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:10:28.100386 osd.2 (osd.2) 801 : cluster [ERR] osd.2 pg 5.4s1 found obsolete rollback obj 1#5:2cc07ff8:::benchmark_data_smithi175_234221_object36161:head#2034 generation < trimmed_to 874'11630...repaired" in cluster log |
||||||||||||||
| pass | 3630291 |
|
2019-02-23 05:02:44 | 2019-02-23 05:11:27 | 2019-02-23 06:23:27 | 1:12:00 | 1:05:09 | 0:06:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630292 |
|
2019-02-23 05:02:44 | 2019-02-23 05:11:32 | 2019-02-23 06:23:32 | 1:12:00 | 1:06:30 | 0:05:30 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630293 |
|
2019-02-23 05:02:44 | 2019-02-23 05:13:34 | 2019-02-23 06:19:33 | 1:05:59 | 0:59:56 | 0:06:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:00:40.930160 osd.2 (osd.2) 648 : cluster [ERR] osd.2 pg 6.ds1 found obsolete rollback obj 1#6:bb233f3e:::benchmark_data_smithi112_167773_object45275:head#21e8 generation < trimmed_to 754'11452...repaired" in cluster log |
||||||||||||||
| fail | 3630294 |
|
2019-02-23 05:02:44 | 2019-02-23 05:13:34 | 2019-02-23 06:19:34 | 1:06:00 | 1:00:23 | 0:05:37 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:44:59.479413 osd.7 (osd.7) 249 : cluster [ERR] osd.7 pg 3.0s1 found obsolete rollback obj 1#3:00b36165:::benchmark_data_smithi154_48139_object38701:head#151a generation < trimmed_to 263'5797...repaired" in cluster log |
||||||||||||||
| fail | 3630295 |
|
2019-02-23 05:02:44 | 2019-02-23 05:13:34 | 2019-02-23 06:23:33 | 1:09:59 | 1:03:42 | 0:06:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:51:11.967273 osd.2 (osd.2) 93 : cluster [ERR] osd.2 pg 4.19s2 found obsolete rollback obj 2#4:9d8d7d45:::benchmark_data_smithi101_122006_object28389:head#14c5 generation < trimmed_to 416'6902...repaired" in cluster log |
||||||||||||||
| fail | 3630296 |
|
2019-02-23 05:02:44 | 2019-02-23 05:13:34 | 2019-02-23 06:35:34 | 1:22:00 | 1:15:35 | 0:06:25 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:48:40.693339 osd.1 (osd.1) 330 : cluster [ERR] osd.1 pg 3.16s2 found obsolete rollback obj 2#3:695238fd:::benchmark_data_smithi121_86191_object47948:head#1a92 generation < trimmed_to 328'7232...repaired" in cluster log |
||||||||||||||
| fail | 3630297 |
|
2019-02-23 05:02:44 | 2019-02-23 05:13:33 | 2019-02-23 06:23:33 | 1:10:00 | 1:02:37 | 0:07:23 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:40:24.979354 osd.3 (osd.3) 151 : cluster [ERR] osd.3 pg 2.1es0 found obsolete rollback obj 0#2:7a545a3d:::benchmark_data_smithi192_9082_object65883:head#264d generation < trimmed_to 189'10403...repaired" in cluster log |
||||||||||||||
| pass | 3630298 |
|
2019-02-23 05:02:44 | 2019-02-23 05:14:23 | 2019-02-23 06:30:23 | 1:16:00 | 1:08:57 | 0:07:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630299 |
|
2019-02-23 05:02:44 | 2019-02-23 05:15:20 | 2019-02-23 06:33:21 | 1:18:01 | 1:10:51 | 0:07:10 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630300 |
|
2019-02-23 05:02:44 | 2019-02-23 05:17:20 | 2019-02-23 06:33:20 | 1:16:00 | 1:09:36 | 0:06:24 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630301 |
|
2019-02-23 05:02:45 | 2019-02-23 05:17:21 | 2019-02-23 06:25:20 | 1:07:59 | 1:01:14 | 0:06:45 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:51:51.146522 osd.5 (osd.5) 299 : cluster [ERR] osd.5 pg 3.as2 found obsolete rollback obj 2#3:54762f11:::benchmark_data_smithi139_101992_object49081:head#113b generation < trimmed_to 361'4425...repaired" in cluster log |
||||||||||||||
| fail | 3630302 |
|
2019-02-23 05:02:45 | 2019-02-23 05:17:20 | 2019-02-23 06:43:21 | 1:26:01 | 1:18:47 | 0:07:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:03:22.806056 osd.2 (osd.2) 624 : cluster [ERR] osd.2 pg 4.1as0 found obsolete rollback obj 0#4:58be9724:::benchmark_data_smithi082_180194_object29909:head#1b96 generation < trimmed_to 634'9010...repaired" in cluster log |
||||||||||||||
| fail | 3630303 |
|
2019-02-23 05:02:45 | 2019-02-23 05:17:20 | 2019-02-23 06:15:20 | 0:58:00 | 0:52:09 | 0:05:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:47:26.961191 osd.1 (osd.1) 218 : cluster [ERR] osd.1 pg 3.as2 found obsolete rollback obj 2#3:579a1ecc:::benchmark_data_smithi172_42522_object46843:head#18d1 generation < trimmed_to 271'6914...repaired" in cluster log |
||||||||||||||
| pass | 3630304 |
|
2019-02-23 05:02:45 | 2019-02-23 05:17:32 | 2019-02-23 06:35:32 | 1:18:00 | 1:11:56 | 0:06:04 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630305 |
|
2019-02-23 05:02:45 | 2019-02-23 05:19:36 | 2019-02-23 06:39:36 | 1:20:00 | 1:13:53 | 0:06:07 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630306 |
|
2019-02-23 05:02:45 | 2019-02-23 05:23:33 | 2019-02-23 06:37:33 | 1:14:00 | 1:06:43 | 0:07:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:00:27.904647 osd.2 (osd.2) 447 : cluster [ERR] osd.2 pg 4.as0 found obsolete rollback obj 0#4:504169ee:::benchmark_data_smithi095_100593_object11829:head#1b3d generation < trimmed_to 528'9649...repaired" in cluster log |
||||||||||||||
| fail | 3630307 |
|
2019-02-23 05:02:45 | 2019-02-23 05:25:26 | 2019-02-23 06:27:27 | 1:02:01 | 0:55:28 | 0:06:33 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:06:34.383705 osd.3 (osd.3) 648 : cluster [ERR] osd.3 pg 6.es1 found obsolete rollback obj 1#6:702b202e:::benchmark_data_smithi042_196634_object3998:head#1605 generation < trimmed_to 689'8623...repaired" in cluster log |
||||||||||||||
| pass | 3630308 |
|
2019-02-23 05:02:45 | 2019-02-23 05:25:27 | 2019-02-23 06:29:28 | 1:04:01 | 0:57:23 | 0:06:38 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630309 |
|
2019-02-23 05:02:45 | 2019-02-23 05:27:09 | 2019-02-23 06:27:09 | 1:00:00 | 0:54:04 | 0:05:56 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 05:49:36.359099 osd.4 (osd.4) 121 : cluster [ERR] osd.4 pg 2.22s1 found obsolete rollback obj 1#2:45c3f03e:::benchmark_data_smithi017_41073_object4304:head#1241 generation < trimmed_to 190'5952...repaired" in cluster log |
||||||||||||||
| pass | 3630310 |
|
2019-02-23 05:02:45 | 2019-02-23 05:27:19 | 2019-02-23 06:29:19 | 1:02:00 | 0:54:40 | 0:07:20 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630311 |
|
2019-02-23 05:02:45 | 2019-02-23 05:29:32 | 2019-02-23 06:47:32 | 1:18:00 | 1:10:59 | 0:07:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630312 |
|
2019-02-23 05:02:45 | 2019-02-23 05:29:32 | 2019-02-23 06:43:32 | 1:14:00 | 1:07:40 | 0:06:20 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630313 |
|
2019-02-23 05:02:45 | 2019-02-23 05:32:03 | 2019-02-23 06:40:03 | 1:08:00 | 1:01:35 | 0:06:25 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630314 |
|
2019-02-23 05:02:45 | 2019-02-23 05:34:12 | 2019-02-23 06:52:13 | 1:18:01 | 1:11:54 | 0:06:07 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:02:42.796903 osd.7 (osd.7) 250 : cluster [ERR] osd.7 pg 3.7s0 found obsolete rollback obj 0#3:e3d9e6b4:::benchmark_data_smithi049_75218_object18557:head#1951 generation < trimmed_to 320'10061...repaired" in cluster log |
||||||||||||||
| pass | 3630315 |
|
2019-02-23 05:02:45 | 2019-02-23 05:35:39 | 2019-02-23 06:51:39 | 1:16:00 | 1:08:12 | 0:07:48 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630316 |
|
2019-02-23 05:02:45 | 2019-02-23 05:36:22 | 2019-02-23 06:40:22 | 1:04:00 | 0:56:34 | 0:07:26 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630317 |
|
2019-02-23 05:02:45 | 2019-02-23 05:51:38 | 2019-02-23 06:51:38 | 1:00:00 | 0:53:54 | 0:06:06 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630318 |
|
2019-02-23 05:02:45 | 2019-02-23 05:55:36 | 2019-02-23 06:55:36 | 1:00:00 | 0:52:43 | 0:07:17 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630319 |
|
2019-02-23 05:02:45 | 2019-02-23 06:05:37 | 2019-02-23 07:07:37 | 1:02:00 | 0:56:02 | 0:05:58 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:30:56.003807 osd.0 (osd.0) 179 : cluster [ERR] osd.0 pg 3.23s2 found obsolete rollback obj 2#3:c7ec84a5:::benchmark_data_smithi109_39241_object16028:head#f09 generation < trimmed_to 268'4602...repaired" in cluster log |
||||||||||||||
| fail | 3630320 |
|
2019-02-23 05:02:45 | 2019-02-23 06:05:37 | 2019-02-23 07:31:38 | 1:26:01 | 1:18:02 | 0:07:59 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:34:48.429681 osd.6 (osd.6) 278 : cluster [ERR] osd.6 pg 3.21s2 found obsolete rollback obj 2#3:85c4f8bd:::benchmark_data_smithi116_56555_object7521:head#f16 generation < trimmed_to 353'4619...repaired" in cluster log |
||||||||||||||
| fail | 3630321 |
|
2019-02-23 05:02:45 | 2019-02-23 06:06:03 | 2019-02-23 07:10:03 | 1:04:00 | 0:56:05 | 0:07:55 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:27:36.210967 osd.0 (osd.0) 113 : cluster [ERR] osd.0 pg 2.14s1 found obsolete rollback obj 1#2:2f1afa7d:::benchmark_data_smithi104_8915_object51501:head#1106 generation < trimmed_to 125'4706...repaired" in cluster log |
||||||||||||||
| pass | 3630322 |
|
2019-02-23 05:02:45 | 2019-02-23 06:09:42 | 2019-02-23 07:19:42 | 1:10:00 | 1:02:58 | 0:07:02 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630323 |
|
2019-02-23 05:02:45 | 2019-02-23 06:10:04 | 2019-02-23 07:10:06 | 1:00:02 | 0:53:28 | 0:06:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:30:53.245921 osd.0 (osd.0) 97 : cluster [ERR] osd.0 pg 2.1fs0 found obsolete rollback obj 0#2:fd669388:::benchmark_data_smithi199_9114_object49312:head#1a2f generation < trimmed_to 121'6847...repaired" in cluster log |
||||||||||||||
| fail | 3630324 |
|
2019-02-23 05:02:45 | 2019-02-23 06:11:45 | 2019-02-23 07:11:45 | 1:00:00 | 0:53:08 | 0:06:52 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:34:45.378334 osd.4 (osd.4) 104 : cluster [ERR] osd.4 pg 2.fs0 found obsolete rollback obj 0#2:f99d01d5:::benchmark_data_smithi190_40991_object37482:head#14fe generation < trimmed_to 122'5652...repaired" in cluster log |
||||||||||||||
| pass | 3630325 |
|
2019-02-23 05:02:45 | 2019-02-23 06:13:40 | 2019-02-23 07:21:41 | 1:08:01 | 1:00:27 | 0:07:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630326 |
|
2019-02-23 05:02:45 | 2019-02-23 06:14:04 | 2019-02-23 07:18:04 | 1:04:00 | 0:55:41 | 0:08:19 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630327 |
|
2019-02-23 05:02:45 | 2019-02-23 06:15:33 | 2019-02-23 07:25:33 | 1:10:00 | 1:03:00 | 0:07:00 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:38:24.116171 osd.4 (osd.4) 98 : cluster [ERR] osd.4 pg 2.as2 found obsolete rollback obj 2#2:5de7bae4:::benchmark_data_smithi172_8838_object44443:head#188b generation < trimmed_to 123'6771...repaired" in cluster log |
||||||||||||||
| pass | 3630328 |
|
2019-02-23 05:02:45 | 2019-02-23 06:15:33 | 2019-02-23 07:31:34 | 1:16:01 | 1:09:07 | 0:06:54 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630329 |
|
2019-02-23 05:02:45 | 2019-02-23 06:15:33 | 2019-02-23 07:33:34 | 1:18:01 | 1:11:02 | 0:06:59 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630330 |
|
2019-02-23 05:02:45 | 2019-02-23 06:15:33 | 2019-02-23 07:23:33 | 1:08:00 | 1:00:11 | 0:07:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630331 |
|
2019-02-23 05:02:45 | 2019-02-23 06:16:04 | 2019-02-23 07:18:04 | 1:02:00 | 0:54:02 | 0:07:58 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:43:31.055247 osd.2 (osd.2) 202 : cluster [ERR] osd.2 pg 3.fs1 found obsolete rollback obj 1#3:f532bd88:::benchmark_data_smithi181_72291_object25556:head#17a0 generation < trimmed_to 237'8759...repaired" in cluster log |
||||||||||||||
| pass | 3630332 |
|
2019-02-23 05:02:45 | 2019-02-23 06:17:38 | 2019-02-23 07:19:38 | 1:02:00 | 0:55:59 | 0:06:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630333 |
|
2019-02-23 05:02:45 | 2019-02-23 06:18:23 | 2019-02-23 07:32:23 | 1:14:00 | 1:07:37 | 0:06:23 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630334 |
|
2019-02-23 05:02:45 | 2019-02-23 06:19:42 | 2019-02-23 07:23:42 | 1:04:00 | 0:57:26 | 0:06:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:52:56.863005 osd.6 (osd.6) 129 : cluster [ERR] osd.6 pg 4.13s2 found obsolete rollback obj 2#4:cea77181:::benchmark_data_smithi154_78978_object43597:head#17f9 generation < trimmed_to 392'6200...repaired" in cluster log |
||||||||||||||
| pass | 3630335 |
|
2019-02-23 05:02:45 | 2019-02-23 06:19:43 | 2019-02-23 07:39:44 | 1:20:01 | 1:13:47 | 0:06:14 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630336 |
|
2019-02-23 05:02:45 | 2019-02-23 06:19:42 | 2019-02-23 07:37:43 | 1:18:01 | 1:10:56 | 0:07:05 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630337 |
|
2019-02-23 05:02:45 | 2019-02-23 06:20:04 | 2019-02-23 07:26:04 | 1:06:00 | 1:00:27 | 0:05:33 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630338 |
|
2019-02-23 05:02:45 | 2019-02-23 06:21:40 | 2019-02-23 07:35:40 | 1:14:00 | 1:06:45 | 0:07:15 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:49:20.660910 osd.2 (osd.2) 211 : cluster [ERR] osd.2 pg 3.5s0 found obsolete rollback obj 0#3:ad90f61c:::benchmark_data_smithi192_70974_object51287:head#249a generation < trimmed_to 293'11757...repaired" in cluster log |
||||||||||||||
| fail | 3630339 |
|
2019-02-23 05:02:45 | 2019-02-23 06:21:40 | 2019-02-23 07:23:40 | 1:02:00 | 0:54:57 | 0:07:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:44:01.699340 osd.2 (osd.2) 101 : cluster [ERR] osd.2 pg 2.ds0 found obsolete rollback obj 0#2:b0f78e6a:::benchmark_data_smithi170_8764_object61696:head#201a generation < trimmed_to 114'8489...repaired" in cluster log |
||||||||||||||
| fail | 3630340 |
|
2019-02-23 05:02:45 | 2019-02-23 06:23:40 | 2019-02-23 07:39:41 | 1:16:01 | 1:10:00 | 0:06:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:15:43.932922 osd.6 (osd.6) 846 : cluster [ERR] osd.6 pg 6.1ds0 found obsolete rollback obj 0#6:bb864b58:::benchmark_data_smithi202_221146_object4845:head#dd3 generation < trimmed_to 912'4440...repaired" in cluster log |
||||||||||||||
| pass | 3630341 |
|
2019-02-23 05:02:46 | 2019-02-23 06:23:41 | 2019-02-23 07:23:40 | 0:59:59 | 0:53:07 | 0:06:52 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630342 |
|
2019-02-23 05:02:46 | 2019-02-23 06:23:41 | 2019-02-23 07:47:41 | 1:24:00 | 1:16:38 | 0:07:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:48:51.404852 osd.5 (osd.5) 132 : cluster [ERR] osd.5 pg 2.fs1 found obsolete rollback obj 1#2:fd8c6de6:::benchmark_data_smithi176_41046_object55614:head#227d generation < trimmed_to 206'10691...repaired" in cluster log |
||||||||||||||
| fail | 3630343 |
|
2019-02-23 05:02:46 | 2019-02-23 06:23:41 | 2019-02-23 07:35:41 | 1:12:00 | 1:04:36 | 0:07:24 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:47:41.423510 osd.0 (osd.0) 136 : cluster [ERR] osd.0 pg 2.5s0 found obsolete rollback obj 0#2:a4ca5fb0:::benchmark_data_smithi178_9405_object94404:head#3156 generation < trimmed_to 197'13266...repaired" in cluster log |
||||||||||||||
| pass | 3630344 |
|
2019-02-23 05:02:46 | 2019-02-23 06:25:37 | 2019-02-23 07:37:38 | 1:12:01 | 1:05:39 | 0:06:22 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630345 |
|
2019-02-23 05:02:46 | 2019-02-23 06:25:37 | 2019-02-23 07:33:38 | 1:08:01 | 1:00:18 | 0:07:43 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630346 |
|
2019-02-23 05:02:46 | 2019-02-23 06:27:24 | 2019-02-23 07:35:24 | 1:08:00 | 1:01:41 | 0:06:19 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:08:05.107322 osd.2 (osd.2) 578 : cluster [ERR] osd.2 pg 5.10s0 found obsolete rollback obj 0#5:0f3e4f2f:::benchmark_data_smithi042_148170_object40091:head#1b8d generation < trimmed_to 664'8388...repaired" in cluster log |
||||||||||||||
| fail | 3630347 |
|
2019-02-23 05:02:46 | 2019-02-23 06:27:28 | 2019-02-23 07:31:28 | 1:04:00 | 0:58:26 | 0:05:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:01:46.585534 osd.2 (osd.2) 101 : cluster [ERR] osd.2 pg 4.fs1 found obsolete rollback obj 1#4:f0871f58:::benchmark_data_smithi017_133483_object42921:head#1767 generation < trimmed_to 472'6600...repaired" in cluster log |
||||||||||||||
| fail | 3630348 |
|
2019-02-23 05:02:46 | 2019-02-23 06:27:28 | 2019-02-23 08:31:29 | 2:04:01 | 1:56:48 | 0:07:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
reached maximum tries (800) after waiting for 4800 seconds |
||||||||||||||
| fail | 3630349 |
|
2019-02-23 05:02:46 | 2019-02-23 06:29:50 | 2019-02-23 07:39:48 | 1:09:58 | 1:03:26 | 0:06:32 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:04:26.206767 osd.4 (osd.4) 142 : cluster [ERR] osd.4 pg 4.as1 found obsolete rollback obj 1#4:5503aed3:::benchmark_data_smithi081_123185_object63534:head#2864 generation < trimmed_to 495'11982...repaired" in cluster log |
||||||||||||||
| fail | 3630350 |
|
2019-02-23 05:02:46 | 2019-02-23 06:29:50 | 2019-02-23 07:39:48 | 1:09:58 | 1:02:55 | 0:07:03 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:58:02.610102 osd.1 (osd.1) 254 : cluster [ERR] osd.1 pg 3.11s2 found obsolete rollback obj 2#3:8f7c09b8:::benchmark_data_smithi046_79665_object5627:head#140c generation < trimmed_to 312'7676...repaired" in cluster log |
||||||||||||||
| fail | 3630351 |
|
2019-02-23 05:02:46 | 2019-02-23 06:30:25 | 2019-02-23 07:36:25 | 1:06:00 | 0:59:24 | 0:06:36 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:03:52.146444 osd.2 (osd.2) 348 : cluster [ERR] osd.2 pg 4.es0 found obsolete rollback obj 0#4:74c0c79c:::benchmark_data_smithi051_86067_object30955:head#1124 generation < trimmed_to 447'4389...repaired" in cluster log |
||||||||||||||
| fail | 3630352 |
|
2019-02-23 05:02:46 | 2019-02-23 06:33:57 | 2019-02-23 07:53:58 | 1:20:01 | 1:13:16 | 0:06:45 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:58:31.751340 osd.6 (osd.6) 136 : cluster [ERR] osd.6 pg 2.27s0 found obsolete rollback obj 0#2:e6753818:::benchmark_data_smithi055_41358_object47808:head#179e generation < trimmed_to 232'6631...repaired" in cluster log |
||||||||||||||
| pass | 3630353 |
|
2019-02-23 05:02:46 | 2019-02-23 06:33:58 | 2019-02-23 07:39:58 | 1:06:00 | 0:58:33 | 0:07:27 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630354 |
|
2019-02-23 05:02:46 | 2019-02-23 06:35:49 | 2019-02-23 07:49:49 | 1:14:00 | 1:06:26 | 0:07:34 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630355 |
|
2019-02-23 05:02:46 | 2019-02-23 06:35:49 | 2019-02-23 07:41:49 | 1:06:00 | 0:59:53 | 0:06:07 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630356 |
|
2019-02-23 05:02:46 | 2019-02-23 06:37:51 | 2019-02-23 07:39:51 | 1:02:00 | 0:55:09 | 0:06:51 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 06:58:47.860727 osd.2 (osd.2) 75 : cluster [ERR] osd.2 pg 2.ds0 found obsolete rollback obj 0#2:b1e87ee3:::benchmark_data_smithi095_41327_object33307:head#15da generation < trimmed_to 135'6926...repaired" in cluster log |
||||||||||||||
| pass | 3630357 |
|
2019-02-23 05:02:46 | 2019-02-23 06:37:51 | 2019-02-23 07:41:51 | 1:04:00 | 0:57:11 | 0:06:49 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630358 |
|
2019-02-23 05:02:46 | 2019-02-23 06:39:58 | 2019-02-23 07:47:58 | 1:08:00 | 1:01:41 | 0:06:19 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630359 |
|
2019-02-23 05:02:46 | 2019-02-23 06:40:05 | 2019-02-23 07:48:05 | 1:08:00 | 1:01:41 | 0:06:19 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:19:16.551511 osd.6 (osd.6) 267 : cluster [ERR] osd.6 pg 4.9s0 found obsolete rollback obj 0#4:9324898e:::benchmark_data_smithi125_133076_object29905:head#1141 generation < trimmed_to 554'4815...repaired" in cluster log |
||||||||||||||
| fail | 3630360 |
|
2019-02-23 05:02:46 | 2019-02-23 06:40:24 | 2019-02-23 07:40:24 | 1:00:00 | 0:54:24 | 0:05:36 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:23:11.232768 osd.4 (osd.4) 333 : cluster [ERR] osd.4 pg 6.1as0 found obsolete rollback obj 0#6:583e9bca:::benchmark_data_smithi175_239000_object46763:head#18e8 generation < trimmed_to 652'6601...repaired" in cluster log |
||||||||||||||
| fail | 3630361 |
|
2019-02-23 05:02:46 | 2019-02-23 06:41:38 | 2019-02-23 07:49:38 | 1:08:00 | 1:01:17 | 0:06:43 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:08:49.392576 osd.0 (osd.0) 91 : cluster [ERR] osd.0 pg 3.1bs1 found obsolete rollback obj 1#3:dfe3bbc3:::benchmark_data_smithi198_83684_object71631:head#22a6 generation < trimmed_to 320'8884...repaired" in cluster log |
||||||||||||||
| fail | 3630362 |
|
2019-02-23 05:02:46 | 2019-02-23 06:41:38 | 2019-02-23 07:47:39 | 1:06:01 | 0:57:51 | 0:08:10 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:20:32.278860 osd.3 (osd.3) 92 : cluster [ERR] osd.3 pg 5.15s2 found obsolete rollback obj 2#5:af1174d8:::benchmark_data_smithi103_148373_object37158:head#1989 generation < trimmed_to 642'7906...repaired" in cluster log |
||||||||||||||
| pass | 3630363 |
|
2019-02-23 05:02:46 | 2019-02-23 06:43:14 | 2019-02-23 07:43:15 | 1:00:01 | 0:53:52 | 0:06:09 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630364 |
|
2019-02-23 05:02:46 | 2019-02-23 06:43:23 | 2019-02-23 07:55:22 | 1:11:59 | 1:05:55 | 0:06:04 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630365 |
|
2019-02-23 05:02:46 | 2019-02-23 06:43:25 | 2019-02-23 07:45:25 | 1:02:00 | 0:55:00 | 0:07:00 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:05:44.275386 osd.7 (osd.7) 138 : cluster [ERR] osd.7 pg 2.fs0 found obsolete rollback obj 0#2:fb149ecf:::benchmark_data_smithi082_41069_object18078:head#11fb generation < trimmed_to 160'6113...repaired" in cluster log |
||||||||||||||
| pass | 3630366 |
|
2019-02-23 05:02:46 | 2019-02-23 06:43:34 | 2019-02-23 07:49:34 | 1:06:00 | 0:58:52 | 0:07:08 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| fail | 3630367 |
|
2019-02-23 05:02:46 | 2019-02-23 06:47:23 | 2019-02-23 07:57:23 | 1:10:00 | 1:02:28 | 0:07:32 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Failure Reason:
"2019-02-23 07:09:47.297734 osd.7 (osd.7) 128 : cluster [ERR] osd.7 pg 2.13s0 found obsolete rollback obj 0#2:cb58a902:::benchmark_data_smithi182_41173_object9158:head#155c generation < trimmed_to 170'8245...repaired" in cluster log |
||||||||||||||
| pass | 3630368 |
|
2019-02-23 05:02:46 | 2019-02-23 06:47:34 | 2019-02-23 07:55:34 | 1:08:00 | 1:01:45 | 0:06:15 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630369 |
|
2019-02-23 05:02:46 | 2019-02-23 06:51:51 | 2019-02-23 07:59:51 | 1:08:00 | 1:01:47 | 0:06:13 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
| pass | 3630370 |
|
2019-02-23 05:02:46 | 2019-02-23 06:51:51 | 2019-02-23 07:55:51 | 1:04:00 | 0:56:59 | 0:07:01 | smithi | master | rhel | 7.5 | rados:thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 |
Pulpito