User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
---|---|---|---|---|---|---|---|---|---|---|
sage | 2017-11-16 21:48:38 | 2017-11-16 22:24:00 | 2017-11-16 23:25:47 | 1:01:47 | rados:thrash | wip-pg-scrub-preempt | smithi | c2ddacd | 13 | 11 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 1855319 | 2017-11-16 21:48:40 | 2017-11-16 22:24:00 | 2017-11-16 22:47:59 | 0:23:59 | 0:21:53 | 0:02:06 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |||
pass | 1855320 | 2017-11-16 21:48:41 | 2017-11-16 22:24:05 | 2017-11-16 22:48:05 | 0:24:00 | 0:23:03 | 0:00:57 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |||
fail | 1855321 | 2017-11-16 21:48:42 | 2017-11-16 22:24:13 | 2017-11-16 22:42:12 | 0:17:59 | 0:14:12 | 0:03:47 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:32:05.518315 osd.5 osd.5 172.21.15.178:6808/947 29 : cluster [ERR] 3.0 scrub stat mismatch, got 21/22 objects, 0/0 clones, 10/11 dirty, 0/0 omap, 0/0 pinned, 1/1 hit_set_archive, 2/2 whiteouts, 41649975/45364487 bytes, 300/300 hit_set_archive bytes." in cluster log |
||||||||||||||
fail | 1855322 | 2017-11-16 21:48:43 | 2017-11-16 22:25:35 | 2017-11-16 22:43:35 | 0:18:00 | 0:12:53 | 0:05:07 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:33:37.097859 osd.4 osd.4 172.21.15.176:6800/31037 52 : cluster [ERR] 3.3 scrub stat mismatch, got 101/102 objects, 0/0 clones, 69/69 dirty, 0/0 omap, 0/0 pinned, 1/1 hit_set_archive, 20/21 whiteouts, 173236549/173236549 bytes, 313/313 hit_set_archive bytes." in cluster log |
||||||||||||||
pass | 1855323 | 2017-11-16 21:48:43 | 2017-11-16 22:25:38 | 2017-11-16 22:39:37 | 0:13:59 | 0:12:40 | 0:01:19 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |||
fail | 1855324 | 2017-11-16 21:48:44 | 2017-11-16 22:25:39 | 2017-11-16 22:41:38 | 0:15:59 | 0:12:59 | 0:03:00 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:33:12.737133 osd.4 osd.4 172.21.15.202:6809/3996 85 : cluster [ERR] 2.6 shard 0 missing 2:615647c8:::smithi20012810-84:head" in cluster log |
||||||||||||||
fail | 1855325 | 2017-11-16 21:48:45 | 2017-11-16 22:25:49 | 2017-11-16 23:03:49 | 0:38:00 | 0:32:06 | 0:05:54 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |||
Failure Reason:
Socket is closed |
||||||||||||||
pass | 1855326 | 2017-11-16 21:48:45 | 2017-11-16 22:25:54 | 2017-11-16 22:51:54 | 0:26:00 | 0:24:31 | 0:01:29 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | |||
pass | 1855327 | 2017-11-16 21:48:46 | 2017-11-16 22:25:54 | 2017-11-16 22:39:54 | 0:14:00 | 0:12:19 | 0:01:41 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | |||
pass | 1855328 | 2017-11-16 21:48:47 | 2017-11-16 22:25:59 | 2017-11-16 22:39:59 | 0:14:00 | 0:11:59 | 0:02:01 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | |||
fail | 1855329 | 2017-11-16 21:48:47 | 2017-11-16 22:26:13 | 2017-11-16 23:06:13 | 0:40:00 | 0:33:28 | 0:06:32 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:39:25.583700 osd.0 osd.0 172.21.15.97:6800/17503 166 : cluster [ERR] 3.3 shard 2 missing 3:d3a2c1af:::smithi09720400-96:head" in cluster log |
||||||||||||||
fail | 1855330 | 2017-11-16 21:48:48 | 2017-11-16 22:27:34 | 2017-11-16 22:53:34 | 0:26:00 | 0:21:09 | 0:04:51 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:38:45.488593 osd.3 osd.3 172.21.15.46:6808/8376 121 : cluster [ERR] 49.6 scrub stat mismatch, got 18/19 objects, 2/2 clones, 18/19 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 142/150 bytes, 0/0 hit_set_archive bytes." in cluster log |
||||||||||||||
pass | 1855331 | 2017-11-16 21:48:49 | 2017-11-16 22:27:44 | 2017-11-16 22:45:43 | 0:17:59 | 0:17:11 | 0:00:48 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | |||
fail | 1855332 | 2017-11-16 21:48:50 | 2017-11-16 22:27:45 | 2017-11-16 23:25:47 | 0:58:02 | 0:53:46 | 0:04:16 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | |||
Failure Reason:
Exiting scrub checking -- not all pgs scrubbed. |
||||||||||||||
fail | 1855333 | 2017-11-16 21:48:50 | 2017-11-16 22:27:54 | 2017-11-16 22:55:54 | 0:28:00 | 0:22:40 | 0:05:20 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:38:52.443866 osd.7 osd.7 172.21.15.93:6804/4641 126 : cluster [ERR] 2.1 scrub stat mismatch, got 182/182 objects, 67/67 clones, 182/182 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 10/11 whiteouts, 446436125/444066305 bytes, 0/0 hit_set_archive bytes." in cluster log |
||||||||||||||
fail | 1855334 | 2017-11-16 21:48:51 | 2017-11-16 22:28:01 | 2017-11-16 22:58:01 | 0:30:00 | 0:22:41 | 0:07:19 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:39:06.389591 osd.0 osd.0 172.21.15.185:6802/1133 49 : cluster [ERR] 3.6 shard 4 missing 3:62a3cd8d:::benchmark_data_smithi185_8245_object644:head" in cluster log |
||||||||||||||
pass | 1855335 | 2017-11-16 21:48:52 | 2017-11-16 22:28:57 | 2017-11-16 22:50:57 | 0:22:00 | 0:21:21 | 0:00:39 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |||
pass | 1855336 | 2017-11-16 21:48:52 | 2017-11-16 22:28:57 | 2017-11-16 22:42:57 | 0:14:00 | 0:13:24 | 0:00:36 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | |||
fail | 1855337 | 2017-11-16 21:48:53 | 2017-11-16 22:29:28 | 2017-11-16 22:47:27 | 0:17:59 | 0:12:47 | 0:05:12 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:37:53.788417 osd.0 osd.0 172.21.15.201:6808/26578 65 : cluster [ERR] 3.3 shard 2 missing 3:c2573310:::smithi20128926-497 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo:head" in cluster log |
||||||||||||||
pass | 1855338 | 2017-11-16 21:48:54 | 2017-11-16 22:29:48 | 2017-11-16 22:45:48 | 0:16:00 | 0:12:15 | 0:03:45 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |||
pass | 1855339 | 2017-11-16 21:48:54 | 2017-11-16 22:29:51 | 2017-11-16 22:45:51 | 0:16:00 | 0:12:36 | 0:03:24 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |||
fail | 1855340 | 2017-11-16 21:48:55 | 2017-11-16 22:30:08 | 2017-11-16 22:54:07 | 0:23:59 | 0:19:54 | 0:04:05 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |||
Failure Reason:
"2017-11-16 22:41:21.355984 osd.2 osd.2 172.21.15.91:6808/6209 502 : cluster [ERR] 3.3 scrub stat mismatch, got 45/45 objects, 9/9 clones, 24/24 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 7/7 whiteouts, 90366630/91807970 bytes, 0/0 hit_set_archive bytes." in cluster log |
||||||||||||||
pass | 1855341 | 2017-11-16 21:48:56 | 2017-11-16 22:30:08 | 2017-11-16 22:58:07 | 0:27:59 | 0:26:10 | 0:01:49 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | |||
pass | 1855342 | 2017-11-16 21:48:56 | 2017-11-16 22:30:10 | 2017-11-16 22:44:10 | 0:14:00 | 0:13:29 | 0:00:31 | smithi | master | rados:thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 |