ClientStore needs to check if batch is too far ahead

twitter / summingbird

Streaming MapReduce with Scalding and Storm

https://twitter.com/summingbird

Apache License 2.0

2.14k stars 267 forks source link

ClientStore needs to check if batch is too far ahead #653

Closed johnynek closed 8 years ago

johnynek commented 8 years ago

There is a method to get a particular (K, BatchID) from a ClientStore. That fails if offline is too far forward. But there is no check so we may have silent data corruption now.

Probably we don't have a problem since people query for now which should never be behind, but we should fix it.