search

mozilla-services / hindsight

Hindsight - light weight data processing skeleton
Mozilla Public License 2.0
668 stars 55 forks source link

Better handling of pruned queues when restarting analysis/output threads #162

Closed trink closed 6 years ago

trink commented 6 years ago

If an analysis thread/output plugin is restarted with a invalid checkpoint (i.e. the file has been removed from the queue) an error should be logged and the checkpoint should be advanced to start of the currently active file.

trink commented 6 years ago

91550a737a010841e3cf299d0c214ec819131867