google / minions

Distributed filesystem scanner
Apache License 2.0
130 stars 12 forks source link

Refactor state management outside the overlord. #18

Closed paradoxengine closed 6 years ago

paradoxengine commented 6 years ago

This will ease future usage of a central DB for state between an array of overlords. It uses a local cache through the same library and general set up we have in the Minion, making it a bit easier to test parts of the Overlord. Note that in this refactoring I pulled out the chunk-merging code away from the overlord and into the implementation of the state manager, which might - or quite likely might not - be the right thing to do.