search

janelia-flyem / dvid

Distributed, Versioned, Image-oriented Dataservice
http://dvid.io
Other
197 stars 33 forks source link

Add logs for pub/sub system and route split/merge through it. #141

Open DocSavage opened 8 years ago

DocSavage commented 8 years ago

Keep persistent write-ahead log for long-lived ops like split, merge, and data syncs via pub/sub that would allow cleanup after restart of crash. Some ops would be kept, like split/merge, and possibly used to speed DVID-to-DVID push/pull. Others would only persist until the op is completed. This would also handle issue #98.

DocSavage commented 8 years ago

This is related to issue #117 and should be used to note divergence of denormalizations if one type of denormalization has an error.