asilvas / blobby

HTTP Proxy for Blob storage systems (such as S3) that automatically shards and replicates your data
MIT License
4 stars 5 forks source link

Parallel repair support #6

Open asilvas opened 7 years ago

asilvas commented 7 years ago

Currently it isn't realistic to support parallel repairs/copies between the same storage locations as the cursors are in lexical order so the repairs would overlap and compete. Random cursor location based on bucket could be built into the individual storage driver to enable several parallel repairs, each starting from a location cursor location. This task should probably be moved to driver repo.