janelia-flyem / dvid

Distributed, Versioned, Image-oriented Dataservice
http://dvid.io
Other
197 stars 33 forks source link

preliminary s3 support (and precomputed doc) #366

Closed pgunn closed 2 years ago

pgunn commented 2 years ago

This diff adds preliminary support for s3:// URIs with the existing precomputed support in DVID. It also adds a readme to tell people how the (currently-implemented) precomputed support works.

I have not done end-to-end testing of this (because of #363) but this is at progress towards what we want (after 363 is resolved I may need to make some smaller changes to make things actually work, once better testing is possible). Via email, it was suggested that some parts of the precomputed design might change along with 363 being fixed.

If it would be better to hold off on doing a PR until other code changes settle down I can do that.


This change is Reviewable