search

dotmesh-io / dotmesh

dotmesh (dm) is like git for your data volumes (databases, files etc) in Docker and Kubernetes
https://dotmesh.com
Apache License 2.0
539 stars 29 forks source link

Need s3 multithreading #731

Open Godley opened 4 years ago

Godley commented 4 years ago

Downloading a 16GB file from s3 to dotmesh currently takes >30minutes. We need to speed this up for it to be a viable "mirror" of S3.