Use multipart uploads for large file uploads

clue / reactphp-s3

Async S3 filesystem API (supporting Amazon S3, Ceph, MiniIO, DigitalOcean Spaces and others), built on top of ReactPHP.

MIT License

12 stars 4 forks source link

Use multipart uploads for large file uploads #5

Open clue opened 5 years ago

clue commented 5 years ago

The S3 upload API is limited to 5GB, so larger files have to be uploaded in chunks. Additionally, we may also chunk smaller files and concurrently upload multiple parts.

Refs #2 and https://developers.digitalocean.com/documentation/spaces/#begin-multi-part-upload

clue commented 5 years ago

See also https://github.com/clue/reactphp-buzz/issues/138 for current timeout handling when uploading large files. For now, we might as well disable any timeouts in this library.