robinrodricks / FluentStorage

A polycloud .NET cloud storage abstraction layer. Provides Blob storage (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and Messaging (AWS SQS, Azure Queue/ServiceBus). Supports .NET 5+ and .NET Standard 2.0+. Pure C#.
MIT License
263 stars 33 forks source link

Use MultipartUpload in AwsS3BlobStorage.WriteAsync #24

Open anhaehne opened 1 year ago

anhaehne commented 1 year ago

As the documentation states, the FileTransferUtility.UploadAsync will cache everything in memory.

The Multipart upload allows to at least upload the stream in chunks.

The TwentyTwenty library implents this: https://github.com/2020IP/TwentyTwenty.Storage/blob/dev/src/TwentyTwenty.Storage.Amazon/AmazonFileUploader.cs