search

gaul / s3proxy

Access other storage backends via the S3 API
Apache License 2.0
1.8k stars 232 forks source link

Azure Multipart Upload #552

Open akshay-sawant-bh opened 1 year ago

akshay-sawant-bh commented 1 year ago

Facing issues when doing part upload on Azure where part with invalid ETag gets uploaded as well as more parts then actually uploaded gets completed in complete upload API, does S3proxy support multipart upload on Azure

gaul commented 9 months ago

S3Proxy supports Azure multi-part upload but needs to subdivide the S3 parts into smaller sizes due to Azure limitations:

https://github.com/gaul/s3proxy/blob/dd73dff0acf2e22f328f22dd0b84b04c3b48a331/src/main/java/org/gaul/s3proxy/S3ProxyHandler.java#L2827

I believe that upgrading the Azure version would raise but not eliminate this limit. Can you more precisely describe the symptoms you observe?

gaul commented 1 month ago

Could you try testing with the new azureblob-sdk provider from #606?