trinodb / aws-proxy

Proxy for S3
Apache License 2.0
8 stars 6 forks source link

Properly handle `aws-chunked` encoding #55

Closed Randgalt closed 4 months ago

Randgalt commented 5 months ago

AWS has a bespoke protocol for request/response chunking, aws-chunked. We'll need to add a Jersey MessageBodyWriter and MessageBodyReader to handle these.

It may be that this needs to be handled at the Jetty level - needs research.

Additional info:

I believe that a single-chunk upload will work for us. All the docs I read imply that you can choose to upload a single chunk (up to normal single PUT limits). The other part of this is that I have yet to get proper aws-chunked to work - it's a bear. So, I say we stick with a single unsigned chunk for now until we find out we need to support something else.