search

timkay / aws

Easy command line access to Amazon EC2, S3, SQS, ELB, and SDB
http://timkay.com/aws/
426 stars 125 forks source link

Real Streaming-support for PUTs #7

Closed sreuter closed 12 years ago

sreuter commented 13 years ago

My findings show that PUTs from STDIN are not really streamed. It looks like "aws" first takes all data on STDIN, and after all data is received triggers curl to upload.

Is it possible to support real streaming? This would be great for stream modification (for example, do some inline encryption with gnupg)

boopsie commented 13 years ago

No, it's not possible, as S3 doesn't support streaming. S3 requires that we know the size of the PUT ahead of time. It's sad that they don't support chunked-encoding.