Added Support to upload to AWS S3

cloudflare / logshare

logshare is a library & CLI client for retrieving logs from Cloudflare's Enterprise Log Share service.

https://support.cloudflare.com/hc/en-us/articles/216672448

BSD 3-Clause "New" or "Revised" License

80 stars 24 forks source link

Added Support to upload to AWS S3 #13

Open posilva opened 6 years ago

posilva commented 6 years ago

This PR adds support to upload logs to AWS S3 bucket with or without compression

elithrar commented 6 years ago

@posilva - thanks for this. Will review soon.

I should also mention that Enterprise customers are now able to join our Logpush beta, where we can continuously push request logs to an S3 (or GCS) bucket for you. Email msilverlock @ cloudflare if that’s relevant to you.

posilva commented 6 years ago

@elithrar - I made a fix to the previous PR because I was getting some "corrupt/incomplete" log entries when using aws-s3-compress option.

We have it in production for several hours and it's working just perfect!

Thanks