mapbox / streambot

DEPRECATED (SEE README) Robot-assisted deploys to Lambda
ISC License
39 stars 7 forks source link

Investigate getting logs to sumologic #2

Closed rclark closed 9 years ago

rclark commented 9 years ago

Current vector looks to be writing files to S3 and having sumologic scan them. This will mean providing services with a custom logger so that streambot can accumulate the logs and write them to S3.

rclark commented 9 years ago

In order to reduce the chances of any unnecessary charges from Amazon, Sumo Logic will perform an automatic back off on the scanning of a configured bucket. Basically if Sumo logic finds no objects in the configured path it will then double the time before the next scan occurs, up to a point where it may only scan once per day.

Kind of a bummer if you're looking for more immediate feedback.

Lambda sets itself up to log to Cloudwatch log streams, more to explore.

rclark commented 9 years ago

Logs are going to S3 so we've done what we can here.