SumoLogic / sumologic-aws-lambda

A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector
Other
152 stars 134 forks source link

Add log stream name prefix filtering, especially for AWS Batch logs #98

Closed ykitamura-mdsol closed 5 years ago

ykitamura-mdsol commented 5 years ago

Background

All of AWS Batch logs are sent to one log group, /aws/batch/job, and the log stream name format is jobDefinitionName/default/ecs_task_id: https://docs.aws.amazon.com/batch/latest/userguide/job_states.html

Changes

In order to stream logs of specific AWS Batch jobs to SumoLogic, this PR is adding log stream name prefix filtering for CloudWatch logs

ykitamura-mdsol commented 5 years ago

@himanshu219, could you please review this PR?

ykitamura-mdsol commented 5 years ago

Good idea 💡 Added the variable in e64128c

himanshu219 commented 5 years ago

Thanks