Filter on bucket key. - Githubissues

arithmetric / lambda-stash

AWS Lambda script to ship data from S3 to other data stores, like Elasticsearch

MIT License

52 stars 18 forks source link

Filter on bucket key. #7

Closed wderezin closed 7 years ago

wderezin commented 7 years ago

Added an option to include keyPrefix in the mapping section. This allows for processing a consolidated log bucket. I'm not sure where it is best to document in the ReadMe but if you point to the section I can add documentation there.

Sample Config: { bucket: acme-conslidated-logs', keyPrefix: 'cloudwatch-lambda', processors: [ 'decompressGzip', 'parseJson', 'formatCloudwatchLogs', 'shipElasticsearch' ], elasticsearch: { index: 'lambda' }, dateField: 'date' }

coveralls commented 7 years ago

Coverage remained the same at 100.0% when pulling f2f7758fca6d803e39b9088a9cc77d7ce49eb418 on wderezin:master into d07ff211252972499ea80a13179866b4a63f2878 on arithmetric:master.

coveralls commented 7 years ago

Coverage remained the same at 100.0% when pulling a0e680edb50b4d2a6c835c45bfa37681012d69a0 on wderezin:master into 729f9ba9c8cf8e7cda6e0f69d38cafb61800e8d8 on arithmetric:master.