Support for logstash filters?

arithmetric / lambda-stash

AWS Lambda script to ship data from S3 to other data stores, like Elasticsearch

MIT License

52 stars 18 forks source link

Open modsaid opened 7 years ago

modsaid commented 7 years ago

Since AWS does not yet support logstash agents, the only way to use logstash many filters is by starting an agent on EC2 machine.

I've seen java based lambda functions to parse the logs and extract many business specific attributes. but i believe logstash is a lot maintainable.

I was wondering now about lambda-stash if it combines the benefits of both worlds. does it?

I'm looking for grok filters, custom grok patterns, matching/tagging routes with business cases.

@arithmetric

durmo11 commented 7 years ago

expertcoder commented 7 years ago

Have you considered ElasticSearch Pipeline/Processors, which now supports logstash like behaviour including grok directly inside ElasticSearch.