search

magnusbaeck / logstash-filter-verifier

Apache License 2.0
192 stars 27 forks source link

Provide example filters to go with the example test cases #52

Open jkschoen opened 6 years ago

jkschoen commented 6 years ago

Suggestion to make it easier for people to get up and running that may not be as familiar with writing filters. Most of the examples are pretty straight forward, but it is still a hurdle that has to be jumped before getting going.

Tetha commented 6 years ago

We're using logstash-filter-verifier a lot internally.

If there is interest, I could go ahead and ask if I'm allowed to provide some of our internal config and tests for public applications, e.g. syslog handling, haproxy log handling, something like that. This would consist of some logstash filter snippets, and the accompanying test files.

matejzero commented 6 years ago

I’m all for it. There is little to no production examples and snippets available online. I think I’m having a good configuration but I could be totally wrong. Usually you only see configuration for a single app but never a full stack that covery many apps.

I could also ask for permission to get some snippets online from our configuration together with tests. Most of my samples are already anonymized, somit should be little work if I get a go!

Tetha commented 6 years ago

Alright, I'll do a few rounds with the necessary people tomorrow. I've also requested access to the company blog so I can write a post about our logstash-config CI pipeline including logstash-config-verifier and some workarounds. We're currently using that for a hopefully boring transition from LS 2 to LS 5 :)

matejzero commented 6 years ago

Great! I'll do the same.

We also setup CI/CD pipeline for logstash & elasticsearch, but with the recent activity, I have a feeling I need to rework it to make it more continuous and less semi-continuous:)

Looking forward to your CI pipeline post:)