search

thekrakken / java-grok

Simple API that allows you to easily parse logs and other files
http://grok.nflabs.com/
Other
358 stars 152 forks source link

High CPU usage #52

Open hayatbehlim opened 8 years ago

hayatbehlim commented 8 years ago

Parsing multi-line logs use high cpu near to 100%. There is no way to find out which grok filter taking more cpu cycle and How we can optimize it. This issue looks similar to logstash grok issue 1.https://gist.github.com/jordansissel/4646783

  1. https://groups.google.com/forum/#!topic/logstash-users/RB3bBnVp_-c
anthonycorbacho commented 8 years ago

@hayatbehlim thank you for opening this issue.

I will try to find some time and investigate why this is happening.

hayatbehlim commented 8 years ago

You are welcome @anthonycorbacho , If you need any implementation side help I'm ready for that.

retoo commented 7 years ago

@hayatbehlim we only parse the first line using with grok, whenever we can.

ShawshankLin commented 5 years ago

What reason is this？I have the same problem @hayatbehlim

fbacchella commented 5 years ago

Did you try to use that: https://blog.codecentric.de/en/2017/09/jvm-fire-using-flame-graphs-analyse-performance/ to identify the problem ?