Open loicmathieu opened 1 month ago
With the new io.kestra.plugin.transform.grok.TransformValue task from the Plugin Transform, we can replace Logstash by Kestra!
io.kestra.plugin.transform.grok.TransformValue
A blueprint would be great to see how we can handle a log file, parse it with the Grok task and save the parsed log to Elasticsearch.
It can either be done by providing a log file or analyzing logs in realtime from a Kafka real-time trigger.
Blocked on https://github.com/kestra-io/plugin-transform/issues/7 and https://github.com/kestra-io/plugin-transform/issues/8
Issue description
With the new
io.kestra.plugin.transform.grok.TransformValue
task from the Plugin Transform, we can replace Logstash by Kestra!A blueprint would be great to see how we can handle a log file, parse it with the Grok task and save the parsed log to Elasticsearch.
It can either be done by providing a log file or analyzing logs in realtime from a Kafka real-time trigger.