search

humio / issues

Issue Tracker for Humio
4 stars 2 forks source link

Support mtail like functionality in Humio. #66

Open henrikjohansen opened 5 years ago

henrikjohansen commented 5 years ago

Mtail (https://github.com/google/mtail) is a really neat tool for extracting whitebox monitoring data from log files and exposing those for external consumption.

Humio actually allows you to do much of the same stuff that you can do with mtail - except exposing data for external consumption which is a real shame.

I would like to see a similar concept in Humio which would allow me to essentially build a new type of "dashboard" (a metricsboard, perhaps?) that would expose the collected data as Prometheus metrics 💥

Sharing such a dashboard would then allow me to scrape the data using Prometheus and include them in our monitoring pipeline 👍

This is somewhat related to #64 as you probably could expose Humio's internal metrics in the same manner ...

pmech commented 5 years ago

This is an interesting idea and would be a very powerful way to integrate towards Prometheus.

henrikjohansen commented 5 years ago

@pmech Indeed :) Another interesting thing - if you use something like Telegraf to scrape the data you are no longer limited to Prometheus; you can ship to all output plugins supported by Telegraf.

The list of outputs is pretty long : https://github.com/influxdata/telegraf/tree/master/plugins/outputs

You can also convert the Prometheus metrics using Telegraf before shipping: https://github.com/influxdata/telegraf/tree/master/plugins/parsers

This could form the basis of a very powerful integration point ....