search

vectordotdev / vector

A high-performance observability data pipeline.
https://vector.dev
Mozilla Public License 2.0
17.79k stars 1.58k forks source link

Add VictoriaMetrics metrics sink #1343

Open valyala opened 4 years ago

valyala commented 4 years ago

It would be great if Vector could route metrics data to VictoriaMetrics via any supported ingestion methods - see https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/README.md#how-to-import-time-series-data .

jogster commented 4 years ago

I was just about to ask for this myself!

lukesteensen commented 4 years ago

Both the Influx line protocol and Graphite text protocol are sinks we plan to support before too long.

jogster commented 4 years ago

Having just setup a statsd (source) -> prometheus (sink) -> prometheus (pull) (5s) -> prometheus(write) (5s) -> victoria-metrics

The above pipe-line results in metics being pulled every 5 seconds and pushed every 5 seconds + 1 second approx. 11 seconds delay

Would be great to just have: statsd(source) -> prometheus_write (sink) -> victoria-metrics

In this pipe-line at the most it should be 1 second (pushed by app into statsd source)

Additionally the current prometheus mapping work 'out-of-the-box' translating those to graphite/influx and back will result in a mapping headache.

xinity commented 11 months ago

thumbing this up as we would be able to leverage metricQL from victoriametrics :)