search

vectordotdev / vector

A high-performance observability data pipeline.
https://vector.dev
Mozilla Public License 2.0
17.42k stars 1.51k forks source link

New `warp10` sink #2258

Open KannarFr opened 4 years ago

KannarFr commented 4 years ago

Warp10 is an open source time series database which is based on kafka & hbase. It comes with a powerful query langague WarpScript (a stack-oriented programming: https://www.warp10.io/content/03_Documentation/04_WarpScript/01_Concepts).

Here is how to push to Warp10 using HTTP: https://www.warp10.io/content/03_Documentation/03_Interacting_with_Warp_10/03_Ingesting_data/01_Ingress;

Here is the (GeoTimeSeries) GTS format required to push to Warp10: https://www.warp10.io/content/03_Documentation/03_Interacting_with_Warp_10/03_Ingesting_data/02_GTS_input_format.

Here is a crate to use to push: https://crates.io/crates/warp10.

More info here: https://www.warp10.io/.

Maybe I'll contribute if I get time to, but in any case I'll take time to answer any question.

wowi42 commented 4 years ago

It would be nice to have this one!

StevenLeRoux commented 3 years ago

It would be great. Also, Warp10 has an optimized ingestion format with Continuation lines which could be leveraged

FlorentinDUBOIS commented 3 years ago

Hey there 🖖, I am interested by this feature and the source as well known as sensision. This will allow us to leverage vector features and deprecate our tool beamium in favor of vector.

I will be happy to give you some help to implement it 🙂

KannarFr commented 3 years ago

Warp10 rust client v1.0.0 is out (only to push data).