search

cloudflare / goflow

The high-scalability sFlow/NetFlow/IPFIX collector used internally at Cloudflare.
BSD 3-Clause "New" or "Revised" License
852 stars 171 forks source link

Support output formats other than protobuf over Kafka #88

Closed sjwang90 closed 3 years ago

sjwang90 commented 3 years ago

Background/Use Case

InfluxData's Telegraf project received a request (influxdata/telegraf#8425) to integrated into goFlow for IPFIX/NetFlow support. Currently Telegraf does not support binary (ex: protobuf) formats.

Feature Request

Request for vFlow to add one of the following output formats to ease the integration with Telegraf.

Also not sure if goFlow is meant to be embedded in other programs as there might not be a stable library API for other programs use.

lspgn commented 3 years ago

@sjwang90 thanks! I added a comment on the telegraf thread. GoFlow can be extended but the main format in this repository is Kafka+protobuf (or JSON). For Influx/Telegraf, you will likely need aggregation.

sjwang90 commented 3 years ago

Ok thanks for your feedback @lspgn. I'll close this issue for now.