cisco-ie / pipeline-gnmi

A Model-Driven Telemetry collector based on the open-source tool pipeline
Apache License 2.0
32 stars 6 forks source link

Kafka 2.x Support #22

Closed remingtonc closed 5 years ago

remingtonc commented 5 years ago

Adds Kafka 2.x support, part of the breakup of #8. Resolves #3.

This pull request adds Kafka 2.x support with minimal changes to the code. Most code is due to vendor dependencies being updated which ideally is resolved with #5.

One breaking change is the requirement of the kafkaversion field in the type=kafka stage specification. This is due to Sarama requiring the Version to be specified, or otherwise defaulting to Kafka 0.8 interaction. This is a breaking config change but a good one for ongoing Kafka support. Thoughts?

Tests for Kafka have been updated to use Kafka 2.x. All Kafka-related tests passing.