logstash-plugins / logstash-integration-kafka

Kafka Integration for Logstash, providing Input and Output Plugins
Apache License 2.0
32 stars 60 forks source link

Add support for AWS Glue Schema Registry #111

Open DzeryCZ opened 2 years ago

DzeryCZ commented 2 years ago

Our Kafka setup consists of AWS MSK and AWS Glue Schema registry. While this plugin works perfectly fine with MSK itself, it lacks support for Glue Schema Registry.

AWS Glue Schema Registry allows connection only over AWS API and the access management is handled via AWS IAM. By reading the documentation of this plugin I found out, that only connection over HTTP Basic Authorisation is possible.

In order to make the application (producer/consumer) talk to Glue Schema Registry a code change is needed - https://github.com/awslabs/aws-glue-schema-registry

So that is bringing up a question. Is support of AWS Glue Schema Registry on your Roadmap? Or is there any other woraround? Did anybody else encountered with this problem? Many thanks.