awslabs / aws-fluent-plugin-kinesis

Amazon Kinesis output plugin for Fluentd
Apache License 2.0
293 stars 96 forks source link

Plan to support AWS Glue Schema Registry integration #212

Open phucnh opened 3 years ago

phucnh commented 3 years ago

I'm using aws-fluent-plugin-kinesis on production to send our csv log to Kinesis Data Streams. I would like to change the log format to a more efficient format like avro. However, AWS Glue Schema Registry integration isn't supported yet. Manually manage avro schema on both producer and consumer side will increase system operating cost.

I understand AWS Glue Schema and Kinesis Producer Library integration only support Java now. However, does aws-fluent-plugin-kinesis have any plan or roadmap to support AWS Glue Schema Registry integration?