search

exasol / kafka-connector-extension

Exasol Kafka Extension for accessing Apache Kafka
MIT License
4 stars 7 forks source link

Add Option to import JSON as-is #16

Closed tglunde closed 3 years ago

tglunde commented 4 years ago

Having an option to import the JSON from the kafka message as-is into a VARCHAR(2000000) field will provide more flexibility to read JSON data downstream using JSON functions JSON_VALUE and JSON_EXTRACT. We are currently implementing this and would like to provide a pull request once finished.

morazow commented 4 years ago

Hello @tglunde,

Thanks for the feedback!

We are in works to support this option.

Please check out the recent pull request #12 in common library. Once the #13 is merged, we are going to release a new version of Kafka connector.

morazow commented 4 years ago

Hey @tglunde,

I have totally misread your comment.

That is great news! Storing the Avro schema as an additional metadata would help!

Please feel free to send the pull request!

morazow commented 4 years ago

Hey @ilikutle, @tglunde,

Thanks again! This is now merged in #18.

tglunde commented 4 years ago

Cool, thx! What is the current road map to releasing this?

morazow commented 4 years ago

I want to update the Kafka versions (#14) so that it is included in the next release.

But we do not have to wait for it, please let me know if you prefer another release early.

morazow commented 3 years ago

Hey @tglunde, @ilikutle,

I have released a new version that includes these changes! Please give it a try!

And thanks for your contributions!