question: how can this be used with confluent kafka and azure wasb

getindata / kafka-connect-iceberg-sink

Apache License 2.0

77 stars 30 forks source link

question: how can this be used with confluent kafka and azure wasb #19

Open alaturqua opened 1 year ago

alaturqua commented 1 year ago

thank you for this package.

Would this work with azure wasb as well?

Data would come from Confluent Kafka Topic and should be saved as iceberg table on azure wasb.

gliter commented 1 year ago

Seems that WASB support is being implemented in Iceberg https://github.com/apache/iceberg/pull/4465 After that is completed iceberg library embedded in this connector would have to be updated.

Second thing is catalog support but you could use any(*) JDBC supported DB for catalog: https://iceberg.apache.org/docs/latest/jdbc/