search

getindata / kafka-connect-iceberg-sink

Apache License 2.0
76 stars 27 forks source link

Cannot specify Hive Metastore #40

Closed bachhs closed 1 year ago

bachhs commented 1 year ago

I'm trying to use Iceberge with Hive Metastore with the config like this

{
    "name": "iceberg-sink",
    "config": {
        "topics.regex": "^topics.*",
        "connector.class": "com.getindata.kafka.connect.iceberg.sink.IcebergSink",
        "iceberg.catalog-impl": "org.apache.iceberg.hive.HiveCatalog",
        "iceberg.warehouse": "s3a://my_bucket/iceberg",
        "iceberg.uri": "thrift://1.2.3.4:9083"
    }
}

But the connector is still trying to connect to the host of the server (like kafka-server) instead of the IP as it was configured. Edit: It seems because of my host file that the hive metastore was resolved to another URL.