[hotfix] fix the spark generic catalog to execute externalCatalog() creates a new hive metastore connection instance.

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.13k stars 842 forks source link

Closed zhuangchong closed 2 days ago

zhuangchong commented 3 days ago

The SparkSession.active().sharedState().externalCatalog().unwrapped() method will create a new hive metastore connection