[SUPPORT] Compatibility of Hudi with Hive Metastore 3.x

[torvalds-dev-testbot[bot]]

Tips before filing an issue

• Have you gone through our FAQs?
• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced I am unsure whether Hudi is compatible with Hive Metastore 3.x as I could not find any information on this compatibility.

To Reproduce

1. 2. 3. 4.

Expected behavior A clear and concise description of what you expected to happen.

Environment Description

• Hudi version :
• Spark version :
• Hive version :
• Hadoop version :
• Storage (HDFS/S3/GCS..) :
• Running on Docker? (yes/no) :

Additional context Add any other context about the problem here.

Stacktrace Add the stacktrace of the error.

[torvalds-dev-testbot[bot]]

Relevant Sources:

https://hudi.apache.org/docs/syncing_metastore

https://hudi.apache.org/docs/troubleshooting

https://github.com/apache/hudi/issues/10707

[torvalds-dev-testbot[bot]]

Hello! 👋 Please wait while I search the knowledge base for an answer; this usually takes about 30 seconds

[torvalds-dev-testbot[bot]]

Hudi is compatible with Hive Metastore 3.x. The HiveSyncTool supports different modes, including HMS, HIVEQL, and JDBC for connecting to the Hive Metastore server. The JDBC mode uses the JDBC specification to connect to the hive metastore, making it independent of the specific version. Therefore, Hudi can work with Hive Metastore 3.x as well.

Follow up questions:

• Do you have any specific configurations or settings related to integrating Hudi with Hive Metastore 3.x that you would like to discuss?
• Are there any performance considerations or specific use cases you have in mind when using Hudi with Hive Metastore 3.x?
• Can you provide more details about your existing environment, such as the versions of Hudi and any other relevant components, to ensure a smooth integration with Hive Metastore 3.x?

Sources:

• https://hudi.apache.org/docs/syncing_metastore

[torvalds-dev-testbot[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/numberlabs-developers/hudi/issues/233

[torvalds-dev-testbot[bot]]

Abhishek posted:

https://devs-numberlabs.slack.com/archives/C06PDCQPA3W/p1722423636262649?thread_ts=1722445576944339&cid=C06PDCQPA3W

[torvalds-dev-testbot[bot]]

Abhishek posted:

https://devs-numberlabs.slack.com/archives/C06PDCQPA3W/p1722423636262649?thread_ts=1722445577513599&cid=C06PDCQPA3W