[SUPPORT] Tutorial on registering Hudi files into HMS

[torvalds-dev-testbot[bot]]

Tips before filing an issue

• Have you gone through our FAQs?
• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced A clear and concise description of the problem.

To Reproduce Steps to reproduce the behavior: 1. 2. 3. 4.

Expected behavior A clear and concise description of what you expected to happen.

Environment Description

• Hudi version :
• Spark version :
• Hive version :
• Hadoop version :
• Storage (HDFS/S3/GCS..) :
• Running on Docker? (yes/no) :

Additional context Add any other context about the problem here.

Stacktrace Add the stacktrace of the error.

[torvalds-dev-testbot[bot]]

Hello! 👋 Please wait while I search the knowledge base for an answer; this usually takes about 30 seconds

[torvalds-dev-testbot[bot]]

Based on the provided documentation snippets, you can use the Hudi Hive Sync Tool to register Hudi files into Hive Metastore by running the hudi-hadoop-mr-bundle into Hive. This involves configuring hive metastore and hiveserver services correctly, importing the hudi-hadoop-mr-bundle jar into Hive by creating an auxlib folder and restarting the services after modifications. Another step involves git cloning the Hudi master branch to test Flink hive sync and using specific Maven profiles for different versions of Hive. Lastly, you can create a sample Hudi table in Spark and sync it to Hive by utilizing specific configurations and options outlined in the documentation.

Follow up questions:

• Are any specific version requirements for Hudi, Hive, or Spark while performing these configurations?
• Do you encounter any errors or warnings during the process of setting up and syncing the Hudi files into Hive?
• Are there any additional customizations or configurations you would like to apply during the registration process?

Sources:

• https://hudi.apache.org/docs/syncing_metastore
• https://hudi.apache.org/docs/docker_demo
• https://medium.com/@devjain1299/apache-hudi-on-aws-glue-a-step-by-step-guide-503c34a9aa95

[torvalds-dev-testbot[bot]]

Hello! 👋 Please wait while I generate the follow up questions; this usually takes about 30 seconds

[torvalds-dev-testbot[bot]]

Error generating response

[torvalds-dev-testbot[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/numberlabs-developers/hudi/issues/230