[SUPPORT] Query regarding compatibility of Hudi JAR versions for exporting Snapshot

[torvalds-dev[bot]]

Tips before filing an issue

• Have you gone through our FAQs?
• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced Is it okay to use Hudi 0.12.2 JARs when exporting a Hudi Snapshot with a Hudi 0.14.1 Table?

To Reproduce

Expected behavior A clear and concise description of what you expected to happen.

Environment Description

• Hudi version : 0.12.2
• Spark version :
• Hive version :
• Hadoop version :
• Storage (HDFS/S3/GCS..) :
• Running on Docker? (yes/no) :

Additional context Add any other context about the problem here.

Stacktrace Add the stacktrace of the error.

[torvalds-dev[bot]]

Relevant Sources:

https://hudi.apache.org/docs/faq_storage

https://hudi.apache.org/docs/deployment

https://hudi.apache.org/docs/troubleshooting

https://hudi.apache.org/docs/faq_integrations

https://github.com/apache/hudi/issues/8147

[torvalds-dev[bot]]

Hello! 👋 Please wait while I search the knowledge base for an answer; this usually takes about 30 seconds

[torvalds-dev[bot]]

To export a Hudi snapshot with Hudi 0.14.1 table, it is acceptable to use Hudi 0.12.2 JARs based on the provided documentation snippet. The Hudi Snapshot Exporter tool allows copying a dataset to a target path using the specified JARs. Additionally, the tool supports converting datasets to other formats like JSON or Parquet. The output partioner parameter also enables custom repartitioning if needed. It's crucial to ensure compatibility and consider potential schema evolution to avoid schema mismatches when reading or updating data. The ability to upgrade and downgrade Hudi versions is available using the Hudi CLI, which allows managing table versions effectively. By following the documented steps, you can create, upgrade, or downgrade tables with different Hudi versions. Overall, the provided documentation supports the use of Hudi 0.12.2 JARs for exporting a snapshot with a Hudi 0.14.1 table efficiently.

Source URLs:

• https://hudi.apache.org/docs/snapshot_exporter
• https://hudi.apache.org/docs/faq_storage
• https://hudi.apache.org/docs/deployment

[torvalds-dev[bot]]

To export a Hudi snapshot with Hudi 0.14.1 table, it is acceptable to use Hudi 0.12.2 JARs based on the provided documentation snippet. The Hudi Snapshot Exporter tool allows copying a dataset to a target path using the specified JARs. Additionally, the tool supports converting datasets to other formats like JSON or Parquet. The output partioner parameter also enables custom repartitioning if needed. It's crucial to ensure compatibility and consider potential schema evolution to avoid schema mismatches when reading or updating data. The ability to upgrade and downgrade Hudi versions is available using the Hudi CLI, which allows managing table versions effectively. By following the documented steps, you can create, upgrade, or downgrade tables with different Hudi versions. Overall, the provided documentation supports the use of Hudi 0.12.2 JARs for exporting a snapshot with a Hudi 0.14.1 table efficiently.

Source URLs:

• https://hudi.apache.org/docs/snapshot_exporter
• https://hudi.apache.org/docs/faq_storage
• https://hudi.apache.org/docs/deployment

[torvalds-dev[bot]]

Thanks, that answers my question.

[torvalds-dev[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/torvalds-dev/hudi/issues/71