[SUPPORT] Inquiry about using Hudi 0.12.2 JARs with Hudi 0.14.1 Table

[torvalds-dev[bot]]

Tips before filing an issue

• Have you gone through our FAQs?
• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced It is uncertain if using Hudi 0.12.2 JARs with Hudi 0.14.1 Table may encounter any corner cases.

To Reproduce Steps to reproduce the behavior: 1. 2. 3. 4.

Expected behavior A clear and concise description of what you expected to happen.

Environment Description

• Hudi version : 0.14.1
• Spark version :
• Hive version :
• Hadoop version :
• Storage (HDFS/S3/GCS..) :
• Running on Docker? (yes/no) :

Additional context Add any other context about the problem here.

Stacktrace Add the stacktrace of the error.

[torvalds-dev[bot]]

Relevant Sources:

https://hudi.apache.org/docs/faq_storage

https://hudi.apache.org/docs/deployment

https://hudi.apache.org/docs/faq_integrations

https://hudi.apache.org/docs/troubleshooting

https://github.com/apache/hudi/issues/10358

[torvalds-dev[bot]]

Hello! 👋 Please wait while I search the knowledge base for an answer; this usually takes about 30 seconds

[torvalds-dev[bot]]

The Hudi Snapshot Exporter process does involve referencing specific Hudi JAR versions like "hudi-spark-bundle_2.11-0.14.0-SNAPSHOT.jar" for both copying Hudi datasets and exporting them to different formats like JSON or Parquet. These JAR versions are crucial components for the Exporter tool to function properly. However, the documentation does not explicitly mention any limitations or compatibility issues when using different Hudi JAR versions when exporting Hudi Snapshots with different table versions. The focus remains on the technical steps and commands involved in the export process rather than on version compatibility checks. Therefore, while you may not have encountered any immediate issues using Hudi 0.12.2 JARs with Hudi 0.14.1 table during the export process, it is recommended to exercise caution and conduct further testing to ensure compatibility in all scenarios. Remember, ensuring version consistency can help mitigate potential corner cases and unexpected behavior during Snapshot exports with Hudi tables of different versions.

Sources:

• https://hudi.apache.org/docs/snapshot_exporter
• https://hudi.apache.org/docs/sql_queries

[torvalds-dev[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/torvalds-dev/hudi/issues/69