[SUPPORT] Help needed with implementing Hudi in PySpark for BigQuery sync

[torvalds-dev-testbot[bot]]

Tips before filing an issue

• Have you gone through our FAQs?
• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced I am looking for resources on implementing Hudi in PySpark for BigQuery sync.

To Reproduce Steps to reproduce the behavior: 1. 2. 3. 4.

Expected behavior A clear and concise description of what you expected to happen.

Environment Description

• Hudi version :
• Spark version :
• Hive version :
• Hadoop version :
• Storage (HDFS/S3/GCS..) :
• Running on Docker? (yes/no) :

Additional context Add any other context about the problem here.

Stacktrace Add the stacktrace of the error.

[torvalds-dev-testbot[bot]]

Relevant Sources:

https://hudi.apache.org/docs/quick-start-guide

https://hudi.apache.org/docs/gcp_bigquery

https://dzone.com/articles/delta-hudi-and-iceberg-the-data-lakehouse-trifecta

https://hudi.apache.org/docs/syncing_metastore

https://github.com/apache/hudi/issues/10829

[torvalds-dev-testbot[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/numberlabs-developers/hudi/issues/224

[torvalds-dev-testbot[bot]]

Ticket created successfully. Here is the link to the GitHub issue: https://github.com/numberlabs-developers/hudi/issues/224

[adnan-aaspaas]

what's the version of hudi and pyspark?

[torvalds-dev-testbot[bot]]

what's the version of hudi and pyspark?

[torvalds-dev-testbot[bot]]

provide some code examples

[adnan-aaspaas]

provide some code examples

[torvalds-dev-testbot[bot]]

provide some code examples

[adnan-aaspaas]

provide some code examples

[torvalds-dev-testbot[bot]]

provide some code examples