GoogleCloudDataproc / spark-bigquery-connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Apache License 2.0
378 stars 198 forks source link

Idempotent write support in BQ #1199

Open SubhamSinghal opened 8 months ago

SubhamSinghal commented 8 months ago

Enable idempotent write in BQ. This is similar to Databricks idempotent write. link