Customer attempted to use the Datastream to BigQuery (Stream) template with PostgreSQL as their source database, intending to leverage merge functionality in BigQuery. However, they ran into a metadata error at point of merging in BigQuery (_metadata_lsn is unrecognized)
Enhance the Datastream to BigQuery (Stream) template to officially support PostgreSQL merges. This would align the template with customer expectations and provide a streamlined solution for replicating and merging PostgreSQL data into BigQuery.
Also, Update and clarify on the public documentation of the Dataflow: Datastream to BigQuery (Stream) template its capabilities and limitations, specially concerning PostgreSQL
Related Template(s)
Datastream to BigQuery (Stream) template
What feature(s) are you requesting?
Customer attempted to use the Datastream to BigQuery (Stream) template with PostgreSQL as their source database, intending to leverage merge functionality in BigQuery. However, they ran into a metadata error at point of merging in BigQuery (_metadata_lsn is unrecognized)
Enhance the Datastream to BigQuery (Stream) template to officially support PostgreSQL merges. This would align the template with customer expectations and provide a streamlined solution for replicating and merging PostgreSQL data into BigQuery.
Also, Update and clarify on the public documentation of the Dataflow: Datastream to BigQuery (Stream) template its capabilities and limitations, specially concerning PostgreSQL