-
**Describe the solution you'd like**
Integration with Apache Beam and GCP Dataflow. Ability to use Google Dataflow templates and custom templates in addition to creating pipelines with Apache Beam.
…
-
### Related Template(s)
MongoDB-to-BigQuery
### Template Version
v2
### What happened?
I have function that checks if a field is true or not. If its true then it returns null to skip saving that…
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the commu…
-
How I can use kafka to bigquery template (https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-bigquery or https://github.com/GoogleCloudPlatform/java-docs-samples/tree/mas…
-
To be able to use Cloud Scheduler effectively with the Spanner->Avro template, it would be ideal if https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/master/src/main/java/com/google/cloud/…
-
Hi @kcreddy @andrewkroh @elastic/security-external-integrations (Team:Security-External Integrations)
I am getting the same error.
exception: "java.io.IOException: Error writing to Elasticsearch…
-
### What happened?
`WriteToBigQuery` with `STORAGE_WRITE_API` method can cause a pickling error [1] if
1. The `WriteToBigQuery` step is applied after a multi-output step
2. And, the pipeline variab…
-
### Related Template(s)
MongoDB-to-BigQuery
### What happened?
[Bug]: Dataflow - MongoDB-to-BigQuery batch mode failing with NullPointer for userOption FLATTEN
command:
gcloud dataflow …
-
### Related Template(s)
oracle_to_bigquery
### Template Version
2024-03-06-00_rc00
### What happened?
I'm trying to use the "bigQuerySchemaPath" template parameter in order to create the BQ table…
-
When I run the script, [this line](https://github.com/GoogleCloudPlatform/dlp-dataflow-deidentification/blob/756d5e753f51f5c18c95b3b31a1076a78d044f05/deploy-data-tokeninzation-solution.sh#L60) returns…