-
### Related Template(s)
oracle_to_bigquery
### Template Version
2024-03-06-00_rc00
### What happened?
I'm trying to use the "bigQuerySchemaPath" template parameter in order to create the BQ table…
-
There are two integration tests which never executed:
- `bigtable-dataflow-parent/bigtable-beam-import/src/test/java/com/google/cloud/bigtable/beam/sequencefiles/EndToEndIT.java`
- `bigtable-dataf…
-
### What happened?
I have a Batch pipeline that reads data from **Firestore** and writes it to **BigQuery**
```
pipeline
.apply(Create.of("myCollection"))
.apply("QueryReq…
-
### What happened?
Scenario:
- Java
- using Dataflow
- 2.45.0
- streaming
- streaming engine disabled
- using `GroupIntoBatches.WithShardedKey` (for example `BigQueryIO.Write.withAutoSharding`)…
-
I think this one has some potential applications , as sdk is just in java, python and go...
https://beam.apache.org/documentation/sdks/python/
so a Python / F# example of some apache beam transf…
-
I am trying to use a dataflow job with a service account.
I am using the GcpOptions flags --serviceAccountKeyfile="dataflow-service-account.p12" --serviceAccountName="dataflow"
I am getting follow…
-
# Note Log sink publishing delays - I see an hour+ on certain sinks - when using pubsub we are near realtime
thank you team for - https://support.google.com/a/answer/7061566
## Results
### Log Si…
-
w/ FallThrough and ReferenceEquality being disabled due to #2638 and #2639 respectively, compiling JDK w/ error-prone leads to `c.g.c.util.concurrent.ExecutionError: java.lang.AssertionError: case vis…
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
hson2 updated
10 months ago
-
### What happened?
More details are here: https://stackoverflow.com/questions/64526500/using-writetobigquery-file-loads-in-a-streaming-pipeline-just-creates-a-lot-of-t
### Issue Priority
Priority…