-
### Related Template(s)
kafka_to_bigquery_flex
### Template Version
2024-11-06-01_rc00
### What happened?
When using the DirectRunner I got the following error:
> BigQueryWriteUtils.BigQueryDy…
-
### What needs to happen?
upgrade Apache Beam to 2.60.0
### Issue Priority
Priority: 2
### Issue Component
Component: Beam
-
I am using Apache Beam with Google Dataflow in Java and I am trying to migrate the java lib from v2.51.0 to v2.59.0
We are using ANTLR v4.11.1 as a dependency of our Beam Pipeline.
With the v2.5…
-
### What happened?
#32482 attempted to improve BQ Avro schema and type conversion logic, but it still seems to not handle FLOAT type properly (though I think it wasn't working before this refactorin…
-
### What happened?
Test env details:
Python 3.11.3
Beam SDK version: 2.60.0
Hello! We want to use generic types as a type annotation for elements in Pardo in Python SDK to improve code readabi…
-
The output of this task is to publish Java SDK distroless variants:
- apache/beam_java17_sdk_distroless
- apache/beam_java21_sdk_distroless
-
### What would you like to happen?
This is more a question than a feature request.
I was wondering... Why I don't see any OpenTelemetry related issue on Apache Beam? Is it because the runners alre…
-
### What would you like to happen?
Currently batch size [1] is not one of the configurable parameters available to cross-language Python JDBC write transform [2][3]. Should be just a matter of wiring…
-
### What would you like to happen?
Apache Beam lacks a native Python-based IO connector that can ingest data directly from a socket. This feature would enable users to easily integrate streaming da…
-
### What needs to happen?
There are a few targeted fixes needed for the Enrichment docs:
- https://beam.apache.org/documentation/transforms/python/elementwise/enrichment/ should mention BigQuery
…