-
### What happened?
npm package version of `apache-beam` is 2.49.0 at https://www.npmjs.com/package/apache-beam while the latest version on github is 2.58.0-SNAPSHOT.
### Issue Priority
Priority: 3 …
-
# Note Log sink publishing delays - I see an hour+ on certain sinks - when using pubsub we are near realtime
thank you team for - https://support.google.com/a/answer/7061566
## Results
### Log Si…
-
### What needs to happen?
This should be done after #31677
Require Build Beam with Java11+. Therefore enable to use newer gradle plugins that already dropped Java8 support. The released Beam artif…
Abacn updated
1 month ago
-
### Prize category
Best Content
### Overview
Applying the Impact Framework to measure carbon emissions resulting from our use of GCP dataflow pipelines to train models.
The final goal is wri…
-
Hello,
I'm running prometheus stackdriver exporter to collect Dataflow and BigQuery metrics. The strange thing is that Dataflow metrics (and others) work fine, however BigQuery metrics simply do no…
-
### What would you like to happen?
As of pyiceberg release of 0.6.0 pyiceberg gives the read write capability to read and write data to iceberg table format in Python. It will be good if we have a So…
-
### What happened?
There's a ctor argument output_fn to WriteToFiles that isn't used other than setting a member variable that is never read:
https://github.com/apache/beam/blob/0d58d23f2d9c34ae5f…
-
I am trying to use a dataflow job with a service account.
I am using the GcpOptions flags --serviceAccountKeyfile="dataflow-service-account.p12" --serviceAccountName="dataflow"
I am getting follow…
-
### What needs to happen?
It seems that one of the python libraries Beam uses, js2py, has a vulnerability:
[CVE-2024-28397](https://nvd.nist.gov/vuln/detail/CVE-2024-28397)
[Exposure](https://g…
-
### What happened?
I am running a Beam pipeline in Google Dataflow (Beam SDK version `2.56.0`) that reads messages from Pub/Sub and writes data to a BigQuery table using the STORAGE_WRITE_API metho…