-
Hi Everyone,
We are trying to add some threats to the Pytm sources. We are trying to figure out which categories to use for the threats. The categories are causing use trouble.
Here are some exa…
-
**Describe the bug**
When performing joins over nested queries (even simple ones), the performance varies drastically based on the number and position of the nested queries. For example, we can have …
-
During a Stream Job, when you insert records to BigQuery in batch using the FILE_LOADS option and one of the jobs fail, the thread who failed is getting stuck and eventually it saturates the Job resou…
-
Since porting to 2.1.0, Dataflow is leaving Datasets/Tables behind in BigQuery when the pipeline is cancelled or when it fails. We've been on 1.8.0/1.9.0 previous to this, and we've never see this bef…
-
```
What steps will reproduce the problem?
The issue here is that the number of fields in the Schema and the number of
fields in the delimited text file are different, the delimited text file has
t…
-
### What happened?
When writing to BQ with streaming inserts, we do some serializing to JSON and int values can have a maximum value of < 2^64. Writing ints of higher value than this results in a `Ty…
-
Getting false positive while using Nullness checker.
```
public class Main {
public void example() {
String str = null;
if (true) {
str = new String();
…
-
### What happened?
Beam 2.46.0
Java 11
Flink 1.15
My pipeline is consuming from streaming source (AWS Kinesis) and writes to parquet files once per minute.
When restarting it from a Flink s…
-
### What would you like to happen?
Support [Resource Hints](https://beam.apache.org/documentation/runtime/resource-hints/).
Specifically being able to apply min_ram and accelerator hints at minimu…
-
### What happened?
```java
Schema schema = Schema.builder()
.addInt64Field("id")
.addStringField("json")
.build();
Schema outputSchema =…