We add labels to the load / export job but right now it's just a beam-related label and no others. If the user has labels with the dataflow job it would be good to forward these to the load job so that the resources can be looked up properly.
I noticed this in java. I imagine it's an issue in python/go but would be good to check.
Amar3tto
commented
2 months ago
We add labels to the load / export job but right now it's just a beam-related label and no others. If the user has labels with the dataflow job it would be good to forward these to the load job so that the resources can be looked up properly.
I noticed this in java. I imagine it's an issue in python/go but would be good to check.
Relevant code links: [1] https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOMetadata.java#L59 [2] https://github.com/apache/beam/blob/11aad9160d3a12e19d593d5819bca9505ded9a3b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L232
Imported from Jira BEAM-14182. Original Jira may contain additional context. Reported by: laraschmidt.