dataform-co / dataform

Dataform is a framework for managing SQL based data operations in BigQuery
https://cloud.google.com/dataform/docs
Apache License 2.0
851 stars 163 forks source link

Bigquery labels not associated with jobs #1870

Open mguidoti opened 1 week ago

mguidoti commented 1 week ago

It would be nice to have these labels also associated with jobs, for governance and cost-tracking related goals.

I noticed that this was discussed in the past, and that there was a PR that solved the issue, but I'm still not seeing them in there (checking on INFORMATION_SCHEMA.JOBS). I can only see these labels in the query field, under the table definition.

Here's how I defined the labels:

config {
  database: require('includes/project_ids').first2,
  type: "table",
  tags: ["second-attempt"],
  bigquery: {
    labels: {
    "lemoncake-env": "dev"
    }
  }
}

Is this the expected behavior? Or am I doing something wrong?

Thanks in advance,

astorrs commented 1 week ago

Can confirm this is no longer working.