mozilla / bigquery-etl

Bigquery ETL
https://mozilla.github.io/bigquery-etl
Mozilla Public License 2.0
241 stars 98 forks source link

[DENG-3918] Ignore glean stable tables with no client id for shredder #5783

Closed BenWu closed 2 weeks ago

BenWu commented 2 weeks ago

https://mozilla-hub.atlassian.net/browse/DENG-3918

Depends on https://github.com/mozilla-services/cloudops-infra/pull/5721 and https://github.com/mozilla/mozilla-schema-generator/pull/268

Skip stable tables for pings that have include_client_id: false. Default to true. This will skip 181 tables. Tables are in the query in this comment https://mozilla-hub.atlassian.net/browse/DENG-3918?focusedCommentId=894752

Checklist for reviewer:

For modifications to schemas in restricted namespaces (see CODEOWNERS):

┆Issue is synchronized with this Jira Task