Use fixed fields from jobs view in shredder_progress

[BenWu]

View currently fails because query_info struct is different between these projects right now (sometimes?)

┆Issue is synchronized with this Jira Task

[dataops-ci-bot]

Integration report for "Exclude query_info from jobs view in shredder_progress"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 17:26:04.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 17:25:52.000000000 +0000 @@ -42,12 +42,12 @@ jobs AS ( -- https://cloud.google.com/bigquery/docs/information-schema-jobs SELECT - * + * EXCEPT (query_info) FROM `moz-fx-data-shredder.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` UNION ALL SELECT - * + * EXCEPT (query_info) FROM `moz-fx-data-bq-batch-prod.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` ), ```

Link to full diff

[dataops-ci-bot]

Integration report for "Use fixed fields from jobs view in shredder_progress"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 17:48:44.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 17:48:27.000000000 +0000 @@ -42,20 +42,34 @@ jobs AS ( -- https://cloud.google.com/bigquery/docs/information-schema-jobs SELECT - * + creation_time, + start_time, + end_time, + state, + error_result, + job_id, + project_id, + total_bytes_processed AS bytes_complete, + total_slot_ms AS slot_ms, FROM `moz-fx-data-shredder.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` UNION ALL SELECT - * + creation_time, + start_time, + end_time, + state, + error_result, + job_id, + project_id, + total_bytes_processed AS bytes_complete, + total_slot_ms AS slot_ms, FROM `moz-fx-data-bq-batch-prod.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` ), successful_jobs AS ( SELECT - *, - total_bytes_processed AS bytes_complete, - total_slot_ms AS slot_ms, + * FROM jobs WHERE ```

Link to full diff

[dataops-ci-bot]

Integration report for "Merge branch 'main' into benwu/shredder-progress-except"

sql.diff

Click to expand!

```diff diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql --- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 18:16:23.000000000 +0000 +++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring/shredder_progress/view.sql 2024-06-06 18:16:21.000000000 +0000 @@ -42,20 +42,34 @@ jobs AS ( -- https://cloud.google.com/bigquery/docs/information-schema-jobs SELECT - * + creation_time, + start_time, + end_time, + state, + error_result, + job_id, + project_id, + total_bytes_processed AS bytes_complete, + total_slot_ms AS slot_ms, FROM `moz-fx-data-shredder.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` UNION ALL SELECT - * + creation_time, + start_time, + end_time, + state, + error_result, + job_id, + project_id, + total_bytes_processed AS bytes_complete, + total_slot_ms AS slot_ms, FROM `moz-fx-data-bq-batch-prod.region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT` ), successful_jobs AS ( SELECT - *, - total_bytes_processed AS bytes_complete, - total_slot_ms AS slot_ms, + * FROM jobs WHERE ```

Link to full diff