GoogleCloudPlatform / bigquery-utils

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
https://cloud.google.com/bigquery/
Apache License 2.0
1.07k stars 269 forks source link

Deploy UDFs to all regions in bqutil #404

Closed afleisc closed 2 months ago

afleisc commented 2 months ago

If the project deploying UDFs is bqutil, add a region specific suffix to the datasets to avoid naming conflicts. The naming convention is documented in udfs/region_to_dataset_suffix_map.yaml

danieldeleo commented 2 months ago

Disregard, tests are failing due to missing EU cloud storage bucket

danieldeleo commented 2 months ago

Investigate why BQ_LOCATION is not being used for non-us dataset names.

Also modify

https://github.com/GoogleCloudPlatform/bigquery-utils/blob/51ab448f26ef89dcdc25ba0b3bf22e67222c34ed/release/build.sh#L139

to delete region specific test dataset when error occurs

Sorry, this still needs to be addressed before we merge

danieldeleo commented 2 months ago

Closing in favor of #405