Closed achrusciel closed 2 years ago
My fault: the yml-file was misconfigured. This yml-file should look like this:
version: 2
sources:
- name: stage
database: ynab-dwh-dev-01
tables:
- name: ynab_report_test_03
external:
location: 'gs://ynab-dwh-dev-bucket-01/02_ynab/*'
options:
format: parquet
hive_partition_uri_prefix: 'gs://ynab-dwh-dev-bucket-01/02_ynab/'
partitions:
- name: server_knowledge
data_type: int64
--> partitions and options shall be on the same level.
Describe the bug
I have a bucket in region us-west1 and a subfolder 02_ynab. There I store partitioned parquet data in the format 'server_knowledge=15547' etc. I want to access this parquet data through an external table in BigQuery. The generated DDL statement is not correct:
Steps to reproduce
Create a file bigquery_stage.yml with the following contents
Expected results
This SQL-DDL statement works in the BigQuery SQL console:
Actual results
Screenshots and log output
System information
The contents of your
packages.yml
file:Which database are you using dbt with?
The output of
dbt --version
:The operating system you're using: Docker Ubuntu
The output of
python --version
: Python 3.10.5Additional context
requirements.txt