[ ] bug fix PR with no breaking changes — please ensure the base branch is main
[x] new functionality — please ensure the base branch is the latest dev/ branch
[ ] a breaking change — please ensure the base branch is the latest dev/ branch
Description & motivation
Resolves #50
By default, generate_source generates the source definitions for all tables in a schema. With very big schemas, sometimes, you only wish to generate the schema for a selected set of tables. This PR adds an optional arg called table_names to generate_source that takes a list of tables.
Note on Testing
The instructions for testing locally were not clear but with some trial and error, the following steps were performed to run the integration tests
Created a bigquery profile called integration_tests
Ran the create_source_table operation using run-operation from console.
Ran dbt sed to create the ...raw_data schema and the data__a_relation table within.
Ran all integration tests
Added a new test to check the added feature
Also tested on a real-life dbt project by including the package locally and running the generate_source command.
Checklist
[x] I have verified that these changes work locally
[x] I have updated the README.md (if applicable)
[x] I have added tests & descriptions to my models (and macros if applicable)
This is a:
main
dev/
branchdev/
branchDescription & motivation
Resolves #50 By default,
generate_source
generates the source definitions for all tables in a schema. With very big schemas, sometimes, you only wish to generate the schema for a selected set of tables. This PR adds an optional arg calledtable_names
togenerate_source
that takes a list of tables.Note on Testing
The instructions for testing locally were not clear but with some trial and error, the following steps were performed to run the integration tests
integration_tests
create_source_table
operation usingrun-operation
from console.dbt sed
to create the...raw_data
schema and thedata__a_relation
table within.Also tested on a real-life dbt project by including the package locally and running the
generate_source
command.Checklist