The CLI GX interface configured data connectors that essentially adds a database schema (so tables added to that schema automatically become available to GX). The GX team is deprecating the CLI interface in favor of a more pythonic workflow. I can still maintain my prior connector schema as a "block-config", but switching from a CLI interface to a more pythonic interface might enable me to automate away a rather high friction mode-change in the development process. So I'm willing to explore the new interface.
Using the new interface means each table I want to set expectations for must be explicitly registered. The update pipeline can handle automatically registering expectations. The data_raw.temp_ table and data_raw persistent tables are easy candidates. I'm not sure if it makes sense to register views, so I'll hold off on registering the _standardized and _clean views.
The CLI GX interface configured data connectors that essentially adds a database schema (so tables added to that schema automatically become available to GX). The GX team is deprecating the CLI interface in favor of a more pythonic workflow. I can still maintain my prior connector schema as a "block-config", but switching from a CLI interface to a more pythonic interface might enable me to automate away a rather high friction mode-change in the development process. So I'm willing to explore the new interface.
Using the new interface means each table I want to set expectations for must be explicitly registered. The update pipeline can handle automatically registering expectations. The
data_raw.temp_
table anddata_raw
persistent tables are easy candidates. I'm not sure if it makes sense to register views, so I'll hold off on registering the_standardized
and_clean
views.