Open windiana42 opened 5 months ago
@NMAC427 @nicolasmueller any objection to go with:
@cached_property
def effective_auto_table(self) -> tuple[type, ...]:
return tuple(*map(import_object, self._config_dict.get("auto_table", ())), ExternalTableReference)
It would make sense if a task could simply return an ExternalTableReference without the surrounding pipedag.Table() object. This can be realized by simply adding the class to the auto_table configuration. It would be strange to ask users to set this sensibly which is why it could also be automatically added in the
ConfigContext
property:It might be nice to change the name of the property a bit (i.e. enriched_auto_table) such that it is not assume that its content is identical to the auto_table config_dict entry.