Refactor data.py for abstract base class, class for every current data source and main.py refactor accordingly data.py functionality is interfaced via the data_factory function which is included in data.py. Now easy to add new data sources, full support for either GCP BQ or API requests utilising data fetching utility in ml_logic/utils.
Refactor data.py for abstract base class, class for every current data source and main.py refactor accordingly data.py functionality is interfaced via the data_factory function which is included in data.py. Now easy to add new data sources, full support for either GCP BQ or API requests utilising data fetching utility in ml_logic/utils.