Open nightsh opened 4 years ago
[STUB]
While scraping, we can download, extract and investigate the contents of the ZIP files to eliminate zipped resources that don't contain data files.
This would likely be a part of the Airflow DAGs and would likely take a long time to complete (but however, shorter than doing it manually).
To Be Continued...
[STUB]
While scraping, we can download, extract and investigate the contents of the ZIP files to eliminate zipped resources that don't contain data files.
This would likely be a part of the Airflow DAGs and would likely take a long time to complete (but however, shorter than doing it manually).
To Be Continued...