search

UNSW-CEEM / NEMSEER

A package for downloading and handling forecasts for the National Electricity Market (NEM) from the Australian Energy Market Operator (AEMO).
http://nemseer.readthedocs.io/
GNU General Public License v3.0
22 stars 3 forks source link

Handle invalid/corrupted zips #16

Closed prakaa closed 2 years ago

prakaa commented 2 years ago
  1. Catch exception and continue downloading other files in query
  2. Write faulty file to a hidden file
  3. ForecastTypeDownloader behaviours based on faulty zips/csvs in hidden file
  4. Modify DataCompiler behaviour based on faulty zips/csvs in hidden file
prakaa commented 2 years ago

Steps 1 and 2 implemented in cf587e691cd975f72c0434e5807a71b1696367ff, 67f34b587c6a36ab833858d8d103ed8becb8c3b8

prakaa commented 2 years ago

Implemented in 23cf07b6530b7b7bafd396d46f406e95fdb0d25f. Will close once PR merged into master