Closed mpadge closed 6 years ago
Format has changed from 2017 -> 2018 from all fields quoted to only non-numeric fields quoted
Fixed the format change; still have to properly process the new annual dump files for 2011-2013
They've gone and implemented separate station tables, and these don't map on to all stations in the data files. Bloody idiots! Anyway, most of the work addressed in this commit, but still not quite there.
2011-12 have now been bundled as annual files, and two extra files of station data are also now in the S3 bucket. These need to be properly processed for the tests to work once again.