Adds a new tfdataset loader that will take in a single netCDF file as the path. This was useful for the SST training, since we're training a single model per tile and the SST dataset is loaded in a single netCDF. The adjustment meant I could keep the directory structure of the training files flat for each tile instead of having to have a directory for each file.
Added public API:
new TFDatasetLoader dataclass, NCFileLoader that takes in a filepath and a dim_order.
Significant internal changes:
Added a new _BaseNCLoader class for shared functionality between NCFileLoader and NCDirLoader
Adds a new tfdataset loader that will take in a single netCDF file as the path. This was useful for the SST training, since we're training a single model per tile and the SST dataset is loaded in a single netCDF. The adjustment meant I could keep the directory structure of the training files flat for each tile instead of having to have a directory for each file.
Added public API:
TFDatasetLoaderdataclass,NCFileLoaderthat takes in afilepathand adim_order.Significant internal changes:
Added a new
_BaseNCLoaderclass for shared functionality betweenNCFileLoaderandNCDirLoader[x] Tests added
Coverage reports (updated automatically):