Motivation
Currently, a configuration file determines the number of bands pulled from the NetCDF during preprocessing, and this data is fed into the model which excepts only a specific band number. This process would require multiple different preprocessed combinations to be created, which presents a storage and time issue. In order to address this, we will change the preprocessing pipeline so that only GeoTIFFs with 6 bands will be created, and process which converts GeoTIFFs to model input will work off the config.py to select the appropriate bands.
Changes
Updates data_preparer.py PixelListPreparer.add_to_dataset() to include an input parameter for bands. This parameter allows the user to select which bands will be added to PixelListPreparer.dataset.
Updated docstring to include information about the function, parameters, and return.
Merge Ramifications
None. Although data_preparer.py PixelListPreparer.add_to_dataset() gained a new parameter, this was given a default value that will preserve old functionality when merged to master.
xhagrg
commented
4 years ago
Motivation Currently, a configuration file determines the number of bands pulled from the NetCDF during preprocessing, and this data is fed into the model which excepts only a specific band number. This process would require multiple different preprocessed combinations to be created, which presents a storage and time issue. In order to address this, we will change the preprocessing pipeline so that only GeoTIFFs with 6 bands will be created, and process which converts GeoTIFFs to model input will work off the config.py to select the appropriate bands.
Changes Updates data_preparer.py PixelListPreparer.add_to_dataset() to include an input parameter for bands. This parameter allows the user to select which bands will be added to PixelListPreparer.dataset. Updated docstring to include information about the function, parameters, and return.
Merge Ramifications None. Although data_preparer.py PixelListPreparer.add_to_dataset() gained a new parameter, this was given a default value that will preserve old functionality when merged to master.
Trello (3) Structure the process so that the pre-processing is not repeated