This PR consists of changes to the preprocessing notebooks for the following Rasdaman coverages:
annual_mean_temp
annual_precip_totals
jan_min_max_mean_temp
july_min_max_mean_temp
heating_degree_days
degree_days_below_zero
thawing_index
freezing_index
We make use of the "Alaska Coast Simplified" shapefile in the ua-snap/geospatial-vector-veracity repo to mask the above datasets and crop the new extent of valid data in an ad hoc fashion using gdalwarp. This significantly reduces the sizes of the resulting datasets.
In addition to the masking and cropping, there are some changes to fix an issue with the resulting coverages in Rasdaman. (Should have made an issue for this!) The realized encoded values for the model dimension for the first four coverages listed above ranged from -1 to 5, instead of 0 to 6 as specified in the luts.py files. This was due to the import order of files and the known requirement to match file import order with the order of encoded values, with CRU-TS files actually being imported first, likely because of some priority given the year axis when determining import order, not strictly filename.
This PR consists of changes to the preprocessing notebooks for the following Rasdaman coverages:
We make use of the "Alaska Coast Simplified" shapefile in the ua-snap/geospatial-vector-veracity repo to mask the above datasets and crop the new extent of valid data in an ad hoc fashion using
gdalwarp. This significantly reduces the sizes of the resulting datasets.In addition to the masking and cropping, there are some changes to fix an issue with the resulting coverages in Rasdaman. (Should have made an issue for this!) The realized encoded values for the model dimension for the first four coverages listed above ranged from -1 to 5, instead of 0 to 6 as specified in the
luts.pyfiles. This was due to the import order of files and the known requirement to match file import order with the order of encoded values, with CRU-TS files actually being imported first, likely because of some priority given the year axis when determining import order, not strictly filename.There is a lot to test here - no rush @cstephen !