search

cp4cds / cmip6_range_check_old

CMIP6 Data Range Check: extract and evaluate information about range of data values in CMIP6 datasets.
1 stars 0 forks source link

Masking: some issues in areacello and basin #56

Closed martinjuckes closed 3 years ago

martinjuckes commented 3 years ago

These variables are not in theAR6 WGI request, and that spreadsheet has been used to specify mask variables.

These are read in local_utilities_datasets.WGIPriority class and referenced in the local_utilities_datasets.CMIPDatasetSample.review_masks method.

For now .. add basin and areacello to AR6_priority_variables_02.csv and add some explanations in doc strings.

martinjuckes commented 3 years ago

April 30th: BS/batch_scan_Fixed_All.txt run as job 46124210 areacello and basin added to AR6 list to include mask info. ARGIPriority class moved into generic_utils.

Now had indirect import into some files ... should be fixed.

martinjuckes commented 3 years ago

Problem here is that there are values of 1.e35 in the data which are intended as mask values, but the mask value is set to 1.e20. This appears to cause overflow and can be avoided by setting dtype="float64" in numpy.mean calls.

martinjuckes commented 3 years ago

This coding issue has been resolved. There remains the issue of documenting and reporting the 1.e35 values.