The data reading function will now fail if one of the datasets fails. It would be nice to change it such that we catch errors, print warnings instead, and then continue.
Also, we could make it such that it can be run both as a function (imported in a notebook), but also as a standalone script that simply saves the data in a cleaned format. For example: python clean_data.py.
Finally, it might make sense to rename the functions to "postprocess_wam2layers()" etc., or "polish_wam2layers()", "standardize_wam2layers()". So if someone comes along with new results, they can easily import and reuse our postprocessing code.
The data reading function will now fail if one of the datasets fails. It would be nice to change it such that we catch errors, print warnings instead, and then continue.
Also, we could make it such that it can be run both as a function (imported in a notebook), but also as a standalone script that simply saves the data in a cleaned format. For example:
python clean_data.py.Finally, it might make sense to rename the functions to "postprocess_wam2layers()" etc., or "polish_wam2layers()", "standardize_wam2layers()". So if someone comes along with new results, they can easily import and reuse our postprocessing code.