[Julia] Use NCDatasets instead of netCDF - masked values are treated as masked only in NCDatasets

valeriupredoi commented 8 months ago

Description

Closes #2595
Link to documentation:
- *

Before you get started

[ ] ☝ Create an issue to discuss what you are going to do

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

[ ] 🛠 This pull request has a descriptive title
[ ] 🛠 Code is written according to the code quality guidelines
[ ] 🛠 Documentation is available
[ ] 🛠 Tests run successfully
[ ] 🛠 The list of authors is up to date
[ ] 🛠 Any changed dependencies have been added or removed correctly
[ ] 🛠 All checks below this pull request were successful

New or updated recipe/diagnostic

[ ] 🧪 Recipe runs successfully
[ ] 🧪 Recipe is well documented
[ ] 🧪 Figure(s) and data look as expected from literature
[ ] 🛠 Provenance information has been added

New or updated data reformatting script

[ ] 🛠 Documentation is available
[ ] 🛠 The dataset has been added to the CMOR check recipe
[ ] 🛠 The dataset has been added to the shared data pools of DKRZ and Jasmin by the @ESMValGroup/OBS-maintainers team
[ ] 🧪 Numbers and units of the data look physically meaningful

To help with the number of pull requests:

🙏 We kindly ask you to review two other open pull requests in this repository

valeriupredoi commented 4 months ago

@ESMValGroup/technical-lead-development-team any of you folks speaks Julia better than me and can give me a hand here please? It's basically there, just needs a couple more changes in the diagnostics to allow for the new API/package :beer:

bouweandela commented 4 months ago

I saw this at EGU, it uses YAXarrays (Julia clone of Xarray) and GeoMakie (Julia geo plotting library), maybe we could too? https://github.com/mauro3/Julia-intro-for-geoscience-EGU2024/blob/main/notebooks/geo-ecosystem.ipynb

Somehow I couldn't get them to install along our current Julia dependencies though, maybe our Julia dependencies are severely outdated?

valeriupredoi commented 4 months ago

I saw this at EGU, it uses YAXarrays (Julia clone of Xarray) and GeoMakie (Julia geo plotting library), maybe we could too? https://github.com/mauro3/Julia-intro-for-geoscience-EGU2024/blob/main/notebooks/geo-ecosystem.ipynb

Somehow I couldn't get them to install along our current Julia dependencies though, maybe our Julia dependencies are severely outdated?

thanks, bud! The netCDF4 library that I am replacing here is indeed outdated, beats me about the others you mention - unfortunately I have no relationship of any kind with Julia :grin: If you had a minute and took over this, would be fab :beer:

valeriupredoi commented 1 month ago

@dr-ko hey buds, maybe you or your other Julia-savvy colleagues can give us a bit of a hand here? Fame and fortune as rewards :beer:

ESMValGroup / ESMValTool