recreate perfmetric plots in python

lukruh commented 6 months ago

Description

Closes #3550
Link to documentation:
- *

Before you get started

[x] ☝ Create an issue to discuss what you are going to do #3550

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

[ ] 🛠 This pull request has a descriptive title
[ ] 🛠 Code is written according to the code quality guidelines
[ ] 🛠 Documentation is available
[ ] 🛠 Tests run successfully
[ ] 🛠 The list of authors is up to date
[ ] 🛠 Any changed dependencies have been added or removed correctly
[ ] 🛠 All checks below this pull request were successful

New or updated recipe/diagnostic

[ ] 🧪 Recipe runs successfully
[ ] 🧪 Recipe is well documented
[ ] 🧪 Figure(s) and data look as expected from literature
[ ] 🛠 Provenance information has been added

New or updated data reformatting script

[ ] 🛠 Documentation is available
[ ] 🛠 The dataset has been added to the CMOR check recipe
[ ] 🛠 The dataset has been added to the shared data pools of DKRZ and Jasmin by the @ESMValGroup/OBS-maintainers team
[ ] 🧪 Numbers and units of the data look physically meaningful

To help with the number of pull requests:

🙏 We kindly ask you to review two other open pull requests in this repository

valeriupredoi commented 6 months ago

what a noble venture, Lukas! Godspeed :checkered_flag: :beer:

lukruh commented 5 months ago

So far we used the distance_metrics prerpocessor from within the recipe, which works but has some limitations in practise and can lead to messy recipes. I added an optional function to apply it from within the plot diagnostic. I.e. use reference_metric: rmse in the script section of the recipe instead of the distance_metric preprocessor. The reference_for_metric facet for the reference dataset i.e. ERA-interim is still required. @diegokam if you are available, you could have a look and try to adjust the recipe accordingly.

mo-gill commented 5 months ago

Hi, we are currently working on the ESMValTool release for v2.11.0. We're wondering if you'd be able to complete this PR by the end of next week (Friday 10th May).

Otherwise, please let us know, and we'll move it into the next milestone for you :slightly_smiling_face:

lukruh commented 5 months ago

I don't see this PR be ready until next week. The next milestone is more realistic I'd say.

rbeucher commented 3 months ago

I just came across this. It looks great. Any progress?

schlunma commented 3 months ago

I just came across this. It looks great. Any progress?

We are working on it 😄 It's planned to include this in v2.12

ESMValGroup / ESMValTool