NOAA-CSL / MELODIES-MONET

MELODIES MONET - diagnostic tool for evaluating models against a variety of observations including surface, aircraft, and satellite data all within a common framework
https://melodies-monet.readthedocs.io
Apache License 2.0
21 stars 31 forks source link

What to do when different models have different numbers of non-null pairs with the obs #245

Open zmoon opened 9 months ago

zmoon commented 9 months ago

@btang1 encountered this in his #238 situation.

This is not something we usually expect to happen with models, since model fields are usually non-null at all time/space and we usually configure things such that multiple models being compared span the same period. But it's not impossible, for example:

Ideas:

We are planning to start with the warning message. And then add the option to drop.

zmoon commented 9 months ago

I can start to work on drop obs( option 2).

Can you start with the warning message? Even when dropping we probably want to print a message with the info of what the differences are / what is being dropped.

btang1 commented 8 months ago

@zmoon I have a branch to add a warning, and I test it works. code start from: https://github.com/btang1/MELODIES-MONET/blob/PairOBS/melodies_monet/driver.py#L1052 code end at: https://github.com/btang1/MELODIES-MONET/blob/PairOBS/melodies_monet/driver.py#L1062 also changed code at : https://github.com/btang1/MELODIES-MONET/blob/PairOBS/melodies_monet/driver.py#L925