Data alert tool to run before running the recipe

[valeriupredoi]

How'd peeps feel about having a command-line based tool that the user can run before running their recipe(s) and it'll tell them if data from the recipe(s) is missing (and which data is missing, obviously; input can be standard: config user and recipes, if more than one; infrastructure is straightforward from ESMValCore; the reason why I ask this here is this is a diagnostic developer's helper tool even if its location will be in Core). I can start working on this right now if folk consider it useful, and can probably implement it using the Intake library so we can use it as a test bed for the actual data finder in the tool. Opinions, suggestions, beer below pls -> @bouweandela @ledm @mattiarighi @jvegasbsc @axel-lauer

[axel-lauer]

Sounds awesome!!! I would love to have a tool like this!

[jvegreg]

It will be very nice to have this, indeed. But, what do we want from this tool exactly? Just looking for all the datasets? Or also read and check them?

It looks like something that we can do with a command line option on the recipe launch, something like --check-data

[valeriupredoi]

indeed! a command line option (no need to create a new executable) is just about enough in my view - and I didn't think of cmor checks but that's a good idea! So maybe two options: --check-data-availability and --check-data-compliance?

[valeriupredoi]

https://github.com/ESMValGroup/ESMValCore/pull/307

[bouweandela]

Related issue https://github.com/ESMValGroup/ESMValCore/issues/138

[ledm]

Did this ever happen? A --dry-run option would be extremely useful!

[valeriupredoi]

this should be sorted by Core #917 indeed