Create cupid workflow - Githubissues

ESMCI / ccs_config_cesm

CESM CIME Case Control System configuration files

3 stars 44 forks source link

Create cupid workflow #176

Open ingridc2051 opened 1 month ago

ingridc2051 commented 1 month ago

Create a new workflow to allow users to run CUPiD after the short-term archiver.

mnlevy1981 commented 1 month ago

Before this PR can be opened up for review and merged in:

[ ] generate_cupid_config.py needs to under version control (probably in CUPiD?)
[ ] CUPiD needs to be added as an external in CESM (tools/CUPiD?)
[ ] generate case.cupid from the template instead of .case.cupid

A second PR to make CUPiD more usable would include

[ ] Add a RUN_CUPID_ANALYSIS flag to env_run.xml (default FALSE)
[ ] Move case.cupid to the default workflow, dependent on DOUT_S and RUN_CUPID_ANALYSIS both being true

mnlevy1981 commented 4 days ago

@jedwards4b What controls whether template.cupid becomes case.cupid (visible) or .case.cupid (hidden)? It's currently the latter, but I think we want it to be visible?

jedwards4b commented 4 days ago

I think that case.st_archive might be a hardcoded special case in the python - I'll look at the code tomorrow and let you know.

jedwards4b commented 4 days ago

In utils.py at line 2533. I think that we should remove that and make it an option in the config_workflow.xml file instead.

mnlevy1981 commented 4 days ago

Cool, I'll make do with the file being hidden for now but we can talk about what it would look like to add a hide_script option to config_workflow.xml and then let CIME's get_batch_script_for_job() depend on that. I assume we'd want the default to be True and case.st_archive (and case.cupid) would set it to False?