environmental-forecasting / model-ensembler

Model Ensemble tool for batch workflows on HPCs
https://pypi.org/project/model-ensembler/
MIT License
13 stars 1 forks source link

Detach cluster implementations from batcher execution code #8

Open JimCircadian opened 3 years ago

JimCircadian commented 3 years ago

ensure the slurm specific functionality is detached from the generic execution model

This will be related to the additional backends ticket as well. The model_ensemble.cluster package will contain these (it already exists as of 0.5.0)

JimCircadian commented 3 years ago

A big item here is to document the ability to use batch_config (which I think I put in) and get rid of slurm specific options the batch config and validation