search

CABLE-LSM / benchcab

Tool for evaluation of CABLE land surface model
https://benchcab.readthedocs.io/en/latest/
Apache License 2.0
2 stars 4 forks source link

Generalise parallel code. #156

Open bschroeter opened 1 year ago

bschroeter commented 1 year ago

Parallel code is currently replicated across the system, it would be good to have a generic interface to do this.

For example:

https://github.com/CABLE-LSM/benchcab/blob/b5fe7fd12c2670c15a4d4b8269cfdccce521fede/benchcab/fluxsite.py#L375-L391

https://github.com/CABLE-LSM/benchcab/blob/b5fe7fd12c2670c15a4d4b8269cfdccce521fede/benchcab/comparison.py#L61-L81

I've written a thing that does this. We could start from here?

https://github.com/bschroeter/blush

bschroeter commented 1 year ago

Do we want to look into graph dependency architecture? https://networkx.org

bschroeter commented 1 year ago

This can be done quickly if we leverage Blush, but depends on scope.

ccarouge commented 1 year ago

If we are going into graph dependency, then we'll need to use cylc. No reason to duplicate the tools.