ioos / colocate

Co-locate oceanographic data by establishing constraints
MIT License
5 stars 9 forks source link

Add joblib for parallel ERDDAP AdvancedSearch query #26

Closed mwengren closed 3 years ago

mwengren commented 3 years ago

Resolves parallelization of ERDDAP Advanced Search in #14 (non 'extra-credit' part).

It is still prone to delay waiting for the 'last' ERDDAP to respond, as I wasn't able to figure out how to implement the 'timeout' parameter in joblib.Parallel (docs)and still retrieve results from the other sub-processes. If anyone knows how to do this, please submit another PR!

MathewBiddle commented 3 years ago

Looks good @mwengren!!