search

GeoscienceAustralia / tcrm

A statistical-parametric model for assessing wind hazard from tropical cyclones
http://geoscienceaustralia.github.io/tcrm
Other
83 stars 53 forks source link

Port to mpi4py #74

Open wcarthur opened 5 years ago

wcarthur commented 5 years ago

Maintainers of pypar have indicated they are not planning to upgrade it to python3, instead recommending using mpi4py.

KayShelton commented 4 years ago

I am unable to get ExecuteEvaluate to run in parallel with the new mpi4py implementation. The other modules (TrackGenerator, ExecuteWindfield) do seem to work OK in parallel though. Happy to provide more info if needed, but just wanted to flag up that I have had issues, and running without parallel takes a loooong time.

KayShelton commented 4 years ago

Note, further to this, the processTracks function within the CreateDatabase module uses the same parallel implementation as ExecuteEvaluate, and also fails to process. The other functions to populate the hazard DB see to work OK in parallel.