org-arl / arlpy

ARL Python Tools
BSD 3-Clause "New" or "Revised" License
118 stars 37 forks source link

compute_arrivals and compute_eigenrays do not work in parallel #95

Closed SquirrelKnight closed 8 months ago

SquirrelKnight commented 8 months ago

Hello,

I am currently working on a project to derive raypaths for thousands of receiver/transmitter pairs (between an autonomous vehicle and a seafloor transponder). Because of this, I was hoping to implement parallel functionality using a fairly simple script and joblib. Unfortunately, it seems that Bellhop is unable to deal with this. I get the following messages.

[BELLHOP] FATAL ERROR [BELLHOP] Generated by program or subroutine: BELLHOP - READIN [BELLHOP] Unable to open the environmental file [BELLHOP]

When running my script in series, it functions just fine.

Parallelization compatibility would be an excellent addition.

SquirrelKnight commented 8 months ago

I have discovered that the issue was with joblib. Apparently joblib is not able to access the temporary directory for parallel processing: https://github.com/joblib/joblib/issues/391

Dask parallel processing works great, however.

mchitre commented 8 months ago

Glad to know that this was resolved.