biigle / laserpoints

:m: BIIGLE module to perform a heuristic laser point detection on images
GNU General Public License v3.0
0 stars 0 forks source link

Enable multi-host queue processing #37

Closed mzur closed 4 years ago

mzur commented 4 years ago

The jobs to process a Delphi laser point detection expect the special file biigle_delphi_gather_output_xxx in the tmp directory. This file exists only on one host. If the queued jobs are processed on multiple hosts, the jobs fail. Use the global cache to store this file so all queue workers can access it.

mzur commented 4 years ago

Or maybe use a storage disk for temporary storage.