Grid Integration

[galerykaeser]

• Research available signals and ways of communication between processes
• Research MPI/Open MPI
• Idea: Single grid node that is dedicated only for search
• Idea: Write state of search to disk instead of keeping it as an active job
• Idea: monitoring process that checks whether certain files have been written
• Idea: Evaluate batches of 100 successors

[galerykaeser]

Update:

• Snakemake or Nextflow could be useful
• Alternatively, parallel evaluation of successors could be achieved with Slurm array jobs
  • For this, a permanently active search node could submit array jobs and look for written files holding evaluation results