stsievert / salmon

A tool to collect triplet queries
https://docs.stsievert.com/salmon/
BSD 3-Clause "New" or "Revised" License
9 stars 2 forks source link

Run adaptive model update and query search in parallel #61

Closed stsievert closed 4 years ago

stsievert commented 4 years ago

Why not run the query search and model update in parallel? Currently they're sequential.

This will eliminate the need to balance between time spent searching and time spent updating, at least for a moderately small number of adaptive algorithms. It should be fine to run in parallel as long as there are Dask workers/cores available.

35 is relevant because executing in parallel will require that some basic inter-process communication.