kymata-atlas / kymata-core

Core Kymata codebase, including statistical analysis and plotting tools
https://kymata.org
MIT License
5 stars 0 forks source link

Ability to easily submit gridsearches for multiple functions to the queue in parallel #237

Closed caiw closed 4 months ago

caiw commented 4 months ago

After discussion with @ollieparish and @young-x-skyee: Because there's a limit of about 4 concurrent queue jobs at the CBU, and because loading the data takes quite a long time, it makes more sense to run different functions in sequence after loading the data once, and sbatch-parallelise a different set of parameters (or e.g. sbatch over ANN layers, with nodes within the layers run in sequence).