search

hoffmangroup / segway

Application for semi-automated genomic annotation.
http://segway.hoffmanlab.org/
GNU General Public License v2.0
13 stars 7 forks source link

Local Segway should limit number of jobs to the actual amount of processors #41

Open EricR86 opened 9 years ago

EricR86 commented 9 years ago

Original report (BitBucket issue) by Eric Roberts (Bitbucket: ericr86, GitHub: ericr86).

Currently when Segway runs locally it has no "smart" mechanism for detecting the number of actual cores on a system before attempting to run jobs.

Currently the default max is 32.

Ideally this number should be based on a detected number of cores on the system and also stop jobs from consuming too much memory as well.

EricR86 commented 9 years ago

Original comment by Sakura Tamaki (Bitbucket: Tamaki_Sakura).

Presumably the issue "question would be whether we should attempt to reduce that to number of actual cores, ignoring hyperthreading" can be decided easily I suppose by testing it with max 4 against max 8 on a 4 core 8 thread computer. If using max 8 does not increase the time cost then we could let it to be 8.

Using E5-1607 v2 now does not have HT can't do test on mine :)