brettc / partitionfinder

PartitionFinder discovers optimal partitioning schemes for DNA sequences.
Other
61 stars 44 forks source link

chunk tasks for analysis #119

Closed roblanf closed 8 years ago

roblanf commented 8 years ago

based on observations and tests which show that exceptionally long task pools are very slow to execute.

We now chunk tasks such that each there are ~10 tasks per available processor in each chunk. This is an attempt to balance efficiency against the limitation identified here.