search

Circuitscape / cloudCS

Circuitscape HTML interface
Other
0 stars 0 forks source link

Parallelize batch mode #10

Closed ViralBShah closed 10 years ago

ViralBShah commented 10 years ago

We should parallelize batch mode, so that each ini file runs on one processor. For now, we can just do it for multicore, but this is not too difficult to make work across lots of nodes. Especially, if resources are being paid for, it is better to spin up more machines and get the answer faster.

tanmaykm commented 10 years ago

Added parallelism to batch execution. Have updated the hosted server where it kicks in if the batch has more than 20 ini files. When a batch runs in parallel, individual runs files are not parallelized further.

bmcrae commented 10 years ago

Are we ready for our first beta tester on this?

ViralBShah commented 10 years ago

It seems we are - @tanmaykm ?

tanmaykm commented 10 years ago

Yes we are. Please send me the e-mail ids that need to be added to the allowed list.

ViralBShah commented 10 years ago

@bmcrae This is currently invite only...

ViralBShah commented 10 years ago

Also, We need gmail ids.

bmcrae commented 10 years ago

Yep, understood.

On Wed, Jan 8, 2014 at 6:17 PM, Viral B. Shah notifications@github.comwrote:

Also, We need gmail ids.

— Reply to this email directly or view it on GitHubhttps://github.com/Circuitscape/cloudCS/issues/10#issuecomment-31896982 .

tanmaykm commented 10 years ago

Closed via https://github.com/Circuitscape/cloudCS/commit/5ac80c81b876807d84c05c5b5575dfbe63736428