shawnlaffan / biodiverse

A tool for the spatial analysis of diversity
http://shawnlaffan.github.io/biodiverse/
GNU General Public License v3.0
74 stars 19 forks source link

Parallel processing - assess MCE #430

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
Many of the Biodiverse analyses are ludicrously parallel in nature, so parallel 
processing would result in speed gains in many cases.  

MCE looks to be a useful approach.  It installs on Windows using cpanm, but 
there are no cpan testers results that I could see.  

https://metacpan.org/module/MCE

As a start, uses of map and grep might be sped up where the block is complex.  

Original issue reported on code.google.com by shawnlaffan on 27 Jan 2014 at 9:24

GoogleCodeExporter commented 9 years ago
This issue was updated by revision r3026.

Don't call a method on an undef value.  Part of the experimentation to get MCE 
working with Biodiverse, albeit it appears that MCE does not like unsuccessful 
eval calls.

Original comment by shawnlaffan on 15 Nov 2014 at 10:07