search

dwdyer / watchmaker

The Watchmaker Framework for Evolutionary Computation
https://watchmaker.uncommons.org
Apache License 2.0
206 stars 79 forks source link

Batch evaluation #29

Open virl opened 7 years ago

virl commented 7 years ago

When using this framework with external evaluation code (that uses network or scripts written in another languages), it is crucial and very important to have ability to evaluate candidates in batches.

One of the examples of such need is when you're calling external script that have large "heating up" time (due to library loading, etc) that is larger than useful evaluation work that it does.

Another example is when your generational population data stored in network database and worker processes that evolve it are residing on different computers — so it's too expensive (time-wise) to transfer same populace-bound data for evolution of each candidate.

virl commented 7 years ago

Basically I need something like this: https://github.com/drone-ah/watchmaker/commit/15f850adebe6aec84459cdd1b79e1ff0dd06031b