ci-group / revolve

Robot evolution framework for the Triangle of Life project
https://evosphere.eu/
29 stars 32 forks source link

(important) the errors for memory and runs #67

Open langongjin opened 4 years ago

langongjin commented 4 years ago

when we run the experiments (e.g., the branch learners) for n_jobs (run in a core). each run in a core will consume a lot of memory. After a lot of testing and meet a lot of weird problems, I finally found the rough consume memory for each run in a core. It is about 4 Gbits each n_jobs (run in a core). Therefore, generally, do not run more than 16 cores for 64 Gbits memory on ripper1/ ripper2/ripper3.

If you run more cores, you will probably meet the problem like: image If you run 16 cores on ripper1/ripper2/ripper3, you will see the perfect ending like: image note that 1500 is the terminal iteration.

for more computing platform, we could calculate it with 4 Gbits per cores at least.