search

kengz / SLM-Lab

Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".
https://slm-lab.gitbook.io/slm-lab/
MIT License
1.25k stars 264 forks source link

every trial startup NUM_EVAL envs #379

Closed lidongke closed 5 years ago

lidongke commented 5 years ago

if i have an empty _random_baseline.json, every trial will startup NUM_EVAL envs to compute random_baseline at the same time, but this has a problem, my CPU memory can not allow so many envs, it will crash. i.e NUM_EVAL = 20 max_trial = 4 it will startup 80 envs when eval ! Am i right ? How can i resolve this? @kengz @lgraesser

kengz commented 5 years ago

You just need to fill in your entry in the json file first if you know what's the number, then it will skip the eval. This can be done manually by directly modifying the json file, or running this script.

kengz commented 5 years ago

@lidongke did you resolve this issue?

lidongke commented 5 years ago

you can close this issue,thanks~@ kengz