thu-ml / tianshou

An elegant PyTorch deep reinforcement learning library.
https://tianshou.org
MIT License
7.84k stars 1.12k forks source link

The load of the main process is too large. Is there any solution? #729

Closed jaried closed 2 years ago

jaried commented 2 years ago
Trinkle23897 commented 2 years ago

It's more or less because of python subprocess and GIL. If your environment is written in Python, unfortunately, for a single-machine case there's no solution IMHO.

jaried commented 2 years ago

Is it possible to avoid this problem by writing in C++ and using envpool?

Trinkle23897 commented 2 years ago

I think so.

jaried commented 2 years ago

Thanks for your answer.