Closed StevenJokess closed 3 years ago
Sorry about that, I haven't updated this section.
It is because we changed VectorEnv to DummyVectorEnv, and created an abstract class BaseVectorEnv
to describe APIs. As you can see, BaseVectorEnv cannot work because all its methods are not implemented.
I'll update it now. Thanks!
If you use docs like http://preview.d2l.ai/d2l-en/master/chapter_linear-networks/softmax-regression-scratch.html, it will alarm you if you don't update.
I read https://tianshou.readthedocs.io/zh/latest/docs/5-example.html
https://github.com/thu-ml/tianshou/blob/master/tianshou/env/venvs.py https://github.com/StevenJokess/d2l-en-read/blob/moreme/RL/tianshou-DQN.ipynb