How to monitor the episode/epoch return/length in Tianshou? - Githubissues

thu-ml / tianshou

An elegant PyTorch deep reinforcement learning library.

https://tianshou.org

MIT License

7.73k stars 1.12k forks source link

How to monitor the episode/epoch return/length in Tianshou? #1082

Open PingH129 opened 5 months ago

PingH129 commented 5 months ago

[x] I have marked all applicable categories:
- [ ] exception-raising bug
- [ ] RL algorithm bug
- [ ] documentation request (i.e. "X is missing from the documentation.")
- [ ] new feature request
- [ ] design request (i.e. "X should be changed to Y.")
[+] I have visited the source website
[+] I have searched through the issue tracker for duplicates
[+] I have mentioned version numbers, operating system and environment, where applicable:
```
import tianshou, gymnasium as gym, torch, numpy, sys
print(tianshou.__version__, gym.__version__, torch.__version__, numpy.__version__, sys.version, sys.platform)
```
I'm using the trainer in Tianshou for MARL, but how can I monitor the episode/epoch return and length in tianshou in the training process?

Trinkle23897 commented 5 months ago

You should check the collector's return value. It has episodic statistic number. For example: https://github.com/thu-ml/tianshou/blob/5bf923c9bd2a08746dd599010f92e1365bcfb844/tianshou/data/collector.py#L574-L581