question about trained models

dgriff777 / rl_a3c_pytorch

A3C LSTM Atari with Pytorch plus A3G design

Apache License 2.0

563 stars 119 forks source link

question about trained models #39

Open enochkan opened 3 years ago

enochkan commented 3 years ago

Just want to clarify that there is only one saved model per environment and it will be overwritten each training epoch, right? For example, MsPacman will only have one saved model trained_models/MsPacman-v0.dat

dgriff777 commented 3 years ago

There are no training epochs as the data the model is training on is constantly changing and dependent on actions the model takes.

The model is setup to save during training when the Test Agent process completes a game and achieves a new high score or matches high score it has achieved on game.