yfeng997 / MadMario

Interactive tutorial to build a learning Mario, for first-time RL learners
199 stars 70 forks source link

When we call replay, should we be saving anything at all? #5

Closed subramen closed 3 years ago

subramen commented 3 years ago

When we call replay, should we be saving anything at all? Since in replay, we're only using the model for inference/serving.

We probably should take a look at replay.py to ensure it's running in eval mode

Originally posted by @suraj813 in https://github.com/YuansongFeng/MadMario/pull/4#r509585652