Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.
GNU General Public License v3.0
847
stars
131
forks
source link
Question about the effect of state encoding indentity connection in dynamics network #36
Closed
puyuan1996 closed 1 year ago
Thanks for you open-sourced code very much.
I'm a little confused about the reason for the identity connection of state encoding in DynamicsNetwork in model.py:
Why do we add this state encoding identity connection, rather than using action encoding, and what is its empirical impact on atari results?
Looking forward to your reply！