danijar / dreamerv2

Mastering Atari with Discrete World Models
https://danijar.com/dreamerv2
MIT License
886 stars 195 forks source link

Are the actions properly fed into the model? #58

Open NagisaZj opened 7 months ago

NagisaZj commented 7 months ago

Hi, I found that in the Dreamerv3 codes, there is a 'prev_action' which is used for the imagine step. However, in Dreamerv2, it seems that the 'action' is used instead, which corresponds to the action for the next state. Is this an implementation error, or do I miss any codes that fix this issue? Thank you!