frame_stack default to False

higgsfield / RL-Adventure

Pytorch Implementation of DQN / DDQN / Prioritized replay/ noisy networks/ distributional values/ Rainbow/ hierarchical RL

2.99k stars 587 forks source link

frame_stack default to False #9

Open lweitkamp opened 6 years ago

lweitkamp commented 6 years ago

Hello, is it correct that frame_stack in wrap_deepmind is never in use? Will you be able to get velocity information if you only parse 1 frame at a time?

garkavem commented 6 years ago

Yeah, it seems like it is never in use. I wonder, how the agent manages to learn to play pong.