Hi, I am a reader of your book and recently met a very weird issue. I tried to modify your ScaledFloatFrame preprocessing, the only two modifications I made are:
Firstly, in Chapter06/lib/wrappers.py, I commented the ScaledFloatFrame
If it was the only changes, it should work. Have you tried to rerun it several times? Sometimes (~10% or something) it fails to converge just because of an unlucky seed.
Hi, I am a reader of your book and recently met a very weird issue. I tried to modify your ScaledFloatFrame preprocessing, the only two modifications I made are:
However, I found DQN can't learn properly on pong. Results are:![dqn_tensor_problem](https://user-images.githubusercontent.com/15168196/51590983-b9ec4c00-1f26-11e9-8ea6-0be3e0ffd1f9.png)
Any ideas of why such things happened? I just really don't know where I made the mistake...