Just realized, I need to ensure that the frames are converted to grayscale in a manner that is consistent with the current way in spragnur's code! It looks like he uses ale.getScreenGrayscale.
Edit: ahh, and having to ensure that my images take the 'max' over two consecutive frames. Spragnur's code indeed does that.
So in all I need to check:
grayscale conversion same during data generation from human gameplay [TODO],
taking max over consecutive frames during data generation from human gameplay [TODO]
(also) ensuring that I use a frame skip of 4 only [Done, already inserted in code, but data not udated]
to make sure the networks are taking consistent inputs.
Just realized, I need to ensure that the frames are converted to grayscale in a manner that is consistent with the current way in spragnur's code! It looks like he uses
ale.getScreenGrayscale
.Edit: ahh, and having to ensure that my images take the 'max' over two consecutive frames. Spragnur's code indeed does that.
So in all I need to check:
to make sure the networks are taking consistent inputs.