Closed dtannebe closed 3 years ago
The store now holds one more observation that actions etc. fixing this issue.
after pulling the update, I still have the same problem.
is it related because I end the game with ESC when my demonstration is finished?
Yes that was exactly what happened and i fixed it now :)
it seems like there's no 'last observation', meaning there are equally many observations and actions. but for a (s,a,s') like structure, there needs to be +1 state/observation, and generally, the last observation should be the state of the world AFTER an/the last action.