search

DavidRother / cooking_zoo

CookingZoo: a gym-cooking derivative to simulate a complex cooking environment
MIT License
18 stars 7 forks source link

last observation #12

Closed dtannebe closed 2 years ago

dtannebe commented 2 years ago

it seems like there's no 'last observation', meaning there are equally many observations and actions. but for a (s,a,s') like structure, there needs to be +1 state/observation, and generally, the last observation should be the state of the world AFTER an/the last action.

DavidRother commented 2 years ago

The store now holds one more observation that actions etc. fixing this issue.

dtannebe commented 2 years ago

after pulling the update, I still have the same problem.

dtannebe commented 2 years ago

is it related because I end the game with ESC when my demonstration is finished?

DavidRother commented 2 years ago

Yes that was exactly what happened and i fixed it now :)