search

openai / roboschool

DEPRECATED: Open-source software for robot simulation, integrated with OpenAI Gym.
Other
2.13k stars 488 forks source link

Markov Property #146

Closed mkbera closed 6 years ago

mkbera commented 6 years ago

This question is from a theoretical perspective. Do the roboschool environments have Markov property? I mean are they MDP? If yes, is the state representation returned by env.step() the complete state representation?

olegklimov commented 6 years ago

Mostly yes, you have x and x dot. But some things are not observable: coordinates, absolute orientation.