openai / gym-http-api

API to access OpenAI Gym from other languages via HTTP
MIT License
293 stars 142 forks source link

binding-go: support multi-dimensional observations #48

Closed unixpickle closed 7 years ago

unixpickle commented 7 years ago

This is useful for environments like Atari, where observations are 3D tensors. Before now, multi-dimensional observations would yield an error. This commit also comes with a new demo that showcases how to use 3D observations in Pong-v0.

This replaces #47 which achieves the same result but in a less general way.

Informal benchmarks show that using reflection for multi-dimensional observations, like is done here, does not negatively impact performance. Processing space elements for pong took roughly 0.2ms per frame on a 2.6GHz Core i7.

wenkesj commented 7 years ago

@korymath looks good to us Go coders here 👍

joeblew99 commented 7 years ago

Would be great if this was committed please.

I have a parametric CAD system written in golang. With it i can design 3d objects and the 3D robots to make the objects, but using the golang vncdriver and some tensors. But i need to hook into the "gym" to get some help....

joeblew99 commented 7 years ago

thanks !