search

damat-le / gym-simplegrid

Simple Gridworld Gymnasium Environment
Apache License 2.0
44 stars 11 forks source link

Adding more complex percepts? #1

Open AI-Guru opened 6 months ago

AI-Guru commented 6 months ago

Hi! I love your environment! A question...

If I got it right, you can only perceive the current position. What about extending the percepts to include the contents of the adjacent cells? This would aid exploration.

Cheer, Tristan

damat-le commented 6 months ago

Hi Tristan, It sounds as a good idea to me! For sure it is possible to implement something like a discrete radius of observation. My only doubt is:

should this observability region depend on the direction the agent is moving (like in minigrid) or should it be independent (something like a 360° view)?

Thank you for the suggestion, Leo

AI-Guru commented 6 months ago

Hi Leo, great talking to you! As a start, I would suggest a square around the agent with (x,y, content). x,y could be absolute at the beginning to make things easier, maybe with an option to make them relative. And yes, making it direction-dependent should be optional. I would not start with it.