semitable / robotic-warehouse

Multi-Robot Warehouse (RWARE): A multi-agent reinforcement learning environment
MIT License
292 stars 69 forks source link

Question about the observation space #17

Open YuffieHuang opened 1 year ago

YuffieHuang commented 1 year ago

Hi!

I'm confused about the observation space of each robot in the environment. The document explains that the observation space includes (1) The location, the rotation, and whether the agent is carrying a shelf; (2) The location and rotation of other robots; and (3) The shelves and whether they are currently in the request queue. However, I'm not sure about the exact dimension of it.

I created an example with a single agent, one workstation, and four shelves as demonstrated: image

In this case, the observation is a tuple with only one element, and the element's size is 80 (retrieved directly from the program). I'm wondering how the size is added up.

Thank you so much for your help.

YuffieHuang commented 1 year ago

I looked into the source code "/rware/warehouse.py." The part that defines the observation space is between lines 404 and 446: https://github.com/semitable/robotic-warehouse/blob/master/rware/warehouse.py

Is there a detailed explanation for the code? Thank you!