PKU-MARL / Multi-Agent-Transformer

339 stars 72 forks source link

Questions about MAMujoco #23

Open kaiyama12345679 opened 10 months ago

kaiyama12345679 commented 10 months ago

Hi, I'm very instersted in your work, and I want to test your MAT for MAMujoco. So, Do you have any experimental results or config of the MAMujoco Envirionment other than "HalfCheetah"?

morning9393 commented 10 months ago

hiya, thank you for your interesting, but we don't have results on other ma-mujoco map w.r.t MAT, since we use ma-mujoco mainly to simulate robot failure scenarios (for Table 3)....thus only choose the simplest case~

kaiyama12345679 commented 10 months ago

@morning9393 , thanks for your reply.

Can I ask one more question? I want to know whether get_obs_agent() in your MAMujoco is globally observable or partially observable, because there is differences between the obsk.py of original MAMujoco and that of yours.

morning9393 commented 10 months ago

@kaiyama12345679 hiya, Questions are always welcome~~ :))

in the file "train_mujoco.sh", you may find that we set agent_obsk=0, which means each agent obs returned by get_obs_agent() contained only the information corresponding to its own node, without neighbors, which is different from the original MA-Mujoco settings (usually agent_obsk=1 or agent_obsk=2, means it will contain information from the current node and all the nearest neighbor nodes with distances 1 or 2).

you can also change the agent_obsk if you would like to include more information into the agent obs~

hoping it might help you~

kaiyama12345679 commented 10 months ago

@morning9393, I'm sorry I didn't make the question clear enough. I would like to know why there is a difference between "build_obs()" in obsk.py and that of original MAMujoco, which seems to be the same as the commented out part in yours.

https://github.com/PKU-MARL/Multi-Agent-Transformer/blob/be3ff49c8264d454c1fe2c41582aa2bfc98498c8/mat/envs/ma_mujoco/multiagent_mujoco/obsk.py#L74-L242