instadeepai / Mava

🦁 A research-friendly codebase for fast experimentation of multi-agent reinforcement learning in JAX
Apache License 2.0
709 stars 83 forks source link

refactor: Remove agent's ID from the global_state #1029

Closed WiemKhlifi closed 7 months ago

WiemKhlifi commented 7 months ago

What?

These changes modify the AgentIDWrapper and JaxMARL wrappers to exclusively support the addition of the agent ID in the agent view, rather than also including it in the global state.

Why?

The adjustment is made because adding an agent's ID to its view can be useful where agents require unique identification. However, adding this information to the global state does not seem necessary, especially given current support for centralized training and the use of a shared critic.