Kaixhin / Rainbow

Rainbow: Combining Improvements in Deep Reinforcement Learning
MIT License
1.56k stars 282 forks source link

rainbow for multiagent setting #62

Closed zyzhang1130 closed 4 years ago

zyzhang1130 commented 4 years ago

Hi, may I ask how should I apply rainbow for a multi-agent setting? I imagine that there should be two models to be trained and each model's reward depends on another agents reward (can be positively or negatively correlated). More importantly, the two models should be trained alternatively (i.e. iter1 train agent1, iter2 train agent2, iter3 train agent1, iter4 train agent2 so on and so forth)

Thanks a lot.

Kaixhin commented 4 years ago

That setup certainly is one way of doing it, but there's many others. This isn't particular to Rainbow, so you should consult the many papers doing multiagent RL with the DQN/DDPG to see what is being done.