Farama-Foundation / HighwayEnv

A minimalist environment for decision-making in autonomous driving
https://highway-env.farama.org/
MIT License
2.48k stars 726 forks source link

Issues with multi-agent settings #597

Open DongChen06 opened 2 months ago

DongChen06 commented 2 months ago

Dear author, I am implementing the Multi-agent settings using the Highway-v0. I am not able to achieve stable training and the vehicles can run off the roads without terminating the environment. I took a look at the codes, in the reward function https://github.com/Farama-Foundation/HighwayEnv/blob/7415379bb741d993557c88d50577df0de190959d/highway_env/envs/highway_env.py#L117-L135 and terminate function https://github.com/Farama-Foundation/HighwayEnv/blob/7415379bb741d993557c88d50577df0de190959d/highway_env/envs/highway_env.py#L136-L142 It seems Only the self.vehicle is considered instead of self.controlled_vehicles. Any thoughts would be appreciated.