search

Farama-Foundation / HighwayEnv

A minimalist environment for decision-making in autonomous driving
https://highway-env.farama.org/
MIT License
2.67k stars 762 forks source link

Hybrid action space #556

Open striving19 opened 10 months ago

striving19 commented 10 months ago

Hi！ Is it possible to add a hybrid action space to highwayenv like Parameterized DQN？

eleurent commented 10 months ago

It is possible to add one, but it would have to be added to action.py so you can specify what the parts of the action space (space() method) are and how they affect the environment dynamics (act(action) method).

For inspiration, you can take a look at the MultiAgentAction which kind of a hybrid space made of a tuple of several subspaces (here it's assumed to be the same atomic space repeated for each agent, but you can change that)

https://github.com/Farama-Foundation/HighwayEnv/blob/17059b8b7da6ba49e9cfbf1a1715f50ac4d8e8d3/highway_env/envs/common/action.py#L301