Implementation of Coordinated Q-learning traffic lights (Guestrin et al., 2002).
Adapted from Lucas Alegre's github repo: https://github.com/LucasAlegre/sumo-rl
sudo add-apt-repository ppa:sumo/stable
sudo apt-get update
sudo apt-get install sumo sumo-tools sumo-doc
Don't forget to set SUMO_HOME variable (default sumo installation path is /usr/share/sumo)
echo 'export SUMO_HOME="/usr/share/sumo"' >> ~/.bashrc
source ~/.bashrc
pip3 install -e .
Single intersection.
A grid of 4 traffic lights arranged 2 by 2.
A grid of 9 traffic lights arranged 3 by 3.
A grid of 64 traffic lights arranged 8 by 8.
Q-learning.
Coordinated Q-learning (with variable elimination).
Deep Q-learning.
python3 experiments/q_singleintersection.py -tripfile outputs/qtrip.xml
python3 outputs/plot.py -f outputs/my-single-intersection/q