This repo provides a simple, distributed and asynchronous multi-agent reinforcement learning framework for the Google Research Football environment. Currently, it is dedicated for Google Research Football environment with the cooperative part implemented in IPPO/MAPPO and the competitive part implemented in PSRO/Simple League. In the future, we will also release codes for other related algorithms and environments.
Our codes are based on Light-MALib, which is a simplified version of MALib with restricted algorithms and environments but certain enhancements, like distributed async-training, league-like multiple population training, detailed tensorboard logging. If you are also interested in other Multi-Agent Learning algorithms and environments, you may also refer to MALib for more details.
You can use any tool to manage your python environment. Here, we use conda as an example.
conda create -n light-malib python==3.9
to create a new conda env.conda activate light-malib
when you want to use it or you can add this line to your .bashrc
file to enable it everytime you login into the bash.setup.py
file), run pip install -r requirement.txt
to install dependencies of Light-MALib.setup.py
file), run pip install .
or pip install -e .
to install Light-MALib.python -c "import gfootball;print(gfootball.__file__)"
or other methods to locate where gfootball
pacakage is. gfootball
pacakage, for example, /home/username/miniconda3/envs/light-malib/lib/python3.8/site-packages/gfootball/
..py
files under scenarios
folder in our repo to scenarios
folder in the gfootball
pacakage.ray start --head
on the master, then connect other machines to the master following the hints from command line output.python light_malib/main_pbt.py --config <config_file_path>
to run a training experiment. An example is given by train_light_malib.sh
.python light_malib/scripts/play_gr_football.py
to run a competition between two models. Beats 1.0 hard bot under multi-agent 11v11 full-game scenraios within 10 hours using IPPO, taking advantage of glitches in built-in logics.
Currently, we provide the following tools for better study in the field of Football AI.
At this stage, we release some of our trained model for use as initializations or opponents. Model files are available on Google Drive and Baidu Wangpan.
Under construction, stay tuned :)
If you have any questions about this repo, feel free to leave an issue. You can also contact current maintainers, YanSong97 and DiligentPanda, by email.
Get Interested in our project? Or have great passions in:
Welcome! Why not take a look at https://digitalbrain.cn/talents?
With the leading scientists, enginneers and field experts, we are going to provide Better Decisions for Better World!
Digital Brain Laboratory, Shanghai, is co-founded by the founding partner and chairman of CMC Captital, Mr. Ruigang Li, and world-renowned scientist in the field of decision intelligence, Prof. Jun Wang.