opendilab / DI-engine

OpenDILab Decision AI Engine. The Most Comprehensive Reinforcement Learning Framework B.P.
https://di-engine-docs.readthedocs.io
Apache License 2.0
2.82k stars 352 forks source link

How can I use the algorithm I designed (such as a new multi-agent reinforcement learning algorithm) in the relevant environment (such as MPE, SMAC, etc.) provided by this platform? #744

Closed QingYuanZi1024 closed 8 months ago

puyuan1996 commented 8 months ago

Hello, if you wish to run your own designed algorithm in the environment provided by DI-engine, you may need to first integrate your algorithm into DI-engine. For the specific steps, you can refer to this tutorial (Note: The framework structure of LightZero is similar to DI-engine, and the relevant tutorial for DI-engine is still being written and will be completed as soon as possible.)

It's worth noting that DI-engine has implemented various types of reinforcement learning algorithms, including DQN, PPO, TD3, etc. Therefore, you can choose an existing algorithm that is most similar to your designed algorithm as the basis for modification. For instance, if your algorithm is of the Multi-Agent Reinforcement Learning (MARL) type, you can refer to this document. For more algorithms, you can check here.

During the process of integrating your algorithm into DI-engine, if you encounter any issues, you can give feedback by submitting an issue. Wishing you all the best!

puyuan1996 commented 8 months ago

BTW,if you wish to use the environments supported by dizoo without fully migrating your own algorithm to the DI-engine framework, you can refer to these two documents: ding_env usage tutorial and Introduction to dizoo. These documents will help you understand the mechanism of the dizoo environments and its configuration in DI-engine.

For instance, if you want to use the MPE environment in pettingzoo, you can refer to the corresponding test file link: test_petting_zoo_simple_spread_env. Hopefully, this information will help you use the dizoo environments more smoothly. If there are any issues, feel free to raise them at any time.