xbpeng / DeepTerrainRL

terrain-adaptive locomotion skills using deep reinforcement learning
GNU Lesser General Public License v3.0
435 stars 129 forks source link

build iLQR control method for this problem #40

Closed MiaoDragon closed 7 years ago

MiaoDragon commented 7 years ago

Hi! After seeing the impressive power of iLQR (Iterative Linear Quadratic Regulator), I'd like to apply this method to this problem and see if it works well. I'd like to first try to use this to control the same actions of the RL method, i.e., the FSM parameters. I may also consider directly controlling torques as a future work.

However, I'm really new to this and don't know what to start first. Could you give me some advice on the files that I may look at, such as the FSM parameters and controllers, and the files in the project which may be related to my implementation? I guess the actions are acting as a reference state or forces to the FSM phases, but don't know if I'm correct. Could you please explain more about their relation?

Thank you in advance for the help!

Neo-X commented 7 years ago

A good place to start would be reading Rich Suttons book on Reinforcement Learning.

MiaoDragon commented 7 years ago

Thank you for the response! I will look at this book.