aidudezzz / deepworlds

Examples and use cases using the deepbots framework (https://github.com/aidudezzz/deepbots) with the Webots robot simulator.
GNU General Public License v3.0
50 stars 23 forks source link

Continuous CartPole Robot-Supervisor - fix coordinate system #67

Closed KelvinYang0320 closed 2 years ago

KelvinYang0320 commented 2 years ago

Check if it works correctly without training:

  1. Download the pretrained agent into the following folder: deepworlds/examples/cartpole/cartpole_continuous/controllers/robot_supervisor_manager/models/saved/default_ddpg

Directories structure:

\robot_supervisor_manager
  \agent
    \...
  \model
    \saved
      \default_ddpg
        \Actor_ddpg
        \Critic_ddpg
        \TargetActor_ddpg
        \TargetCritic_ddpg
  \...
  1. Add agent.load('./PPO') to controllers/robot_supervisor_manager/DDPG_runner.py
    agent = DDPGAgent(...)
    agent.load_models()
  2. You should be able to see that the agent works correctly.

https://user-images.githubusercontent.com/49781698/175893059-e27fb65f-c321-4175-91be-e6f063ee797b.mp4