roboterax / humanoid-gym

Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfer https://arxiv.org/abs/2404.05695
https://sites.google.com/view/humanoid-gym/
541 stars 88 forks source link

Sim 2 sim transfer #16

Open jaykorea opened 1 month ago

jaykorea commented 1 month ago

Dear author.

Recently I ‘ve found out this amazing project to enhance sim 2 real transfer. Well reviewed your code and I have some question that you guys have done for sim 2 sim framework.

First of all, I also tested sim 2 sim transfer with my own robot model(ledgged based robot), however I ve found out that It is really hard to safely control the robot on different simulation because physics engine differes I guess. Is there specific way to enhance sim 2 sim transfer(Isaac orbit to Mujoco) or any idea how to reduce the gap between different simulation.

I’m also wondering that you guys have different control term on Isaac gym environment(following the code). One is the dynamic randomization term and the other is PD control term. Which one did you use to train the policy?

Huge thanks to your open soure library again :)