isaac-sim / OmniIsaacGymEnvs

Reinforcement Learning Environments for Omniverse Isaac Gym
Other
835 stars 211 forks source link

Failed To Train the AnymalTerrain Task #137

Open AlanSunHR opened 8 months ago

AlanSunHR commented 8 months ago

Hi, recentlty I tried to train the AnymalTerrain task using the latest codes in this repo and the lastest version of Isaac Sim.

Without changing any parameters, I tried 3 seeds, but the Anymal robots just stand still all the time in these 3 seeds. I tried to play with the demo and load the checkpoint from the NVidia server, it worked perfectly well.

Another problem is that the GPU util is pretty low (around 20% on a 4080 GPU), I also trained the same task using the Isaac Sim version of 2022.2.1, the GPU util is about 60% and the overall training speed is 5x faster.

So my question is:

  1. Are the current parameters for AnymalTerrain task robust enough for different random seeds?
  2. Do I have to design a curriculum to successfully train AnymalTerrain (lower penalty/noise at first and then increase the penalty)?
  3. Why are the performance of different versions of Isaac Sim so different?

Thanks!