isaac-sim / OmniIsaacGymEnvs

Reinforcement Learning Environments for Omniverse Isaac Gym
Other
762 stars 203 forks source link

In extension workflow - some envs not updating in viewport #153

Open VladimirFokow opened 3 months ago

VladimirFokow commented 3 months ago

In the extension workflow, in video example here (at 1:34), after we click "START" we can see the cartpoles moving in the viewport.

When I try the same with Humanoid - it doesn't move (nor if "Test" is selected) In the terminal I see that it is training -- but it just doesn't render in the viewport.

If I launch the training from the command line (not with the extension) (with headless=False by default), a window opens and there everything DOES move.

If I create my custom env, will I be able to check its training progress with the extension workflow? - how to ensure that it will be moving?

Envs:

In the extension workflow: ✅ = is moving ❌ = is not moving (without emoji = not tested)




system info:

Ubuntu 22.04.3 LTS Isaac Sim 2023.1.1.

SuomiKP31 commented 3 months ago

This is caused by OmniHydra instancing not being enabled when we are using extension workflow. I believe all robots that don't move are using instanceable assets. I did see a warning in the command prompt, but currently I don't know how to enable it.