isaac-sim / OmniIsaacGymEnvs

Reinforcement Learning Environments for Omniverse Isaac Gym
Other
856 stars 217 forks source link

Different behaviour from isaac sim #37

Open KevinGalassi opened 1 year ago

KevinGalassi commented 1 year ago

Hello, I have a pick and place application, where a robot is grasping a cloth created using ClothPrim. I started from isaac sim and i was able to grasp the cloth, and when i integrated everything inside this repository i have the following behavior.

The cloth parameters are exactly the same and i use the same robot model as well. So i don't know exactly what to do...

Screencast from 04-21-2023 12:02:09 PM.webm

kellyguo11 commented 1 year ago

Hi there, it's possible that this repository is applying additional default values to some of the physics parameters for the simulation, robots, and objects. Many of the parameters can be adjusted from the config files. The simulation results may also vary depending on whether the GPU or CPU APIs are used. It may be a good start to compare the attributes for the physics scene and objects to see if they are the same when launched from OIGE and from Isaac Sim.

KevinGalassi commented 1 year ago

I checked the parameters of the PhysicScene and they look the same, while i'm using the same objects definition in both the files, so i have no idea. Another thing that i noticed that the debug of physics behave differently when using OIGE (e.g. particles are shown in spawn position and not follow the cloth representation)

That bring me think that the by default the two application spawned are different but i don't know

KevinGalassi commented 1 year ago

Do you know how to change the setting so that i can obtain all USD as in isaac application instead of the output you can get from OIGE? It may be related to the difference behavior i'm experiencing.

At first, it seems that it was related to the flatcache setting, and if I set it to False, the cameras are blocked despite having my application running in the background

OIGE output : Screenshot from 2023-04-24 17-23-03

Issac sim app: Screenshot from 2023-04-24 17-25-27

kellyguo11 commented 1 year ago

Hi there, you can try running with the CPU pipeline (pipeline=cpu), which will disable the flatcache extension.

KevinGalassi commented 1 year ago

with pipeline=cpu i obtain the following error:

2023-05-09 07:43:44 [22,619ms] [Error] [omni.physx.tensors.plugin] CpuSimulationView::createParticleClothView is not implemented yet

Other parameters that may be usefull are :

## Device config
physics_engine: 'physx'
# whether to use cpu or gpu pipeline
pipeline: 'cpu'
# whether to use cpu or gpu physx
sim_device: 'gpu'

I also tried disabling flatcahe, but if it is set to false the robot is not moving anymore while the program is running in the background