isaac-sim / IsaacGymEnvs

Isaac Gym Reinforcement Learning Environments
Other
1.94k stars 412 forks source link

Using camera images as sensor tensors to train RL polices #150

Open scode-cmd opened 1 year ago

scode-cmd commented 1 year ago

Are there any updates on some official examples for camera input to train RL policies? I was confused watching the "Isaac Gym: The Next Generation" talk which gives the impression that it's not possible to use camera images as sensor tensors to train RL polices using Isaac Gym.

Is this still the case?

https://www.nvidia.com/en-us/on-demand/session/gtcspring22-s41582/?playlistId=playList-63b157fe-95fe-4b93-8b9b-d731be32ec29

time stamp 31:49