search

isaac-sim / IsaacLab

Unified framework for robot learning built on NVIDIA Isaac Sim
https://isaac-sim.github.io/IsaacLab
Other
1.8k stars 654 forks source link

[Question] Vision-based task, camera-based task #394

Closed Guanbin-Huang closed 2 months ago

Guanbin-Huang commented 3 months ago

Does orbit support vision in the loop's task? any example? e.g. vision in the training loop or vision in the task for adapting some settings in the SOTA work in the field of embodied AI.

like the following: https://github.com/NVIDIA-Omniverse/OmniIsaacGymEnvs/blob/main/omniisaacgymenvs/tasks/cartpole_camera.py

Dhoeller19 commented 2 months ago

Hi Guanbin, This is now supported.

hutslib commented 1 month ago

@Dhoeller19 ow to run vision-base RL tasks in isaaclab, is there any example?