StanfordVL / OmniGibson

OmniGibson: a platform for accelerating Embodied AI research built upon NVIDIA's Omniverse engine. Join our Discord for support: https://discord.gg/bccR5vGFEx
https://behavior.stanford.edu/omnigibson/
MIT License
463 stars 51 forks source link

Teleoperation using Game Controller #716

Closed vantony1 closed 4 months ago

vantony1 commented 5 months ago

Hi,

I was wondering if tele-operating robots in OmniGibson using a Game Controller is possible? I have looked that the documentation and the code but can't seem to find the keyboard teleoperation file that I could use as a guide to implement the game controller teleop functionality if one is not provided already.

Best,

Victor

cgokmen commented 5 months ago

@wensi-ai

wensi-ai commented 5 months ago

Yes, using game controller is possible. Take a look at this script where we use Telemoma for robot teleoperation (you can try out robot_teleoerate_demo.py to see how it is used)

Alternatively, here is another keyboard interface that is used by robot_control_example.py. At the end of the day you will need to implement some code to read input from the game controller and then compute robot actions using the input.

vantony1 commented 5 months ago

Thanks so much! I will give it a shot and let you know if I further questions. I appreciate the help.