abizovnuralem / go2_ros2_sdk

Unofficial ROS2 SDK support for Unitree GO2 AIR/PRO/EDU
BSD 2-Clause "Simplified" License
237 stars 46 forks source link

[#feature] simple text processing #19

Closed alexlin2 closed 6 months ago

alexlin2 commented 6 months ago

This is for anyone looking to use Siri Shortcuts and the equivalent Google thingy for those green bubble folks to dictate commands and send it to the robot dog.

You just need to have a remote ssh connection that can echo text into a tmp file /tmp/robot_cmd, then the script go2_proc_text.py will look for keywords in this file such as "sit", "stand", "shake hands" then it will execute it.

Future development will use ChatGPT's API to process the raw text into a sequence of robot actions and understand natural language. It will also use the camera feed as input so it's multi-modal.