search

RobotecAI / rai

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.
Apache License 2.0
159 stars 16 forks source link

Add turtlebot tutorial #236

Closed boczekbartek closed 4 days ago

boczekbartek commented 1 month ago

Is your feature request related to a problem? Please describe. Turtlebot is a well known example of a robot very well integrated with ros2 ecosystem. It would be a good candidate for a simple example with RAI.

Describe the solution you'd like

Describe alternatives you've considered Other rosbots.

Additional context https://clearpathrobotics.com/turtlebot-4/

boczekbartek commented 1 month ago

Proposed tutorial flow:

  1. How to import turtlebot to some example scene. For example https://github.com/o3de/o3de-extras/tree/development/Templates/Ros2RoboticManipulationTemplate
  2. Starting the simulation
  3. Configuring rai_whoami_node node using documentations and screenshots from the simulation
  4. Writing a simple RaiAgent.
  5. Connecting to the agent using streamlit-based web interface
  6. Asking questions about the robot, what are it's interfaces.
  7. Asking what the robot can see - it can describe the manipulator that is on the table
  8. Asking the robot to move around
  9. Oops - developer forgot to add ros2 publish to topic tool to the agent - robot can't perform the mission
  10. Adding the tool
  11. Robot drives forward