feat: integrate open-set detection tools with RaiNode

RobotecAI / rai

RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

Apache License 2.0

162 stars 17 forks source link

feat: integrate open-set detection tools with RaiNode #281

Open boczekbartek opened 1 month ago

boczekbartek commented 1 month ago

Purpose

rai_open_set_vision tools are currently only used in manipulation_demo.py

The aim of this PR is to integrate them rai-wide and enable using them in other use-cases.

Proposed Changes

integrate rai_open_set_vision with RaiNode and make the available through ros2 action bases mission interface of the node.

Issues

TBD

Testing

TBD