search

RoBorregos / home-hri

Human-Robot interaction R&D for RoboCup at Home OPL
GNU General Public License v3.0
4 stars 0 forks source link

Receptionist development #36

Closed afr2903 closed 6 months ago

afr2903 commented 6 months ago

Creating the new nodes and integrating new features such as name extractor and gpt vision

afr2903 commented 6 months ago

Guest analysis

Inside the frida_language_processing it was added the node guest_analyzer.

The first functionality implemented is extracting the name and the favorite drink from the user speech, using gpt-4 model. This was implemented as a ROS Service.

afr2903 commented 6 months ago

Guest image analysis

For extracting the characteristics from the image of the guests, the model gpt-4-vision-preview was used with the API