search

mgonzs13 / llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
MIT License
161 stars 27 forks source link

ChatLlamaROS (w/ image support) for Langchain #10

Closed agonzc34 closed 3 months ago

agonzc34 commented 3 months ago

The LlamaROS model has been integrated as a Langchain ChatModel, allowing messages to be formatted according to the model's training format (e.g., <|im_start|>). It also accepts images and URLs as inputs.