patterns-ai-core / langchainrb

Build LLM-powered applications in Ruby
https://rubydoc.info/gems/langchainrb
MIT License
1.44k stars 195 forks source link

847 add ability to send images to the assistant when using ollama #870

Closed sergiobayona closed 1 week ago

sergiobayona commented 2 weeks ago

add support for a single image to be passed to ollama using a model that supports vision (i.e. Llama3.2.vision, Llava)

example usage: examples/ollama_inquire_about_image.rb