justyns / silverbullet-ai

Plug for SilverBullet to integrate LLM functionality
https://ai.silverbullet.md/
GNU Affero General Public License v3.0
26 stars 1 forks source link

Multi-modal (image) support #35

Open justyns opened 2 months ago

justyns commented 2 months ago

Multi-modal support is pretty standard at this point. We should offer it as an optional feature that will send images along with the text to the llm.

E.g. "Describe the animal in this picture" or "Transcribe this diagram into a Mermaid block"