Description

This PR include an initial support for vision models, so far I have tested vision models from OpenAi, ToghetherAI and Google and they seem to work without problems.

Related to issue #564

Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist:

[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas

pieroit commented 3 weeks ago

Love it 😍

valentimarco commented 3 weeks ago

should we also support base64 image? i see ollama and others using it but idk

Pingdred commented 3 weeks ago

should we also support base64 image? i see ollama and others using it but idk

Yep, it can be useful, can you test if it works with ollama?

cheshire-cat-ai / core

Initial vision support #959

Description

Type of change

Checklist: