VISION project typ does not works with llava.

apocas / restai

RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precise embeddings usage and tuning. Image generation (Dall-E, SD, Flux).

https://apocas.github.io/restai/

Apache License 2.0

383 stars 73 forks source link

VISION project typ does not works with llava. #92

Open just-valera opened 1 month ago

just-valera commented 1 month ago

To work, you need to connect to open AI, but why?

apocas commented 1 month ago

It will be changed in the next version. Vision was a bit forgotten unfortunately.

At the time there was no proper "multimodal", so... there was an agent coordinating stuff.