search

lmstudio-ai / configs

LM Studio JSON configuration file format and a collection of example config files.
MIT License
186 stars 34 forks source link

LLaVA support through API? #6

Closed rinaldowouterson closed 9 months ago

rinaldowouterson commented 10 months ago

llama.cpp has LLaVA support for a while now

yagil commented 10 months ago

Supported since 0.2.9. Same API request format as OpenAI. See a few example models here: https://huggingface.co/collections/lmstudio-ai/vision-models-gguf-6577e1ce821f439498ced0c1 You need to download both a primary model and a vision adapter model.