Closed velteyn closed 2 months ago
See https://github.com/BuilderIO/micro-agent/issues/12
Should already have it to some extent although may need to add support for more models.
@velteyn here the config that worked for me.
Run micro-agent config
and set all the option with the following:
endpoint=http://localhost:11434/v1/
model=mixtral:8x7b
key=ollama
Hi , great project here. I would like to ask if it is possible to have Ollama support fo local LLMs like Mistral Instruct 8b that can run in a laptop. Thz