vercel / modelfusion

The TypeScript library for building AI applications.
https://modelfusion.dev
MIT License
1.01k stars 76 forks source link

Support text completion and chat on Phi-3 model for Ollama and LlamaCpp #345

Open apresence opened 3 weeks ago

apresence commented 3 weeks ago

Support text completion and chat on Phi-3 model for Ollama and LlamaCpp. Embeddings and other options not yet implemented. NOTE: The Phi-3 docs say that a system messages are not supported, however looking at various templates online it seems most projects are using them, so I left it there. Alternatively, an error could be thrown, or the system message could be automatically included in the first user message using some sort of scheme similar to what is being done with Mistral.