search

developersdigest / llm-answer-engine

Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper
https://developersdigest.tech
MIT License
4.28k stars 679 forks source link

support ollama API? #2

Closed mintisan closed 3 months ago

mintisan commented 3 months ago

As title....

developersdigest commented 3 months ago

This should work since it’s set up with OpenAI compatibility.

Just swap the endpoint from Groq to your Ollama localhost and change the model string to one you have installed. Finally use ‘ollama’ as API key 🔑

More info: https://ollama.com/blog/openai-compatibility