search

matlab-deep-learning / llms-with-matlab

Connect MATLAB to LLM APIs, including OpenAI® Chat Completions, Azure® OpenAI Services, and Ollama™
Other
108 stars 23 forks source link

Add Custom API Endpoint for Ollama #54

Closed hhyqhh closed 3 months ago

hhyqhh commented 3 months ago

I have added a custom endpoint for Ollama:

Endpoint = "http://xxxx/api/chat";
chat = ollamaChat("qwen2:72b",systemPrompt,Endpoint = Endpoint);
txt = generate(chat,"what is your name")
ccreutzi commented 3 months ago

Thank you for the proposed change. Since we have the same effect for the end user in #53 already, I hope you don't mind if I close it anyway. (The other PR also contains tests and doc changes.)