search

Maplemx / Agently

[AI Agent Application Development Framework] - 🚀 Build AI agent native application in very few code 💬 Easy to interact with AI agent in code using structure data and chained-calls syntax 🧩 Enhance AI Agent using plugins instead of rebuild a whole new agent
http://agently.tech
Apache License 2.0
1.07k stars 122 forks source link

请教一下，如何用ollama加载的模型 #117

Closed gzcqy closed 3 months ago

gzcqy commented 3 months ago

我从langchain转过来的，太难用了langchain，现在的问题是，我如果用agently中使用ollama加载的qwen:7b模型，我该如何在agently里添加。

Maplemx commented 3 months ago

Firstly, use ollama OpenAI compatible mode to start your local model server: https://ollama.fan/reference/openai/

Then you can use Agently OpenAI compatible mode to connect the local server: http://agently.cn/features/model_request.html#openaiopenailike