search

casibase / casibase

Spising: ⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com
https://casibase.org
Apache License 2.0
2.7k stars 349 forks source link

Support for Qwen local API #731

Closed MeditatorLiu closed 6 months ago

MeditatorLiu commented 6 months ago

Qwen models provide methods to deploy local API based on OpenAI API, please add support for it. We tried add a new provider, and input our local api in "Provider URL", but casibase seems ignore the "Provider URL" and stills tries to make post requests to OpenAI url.

hsluoyz commented 6 months ago

@MeditatorLiu you need to choose the "Local" --> "custom-model" for local models, see example: https://demo-admin.casibase.com/providers/provider_model_azure

image