search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
23.86k stars 2.34k forks source link

[Question]: Add qwen-plus in docker self-hosted server #2857

Open XbIK opened 1 month ago

XbIK commented 1 month ago

Describe your problem

Get the api-key in alibaba cloud, it works well with python examples, through url: https://dashscope-intl.aliyuncs.com/api/v1. But when trying to add in ragflow web, get an error message: hint : 102 Fail to access model(qwen-plus) using this api key.ERROR: Invalid API-key provided.

KevinHuSh commented 1 month ago

The error message is from Alibaba.

XbIK commented 1 month ago

Ragflow docker tries to get: https://dashscope.aliyuncs.com/, my alibaba API is on https://dashscope-intl.aliyuncs.com/, with intl in the url. I changed the basic url to 'https://dashscope.aliyuncs.com/' in python example code, and got the sames error, not valid api-key (with intl in url it works). How could I change the dashscope.base_http_api_url in Ragflow?

KevinHuSh commented 1 month ago

Please refer to this.

XbIK commented 1 month ago

thank you, Kevin. Currently connected chat model through OpeinAI-API, with basic url https://dashscope-intl.aliyuncs.com/compatible-mode/v1. Last step to add embedding of qwen, as it is not works through this url

KevinHuSh commented 1 month ago

I will update the dashscope latter both in docker image and demo.

XbIK commented 1 month ago

is this issue was fixed in this commit? how could I check it

KevinHuSh commented 1 month ago

Pull the dev version of docker image or pull the latest code and build the system.

XbIK commented 1 month ago

still the same error with key that works in python, but not works in ragflow

hint : 102 Fail to access model(gte-rerank) using this api key.Fail Fail to access model(qwen-long) using this api key.ERROR: ERROR: Invalid API-key provided. Fail to access model(qwen-plus) using this api key.ERROR: ERROR: Invalid API-key provided. Fail to access model(qwen-turbo) using this api key.ERROR: ERROR: Invalid API-key provided. Fail to access embedding model(text-embedding-v2) using this api key.Account abnormal. Please ensure it's on good standing to use QWen's text-embedding-v2 Fail to access embedding model(text-embedding-v3) using this api key.Account abnormal. Please ensure it's on good standing to use QWen's text-embedding-v3