search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
18.18k stars 1.84k forks source link

fix self deployed llm lost #2510

Closed KevinHuSh closed 1 week ago

KevinHuSh commented 1 week ago

What problem does this PR solve?

2506

Type of change

0000sir commented 1 week ago 
mysql> select * from llm where fid='Xinference';
Empty set (0.00 sec)

There's no fid 'Xinference', so this won't work.

0000sir commented 1 week ago

The local defined LLMs is located in tenant_llm, so I changed line 317 to:

if o.llm_name in llm_set and o.llm_factory not in self_deploied:continue

Then the chat model shows up.