[Bug] [GraphRAG] GraphRAG chat shut down.

AppleJunJiang commented 1 week ago

Search before asking

[X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

[ ] Chat Data
[ ] Chat Excel
[ ] Chat DB
[X] Chat Knowledge
[ ] Model Management
[ ] Dashboard
[ ] Plugins

Installation Information

Device information

GTX 3060

Models information

default embedding

What happened

当我建立完知识图谱以后，只要Chat Knowledge没服务就崩溃

1、知识图谱确认已建立 2、确认chat llm正常，chat Knowledge就立刻崩溃

2024-09-14 18:31:04 2024-09-14 10:31:04 7ba7ee03bbb8 dbgpt.rag.transformer.llm_extractor[1] INFO Using model proxyllm to extract 2024-09-14 18:31:04 2024-09-14 10:31:04 7ba7ee03bbb8 dbgpt.model.adapter.base[1] INFO Message version is v2 2024-09-14 18:31:04 2024-09-14 10:31:04 7ba7ee03bbb8 dbgpt.model.cluster.worker.default_worker[1] INFO current generate stream function is asynchronous stream function 2024-09-14 18:31:04 2024-09-14 10:31:04 7ba7ee03bbb8 dbgpt.model.proxy.llms.chatgpt[1] INFO Send request to openai(1.44.1), payload: {'stream': True, 'model': 'THUDM/glm-4-9b-chat'} 2024-09-14 18:31:04 2024-09-14 18:31:04 messages: 2024-09-14 18:31:04 [{'role': 'user', 'content': "A question is provided below. Given the question, extract up to keywords from the text. Focus on extracting the keywords that we can use to best lookup answers to the question.\nGenerate as more as possible synonyms or alias of the keywords considering possible cases of capitalization, pluralization, common expressions, etc.\nAvoid stopwords.\nProvide the keywords and synonyms in comma-separated format.Formatted keywords and synonyms text should be separated by a semicolon.\n---------------------\nExample:\nText: Alice is Bob's mother.\nKeywords:\nAlice,mother,Bob;mummy\nText: Philz is a coffee shop founded in Berkeley in 1982.\nKeywords:\nPhilz,coffee shop,Berkeley,1982;coffee bar,coffee house\n---------------------\nText: 卫宁\nKeywords:\n"}] 2024-09-14 18:31:09 2024-09-14 10:31:09 7ba7ee03bbb8 openai._base_client[1] INFO Retrying request to /chat/completions in 0.867724 seconds 2024-09-14 18:31:15 2024-09-14 10:31:15 7ba7ee03bbb8 openai._base_client[1] INFO Retrying request to /chat/completions in 1.713854 seconds 2024-09-14 18:31:17 llm_adapter: 2024-09-14 18:31:17 2024-09-14 18:31:17 model prompt: 2024-09-14 18:31:17 2024-09-14 18:31:17 human: A question is provided below. Given the question, extract up to keywords from the text. Focus on extracting the keywords that we can use to best lookup answers to the question. 2024-09-14 18:31:17 Generate as more as possible synonyms or alias of the keywords considering possible cases of capitalization, pluralization, common expressions, etc. 2024-09-14 18:31:17 Avoid stopwords. 2024-09-14 18:31:17 Provide the keywords and synonyms in comma-separated format.Formatted keywords and synonyms text should be separated by a semicolon. 2024-09-14 18:31:17 --------------------- 2024-09-14 18:31:17 Example: 2024-09-14 18:31:17 Text: Alice is Bob's mother. 2024-09-14 18:31:17 Keywords: 2024-09-14 18:31:17 Alice,mother,Bob;mummy 2024-09-14 18:31:17 Text: Philz is a coffee shop founded in Berkeley in 1982. 2024-09-14 18:31:17 Keywords: 2024-09-14 18:31:17 Philz,coffee shop,Berkeley,1982;coffee bar,coffee house 2024-09-14 18:31:17 --------------------- 2024-09-14 18:31:17 Text: 卫宁 2024-09-14 18:31:17 Keywords: 2024-09-14 18:31:17 2024-09-14 18:31:17 2024-09-14 18:31:17 async stream output: 2024-09-14 18:31:17 2024-09-14 18:31:17 2024-09-14 18:31:17 2024-09-14 10:31:17 7ba7ee03bbb8 dbgpt.model.cluster.worker.default_worker[1] INFO is_first_generate, usage: None 2024-09-14 18:31:17 Keywords: 卫宁;Weining 2024-09-14 18:31:17 2024-09-14 18:31:17 Synonyms: 2024-09-14 18:31:28 2024-09-14 10:31:28 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:31:43 2024-09-14 10:31:43 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:31:58 2024-09-14 10:31:58 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:32:13 2024-09-14 10:32:13 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:32:28 2024-09-14 10:32:28 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:32:43 2024-09-14 10:32:43 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:32:58 2024-09-14 10:32:58 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:33:13 2024-09-14 10:33:13 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:33:28 2024-09-14 10:33:28 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:33:43 2024-09-14 10:33:43 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:33:58 2024-09-14 10:33:58 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10) 2024-09-14 18:34:13 2024-09-14 10:34:13 7ba7ee03bbb8 dbgpt.util.api_utils[1] WARNING Health check failed for http://127.0.0.1:5670, error: HTTPConnectionPool(host='127.0.0.1', port=5670): Read timed out. (read timeout=10)

What you expected to happen

正常回答

How to reproduce

当我建立完知识图谱以后，只要Chat Knowledge没服务就崩溃

Additional context

No response

Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Aries-ckt commented 5 days ago

it looks like your llm service problem.

AppleJunJiang commented 3 days ago

My model service is functioning normally, and chat with LLM is also working fine. However, the service crashes when chatting with knowledge. Additionally, an LLM returning an exception should not cause the entire app to crash.

eosphoros-ai / DB-GPT