Closed ocpinfo closed 7 months ago
🤖
嗨,@ocpinfo!很高兴再次见到你。希望你一切都好!
感谢您的反馈。根据您提供的错误日志,这个问题似乎是在流处理过程中出现的,而不是由于问题的复杂性导致的。在Langchain-Chatchat应用中,如果在流处理过程中出现错误,就会抛出 "APIError: Caught exception: An error occurred during streaming" 错误。这可能是由于网络问题、服务器问题,甚至是客户端问题。
如果应用程序找不到复杂问题的合适信息,它不会抛出错误。相反,它会使用 "empty" 模板作为提示,如下面的代码所示:
if len(docs) == 0: ## 如果没有找到相关的文档,使用空模板
prompt_template = get_prompt_template("knowledge_base_chat", "empty")
所以,您看到的错误不是由于问题的复杂性,而是由于流处理过程中的问题。
关于您提到的类似问题,我在Langchain-Chatchat的问题库中找到了两个相关的已解决问题。这两个问题的讨论和解决方案可能对您有所帮助:
关于Langchain-Chatchat v0.2.10的更改,我没有找到可能导致 "APIError: Caught exception: An error occurred during streaming" 错误的相关信息。如果您在更新到v0.2.10之后才开始遇到这个问题,可能需要进一步检查v0.2.10中的更改,看看是否有可能影响到流处理过程。
如果您需要进一步的帮助,或者有更多的信息可以提供,欢迎随时告诉我。
回答超时吗,这时候大概输出了多少字,应该是回答超过15秒了吧
这种情况就没有字出了,一个也没有
降级streamlit看看?
降级到29、30版本都试过,没啥用
知识库问答及文件对话都遇到类似问题: Traceback (most recent call last): File "/Users/weigong/Desktop/gpt/hkb/server/utils.py", line 22, in wrap_done await fn File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 381, in acall raise e File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 375, in acall await self._acall(inputs, run_manager=run_manager) File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 275, in _acall response = await self.agenerate([inputs], run_manager=run_manager) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 142, in agenerate return await self.llm.agenerate_prompt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 554, in agenerate_prompt return await self.agenerate( ^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 514, in agenerate raise exceptions[0] File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 617, in _agenerate_with_cache return await self._agenerate( ^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 522, in _agenerate return await agenerate_from_stream(stream_iter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 87, in agenerate_from_stream async for chunk in stream: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 488, in _astream async for chunk in await acompletion_with_retry( File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 116, in aiter async for item in self._iterator: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 136, in stream raise APIError( openai.APIError: An error occurred during streaming 2024-03-19 19:09:15 | ERROR | root | APIError: Caught exception: An error occurred during streaming
知识库问答及文件对话都遇到类似问题: Traceback (most recent call last): File "/Users/weigong/Desktop/gpt/hkb/server/utils.py", line 22, in wrap_done await fn File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 381, in acall raise e File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 375, in acall await self._acall(inputs, run_manager=run_manager) File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 275, in _acall response = await self.agenerate([inputs], run_manager=run_manager) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 142, in agenerate return await self.llm.agenerate_prompt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 554, in agenerate_prompt return await self.agenerate( ^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 514, in agenerate raise exceptions[0] File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 617, in _agenerate_with_cache return await self._agenerate( ^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 522, in _agenerate return await agenerate_from_stream(stream_iter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 87, in agenerate_from_stream async for chunk in stream: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 488, in _astream async for chunk in await acompletion_with_retry( File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 116, in aiter async for item in self._iterator: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 136, in stream raise APIError( openai.APIError: An error occurred during streaming 2024-03-19 19:09:15 | ERROR | root | APIError: Caught exception: An error occurred during streaming
您好,请问解决了吗
知识库问答及文件对话都遇到类似问题: Traceback (most recent call last): File "/Users/weigong/Desktop/gpt/hkb/server/utils.py", line 22, in wrap_done await fn File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 381, in acall raise e File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 375, in acall await self._acall(inputs, run_manager=run_manager) File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 275, in _acall response = await self.agenerate([inputs], run_manager=run_manager) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 142, in agenerate return await self.llm.agenerate_prompt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 554, in agenerate_prompt return await self.agenerate( ^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 514, in agenerate raise exceptions[0] File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 617, in _agenerate_with_cache return await self._agenerate( ^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 522, in _agenerate return await agenerate_from_stream(stream_iter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 87, in agenerate_from_stream async for chunk in stream: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 488, in _astream async for chunk in await acompletion_with_retry( File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 116, in aiter async for item in self._iterator: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 136, in stream raise APIError( openai.APIError: An error occurred during streaming 2024-03-19 19:09:15 | ERROR | root | APIError: Caught exception: An error occurred during streaming
您好,请问解决了吗
没有解决,没人理我,已经放弃使用langchain了,建议使用Fastgpt,很好用。
知识库问答及文件对话都遇到类似问题: Traceback (most recent call last): File "/Users/weigong/Desktop/gpt/hkb/server/utils.py", line 22, in wrap_done await fn File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 381, in acall raise e File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/base.py", line 375, in acall await self._acall(inputs, run_manager=run_manager) File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 275, in _acall response = await self.agenerate([inputs], run_manager=run_manager) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain/chains/llm.py", line 142, in agenerate return await self.llm.agenerate_prompt( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 554, in agenerate_prompt return await self.agenerate( ^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 514, in agenerate raise exceptions[0] File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 617, in _agenerate_with_cache return await self._agenerate( ^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 522, in _agenerate return await agenerate_from_stream(stream_iter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 87, in agenerate_from_stream async for chunk in stream: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/langchain_community/chat_models/openai.py", line 488, in _astream async for chunk in await acompletion_with_retry( File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 116, in aiter async for item in self._iterator: File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/_streaming.py", line 136, in stream raise APIError( openai.APIError: An error occurred during streaming 2024-03-19 19:09:15 | ERROR | root | APIError: Caught exception: An error occurred during streaming
您好,请问解决了吗
没有解决,没人理我,已经放弃使用langchain了,建议使用Fastgpt,很好用。 好的好的,谢谢
问题描述 / Problem Description 知识库问答突然会出现这个问题,然后没有回答
复现问题的步骤 / Steps to Reproduce 任意知识库问答,问到较为复杂的问题会出现
预期的结果 / Expected Result 如果不会回答,会反馈没有合适的信息,而不是出错
实际结果 / Actual Result utils.py[line:40] - ERROR: APIError: Caught exception: An error occurred during streaming
环境信息 / Environment Information
附加信息 / Additional Information 2024-02-09 06:05:45 | INFO | httpx | HTTP Request: POST http://127.0.0.1:21006/worker_generate_stream "HTTP/1.1 200 OK" 2024-02-09 06:05:46 | ERROR | model_worker | 请求千问 API 时发生错误:{'error_code': <HTTPStatus.INTERNAL_SERVER_ERROR: 500>, 'text': 'Input data may contain inappropriate content.', 'error': {'message': 'Input data may contain inappropriate content.', 'type': 'invalid_request_error', 'param': None, 'code': None}} 2024-02-09 06:05:46,649 - utils.py[line:38] - ERROR: An error occurred during streaming Traceback (most recent call last): File "D:\Langchain-Chatchat\server\utils.py", line 36, in wrap_done await fn File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain\chains\base.py", line 385, in acall raise e File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain\chains\base.py", line 379, in acall await self._acall(inputs, run_manager=run_manager) File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain\chains\llm.py", line 275, in _acall response = await self.agenerate([inputs], run_manager=run_manager) File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain\chains\llm.py", line 142, in agenerate return await self.llm.agenerate_prompt( File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_core\language_models\chat_models.py", line 553, in agenerate_prompt return await self.agenerate( File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_core\language_models\chat_models.py", line 513, in agenerate raise exceptions[0] File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_core\language_models\chat_models.py", line 616, in _agenerate_with_cache return await self._agenerate( File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_community\chat_models\openai.py", line 522, in _agenerate return await agenerate_from_stream(stream_iter) File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_core\language_models\chat_models.py", line 86, in agenerate_from_stream async for chunk in stream: File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\langchain_community\chat_models\openai.py", line 488, in _astream async for chunk in await acompletion_with_retry( File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\openai_streaming.py", line 116, in aiter async for item in self._iterator: File "D:\Langchain-Chatchat\miniconda3\lib\site-packages\openai_streaming.py", line 136, in stream raise APIError( openai.APIError: An error occurred during streaming 2024-02-09 06:05:46,650 - utils.py[line:40] - ERROR: APIError: Caught exception: An error occurred during streaming