AttributeError: module 'faiss' has no attribute 'read_index'2024-04-19 00:34:05,418 - utils.py[line:197] - ERROR: RemoteProtocolError: API通信遇到错误：peer closed connection without sending complete message body (incomplete chunked read)

[zmwstu]

所有报错信息如下： 在进行知识库对话的时候，就出现了这问题，之前从来没有过。 2024-04-19 00:34:05,408 - faiss_cache.py[line:92] - INFO: loading vector store in 'samples/vector_store/m3e-base' from disk. ERROR: Exception in ASGI application Traceback (most recent call last): File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 269, in call await wrap(partial(self.listen_for_disconnect, receive)) File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 258, in wrap await func() File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 215, in listen_for_disconnect message = await receive() ^^^^^^^^^^^^^^^ File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 568, in receive await self.message_event.wait() File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/asyncio/locks.py", line 213, in wait await fut asyncio.exceptions.CancelledError: Cancelled by cancel scope 7f78df4f43d0

During handling of the above exception, another exception occurred:

• Exception Group Traceback (most recent call last): | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 411, in run_asgi | result = await app( # type: ignore[func-returns-value] | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 69, in call | return await self.app(scope, receive, send) | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call | await super().call(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/applications.py", line 119, in call | await self.middleware_stack(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call | raise exc | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call | await self.app(scope, receive, _send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app | raise exc | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app | await app(scope, receive, sender) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/routing.py", line 762, in call | await self.middleware_stack(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/routing.py", line 782, in app | await route.handle(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle | await self.app(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/routing.py", line 77, in app | await wrap_app_handling_exceptions(app, request)(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app | raise exc | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app | await app(scope, receive, sender) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/routing.py", line 75, in app | await response(scope, receive, send) | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 255, in call | async with anyio.create_task_group() as task_group: | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 678, in aexit | raise BaseExceptionGroup( | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception) +-+---------------- 1 ---------------- | Traceback (most recent call last): | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 258, in wrap | await func() | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/sse_starlette/sse.py", line 245, in stream_response | async for data in self.body_iterator: | File "/home/zwm/Code_Program/Langchain-Chatchat/server/chat/knowledge_base_chat.py", line 81, in knowledge_base_chat_iterator | docs = await run_in_threadpool(search_docs, | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/starlette/concurrency.py", line 40, in run_in_threadpool | return await anyio.to_thread.run_sync(func, args) | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync | return await get_async_backend().run_sync_in_worker_thread( | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread | return await future | ^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 851, in run | result = context.run(func, args) | ^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/Code_Program/Langchain-Chatchat/server/knowledge_base/kb_doc_api.py", line 38, in search_docs | docs = kb.search_docs(query, top_k, score_threshold) | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/Code_Program/Langchain-Chatchat/server/knowledge_base/kb_service/base.py", line 182, in search_docs | docs = self.do_search(query, top_k, score_threshold) | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/Code_Program/Langchain-Chatchat/server/knowledge_base/kb_service/faiss_kb_service.py", line 67, in do_search | with self.load_vector_store().acquire() as vs: | ^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/Code_Program/Langchain-Chatchat/server/knowledge_base/kb_service/faiss_kb_service.py", line 28, in load_vector_store | return kb_faiss_pool.load_vector_store(kb_name=self.kb_name, | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/Code_Program/Langchain-Chatchat/server/knowledge_base/kb_cache/faiss_cache.py", line 97, in load_vector_store | vector_store = FAISS.load_local(vs_path, embeddings, normalize_L2=True,distance_strategy="METRIC_INNER_PRODUCT") | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | File "/home/zwm/miniconda3/envs/Langchain-Chatchat2/lib/python3.11/site-packages/langchain_community/vectorstores/faiss.py", line 1110, in load_local | index = faiss.read_index( | ^^^^^^^^^^^^^^^^ | AttributeError: module 'faiss' has no attribute 'read_index' +------------------------------------ 2024-04-19 00:34:05,418 - utils.py[line:197] - ERROR: RemoteProtocolError: API通信遇到错误：peer closed connection without sending complete message body (incomplete chunked read)

[dosubot[bot]]

The error AttributeError: module 'faiss' has no attribute 'read_index' suggests there's a mismatch between the FAISS library version and its usage in your code. The FAISS.load_local method is correctly used for loading a vector store from disk, which does not directly call a read_index method. This issue might be due to an incorrect expectation of the FAISS module's capabilities as extended by the langchain.vectorstores.faiss module or a version incompatibility.

Ensure that your environment is set up according to the langchain package requirements, specifically with the correct version of the FAISS library, which is 1.7.4 for the Langchain-Chatchat application. This setup is crucial for the FAISS.load_local method to function properly, as it's designed to load the vector store with specific parameters like normalize_L2 and distance_strategy.

For resolving this issue, verify the version of the FAISS library installed in your environment and ensure it matches the expected version by the langchain package. Adjustments to the environment or the code might be necessary to align with the correct FAISS library capabilities and the langchain package's expectations.

Sources

• duckduckgo搜索报错
• 为什么使用Milvus向量数据库, 也会报没有Faiss的错呢
• server/knowledge_base/kb_cache/faiss_cache.py
• requirements.txt
• server/knowledge_base/kb_service/faiss_kb_service.py

#### About Dosu

This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant. If you want to continue the conversation, start your reply with @dosu-bot.