search

intel / intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
Apache License 2.0
2.05k stars 200 forks source link

rag plugin initialize failed #1538

Open redhairerINTEL opened 1 month ago

redhairerINTEL commented 1 month ago

backend w/ rag I already installed requirement

pip install -r ~/intel-extension-for-transformers/intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/requirements.txt

But rag plugin still initialize failed.

2024-05-10 04:32:14,308 - intel_extension_for_transformers.neural_chat.utils.error_utils - ERROR - neuralchat error: Generic error
2024-05-10 04:32:14,309 - intel_extension_for_transformers.neural_chat.chatbot - ERROR - build_chatbot: plugin init failed

image

backend w/o rag launch successfully image

redhairerINTEL commented 1 month ago

image degrade protobuf can solve problem. pip install protobuf==3.20.3 image But if i run "pip install -r ~/intel-extension-for-transformers/intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/requirements.txt", Protobuf will be back to 5.26 in my environment.