Error when querying the model

jonfairbanks / local-rag

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

GNU General Public License v3.0

535 stars 64 forks source link

Error when querying the model #51

Closed AusbelDev closed 6 months ago

AusbelDev commented 6 months ago

Hi! When I run the app and send a query to the model I get the following error:

ollama - ERROR - Ollama chat stream error: 'HuggingFaceEmbedding' object has no attribute '_model'

I dont know if this is due to the models I'm using (llama3:instruct, phi3:latest) or a bug caused by the versions of the dependencies.

Hope I can get some help to solve this problem. Ty.

jonfairbanks commented 6 months ago

Please checkout the troubleshooting documentation. It should help you locate which part of the pipeline is erroring.