search

nicknochnack / Llama2RAG

A working example of RAG using LLama 2 70b and Llama Index
352 stars 110 forks source link

HuggingFaceLLM query_wrapper_prompt str type expected (type=type_error.str) #3

Closed Elreniel closed 1 year ago

Elreniel commented 1 year ago

Hey! I am trying to run the app on windows. There was a issue about bitsandbytes in windows so in order to work the package correctly it must be installed like; pip install git+https://github.com/Keith-Hon/bitsandbytes-windows.git.

However, there is another issue about query_wrapper_prompt. I keep getting; ValidationError: 1 validation error for HuggingFaceLLM query_wrapper_prompt str type expected (type=type_error.str)

I have tried other prompting functions like PromptTemplate from langchain but the error is same. Can anyone help to solve the problem?

Elreniel commented 1 year ago

My bad. Should not install the latest versions. You can delete the issue.

pip install llama-index==0.7.21 llama_hub==0.0.19