Hey! I am trying to run the app on windows.
There was a issue about bitsandbytes in windows so in order to work the package correctly it must be installed like;
pip install git+https://github.com/Keith-Hon/bitsandbytes-windows.git.
However, there is another issue about query_wrapper_prompt. I keep getting;
ValidationError: 1 validation error for HuggingFaceLLM query_wrapper_prompt str type expected (type=type_error.str)
I have tried other prompting functions like PromptTemplate from langchain but the error is same. Can anyone help to solve the problem?
Hey! I am trying to run the app on windows. There was a issue about bitsandbytes in windows so in order to work the package correctly it must be installed like; pip install git+https://github.com/Keith-Hon/bitsandbytes-windows.git.
However, there is another issue about query_wrapper_prompt. I keep getting; ValidationError: 1 validation error for HuggingFaceLLM query_wrapper_prompt str type expected (type=type_error.str)
I have tried other prompting functions like PromptTemplate from langchain but the error is same. Can anyone help to solve the problem?