Open Shootmir opened 2 months ago
When using LLM RAG technology you need to embedding the document to the vector library, and this project embedding default use chatgpt model, you need to switch the embedding model to other model, such as free use of "HuggingFace" model, modify the way as follows:
Add it in your .evn
file:
EMBEDDING_PROVIDER = “huggingface”
Detailed parameter settings can be found in the documentation.
@Shootmir ,
Since you are trying to use google as LLM provider, try to these environment variables along GOOGLE_API_KEY.
LLM_PROVIDER=google_genai FAST_LLM_MODEL=gemini-1.5-pro-001 # can be changed to another gemini model SMART_LLM_MODEL=gemini-1.5-pro-001 #can be changed to another gemini model EMBEDDING_PROVIDER=huggingface
@assafelovic ,please do suggest if this is Ok. I am happy to contribute to the development. please let me know your thoughts
Thanks. Keep learning.
I am using google as LLM provider. I successfully deployed using docker. But when I using the application there is error occuring it says no openAI key provided. I don't need to use openAI as LLm provider.