search

danny-avila / rag_api

ID-based RAG FastAPI: Integration with Langchain and PostgreSQL/pgvector
https://librechat.ai/
143 stars 60 forks source link

🦙 feat: HuggingFace TEI and Ollama #6

Closed bsu3338 closed 3 months ago

bsu3338 commented 3 months ago

Add the below for local embeddings: https://python.langchain.com/docs/integrations/text_embedding/text_embeddings_inference and https://python.langchain.com/docs/integrations/text_embedding/ollama

The huggingfacetei code looks a little odd because it takes the url for the model parameter

danny-avila commented 3 months ago

Thanks for this will test this as soon as I can