search

AI-ANK / RAGArch

RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented Generation (RAG) pipelines. Utilizing the power of Llamaindex, RAGArch facilitates the testing of different configurations to see how they perform.
https://ai-ank.github.io/harshad-portfolio/
MIT License
77 stars 18 forks source link

Add support for open source LLMs for purely local deployment? #2

Open yunhua-deng opened 6 months ago

yunhua-deng commented 6 months ago

Currently, seems like only commercial LLM were supported.

LLMs: OpenAI GPT 3.5 and 4, Cohere API, Gemini Pro

Add support for open source LLMs for purely local deployment?

jbdatascience commented 6 months ago

Currently, seems like only commercial LLM were supported.

LLMs: OpenAI GPT 3.5 and 4, Cohere API, Gemini Pro

Add support for open source LLMs for purely local deployment?

I would also like support for open source LLMs very much!