getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
https://apps.umbrel.com/app/llama-gpt
MIT License
10.72k stars 696 forks source link

Any plans to implement RAG (retrieval augmented generation)? #34

Open AI-Zebra opened 1 year ago

AI-Zebra commented 1 year ago

I think this is a great project when it comes to data privacy and compliance for Organizations looking to adopt Gen AI with LLAMA 2. Adding capabilities for this private GPT to get ingested with Org specific data (like docs,confluence pages) as vectors would take this to next level. let me know if I can contribute. thank you!

douglasg14b commented 1 year ago

This is the biggest thing I'm seeking out. I want to give a self-hosted LLM access to my own data that I've collected, so I can search and summarize through it.

edgar971 commented 1 year ago

This is a good idea. Any tools or post about this? I can take a look on how to implement this.

edgar971 commented 1 year ago

Maybe this https://gpt-index.readthedocs.io/en/latest/?

piercus commented 1 year ago

@edgar971 2 ressources :