Doing RAG for Finance using LLama2. Highly recommend you run this in a GPU accelerated environment. I used a A100-80GB GPU on Runpod for the video!
git clone https://github.com/nicknochnack/Llama2RAG
cd Llama2RAG
jupyter lab
in a terminal or command promptauth_token
variable in the notebook. Ctrl + Enter
to run through the notebook! streamlit run app.py
(make sure you update your auth token in there as well!)-Llama 2 70b Chat Model Card:hugging face model card on the model used for the video.
-Llama Index Doco:sick library used for RAG.
π¨πΎβπ» Author: Nick Renotte
π
Version: 1.x
π License: This project is licensed under the MIT license. Feel free to use it, just don't do bad things with it.