Installs dependencies. These are commented out in the notebook. Uncomment them if you need to install.
Imports modules from HuggingFace and LangChain. See the Modules section below for the list.
Defines the initial model using microsoft/Phi3-mini-4k-instruct. This model is roughly 5 GB.
Modules
from langchain.text_splitter import RecursiveCharacterTextSplitter
from langchain.embeddings import HuggingFaceEmbeddings
from langchain.vectorstores import Chroma
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
from langchain import HuggingFacePipeline
from langchain.chains.question_answering import load_qa_chain
from langchain.prompts import PromptTemplate
Overview
This change adds the initial LLM model.
Details
Modulessection below for the list.microsoft/Phi3-mini-4k-instruct. This model is roughly 5 GB.Modules