tascheidt / jdmgpt

RAG based GPT based on open access Pubmed data related to Juvenile Dermatomyositis
MIT License
0 stars 0 forks source link

Test sentence transformer #1

Open tascheidt opened 7 months ago

tascheidt commented 7 months ago

Likely a performance improvement benefit

Example code snippet:

from llama_index.llms import OpenAI

llm = OpenAI(model="gpt-3.5-turbo", temperature=0.1)

sentence_index = build_sentence_window_index( document, llm, embed_model="local:BAAI/bge-small-en-v1.5", save_dir="sentence_index" )