Prompt RAG Cost analysis

CampusGPT-ai / GAI_Academic_Advising_Assistant_MVP

Open Source Public Repo for collaborative academic advising assistant project

MIT License

1 stars 0 forks source link

Prompt RAG Cost analysis #30

Open marycampus opened 7 months ago

marycampus commented 7 months ago

Evaluate average token cost (GPT 4) using current retrieval, and investigate ways to optimize for cost while keeping same result relevancy and accuracy by shortening prompt context