Open AI Assistants API - Githubissues

manisnesan / til

collection of today i learned scripts

4 stars 0 forks source link

Open AI Assistants API #96

Open manisnesan opened 2 months ago

manisnesan commented 2 months ago

Details on OpenAI's new assistants RAG

Hard creep into vectorstore territory

Thoughts:

Default chunk overlap of 50%, super interesting
Metadata filtering, super interesting how this dips into vectorstore territory
Unsure about what chunking method they use - 800 tokens character splitter? Recursive? semantic?
Support for CSV retrieval, this is hard! Cool
Hints towards alternative methods routing for Q&A types (summarization)

Retrieval set up:

Query expansion (optimize user queries)
Multi-query (one query > multiple searches)
Hybrid search (keyword + semantic)
Reranking

Source: Greg Kamradt Post and another post

manisnesan commented 2 months ago

Chunking strategy

chunk based on sentence and paragraph boundaries (by using common stop tokens like periods, newlines, etc.), but don’t currently do semantic chunking. We’re optimizing for docs as-they-exist, so no need to particularly optimize your files.