retrieval tool

[tony-lii]

gain more experience for text based rag, be clear about what happens each step.

• search agent -> able to return a/multiple reference text(s) relevant to the input prompt by user.

[beepo34]

• Removed multimodal functionality.
• Implemented text chunking and retrieval of relevant chunks based on user query.
• Need further details on #15 to work towards locating and highlighting specific lines in a pdf document.

[SaltedFishLZ]

https://llamahub.ai/

[beepo34]

• SentenceWindowNodeParser splits text documents into nodes each containing a sentence and the context around it
• VectorStoreIndex stores node embeddings in an index in memory for retrieval
• MetadataReplacementPostProcessor replaces node content with sentence window context to prepare for generation.
• index supports insertion and deletion of documents