Enable feeding in data into a memory DB and vector embed it. Use a small and simple vector search to support RAG lookup of info. Potentially structure various chunking and search strategies. Likely a secondary model link to embedding model for vectorization.
NB best results are achieved if we combine with something like a normal search (matches exact text which is a weakness of vector searches) e.g. using bm25 algorithm: https://github.com/scorta/BM25
Enable feeding in data into a memory DB and vector embed it. Use a small and simple vector search to support RAG lookup of info. Potentially structure various chunking and search strategies. Likely a secondary model link to embedding model for vectorization.