Data needs to be searchable for the LLM - Githubissues

buerokratt / Common-Services

Bürokratt Common Services

MIT License

0 stars 9 forks source link

Data needs to be searchable for the LLM #54

Open ValterAro opened 3 months ago

ValterAro commented 3 months ago

AS A product manager I WANT the data to be indexed SO THAT it is searchable by a similarity search

AC:

[ ] The clean data is vectored and added to a vector database.
[ ] The vector database is used for a similarity search to give k-nearest matches.
[ ] There should be a possibility to change the various settings that are used in the indexing and search process.
[ ] There should be an option to use a reranker for the search results.

PaulaMerle commented 1 week ago

This task is for RAG and not for common knowledge base.