RAG ontop of the vector database

[1jamesthompson1]

State

After the completion of #146 there will be a way to easily get the relevant information you want. This is more or less the first part of #163 solved.

Problem

The amount of returned information will still be too large to be helpful. It needs to be summarised to answer the actual questions the use has asked.

Solution

Using the vector database a RAG can be installed on top which can gather the relevant informationa nad answer the question with correct and relevatn information.

The RAG would be able to asnwer questions while also providing the relevatn information that was retrieved. Here are some tasks that need to be completed in a rough order:

• [x] Setup LLM that can query and summarise a database
• [ ] Make the LLM provide references and attributation to the specifc information it has used when generating its response
• [x] Allow the RAG to perform more complex search / filtering of the database, I.e just for safety issues, all reports, modes etc.

[1jamesthompson1]

The RAg does provide some attributions and refencres to specific documents. It may not be perfect but further work should be tracked in its own issue. This issue will be considered resolved to prevent a giant issue.