search

fmeiraf / LLM-budget-assistant

0 stars 0 forks source link

Add financial assistant basic functions #3

Open fmeiraf opened 11 months ago

fmeiraf commented 11 months ago

Enable the assistant to query user transactions and come up with analyses or recommendations.

fmeiraf commented 11 months ago

Idea: Use RAG for user queries, this would point resolution pairs : (embedded) search > function to achieve that result.

resolution pairs would be fed into a prompt to compose the text of the answer to the user.

This would prevent prompt injection by forcing that data transformation would need to come exclusively from the resolution pairs database. This would not prevent the model to hallucinate and also is not fluid in the sense that queries not in the database wouldn't trigger transformations properly.

Use a vector db for it (maybe tinyvector or chroma).

serve it through a chat service.

Link: https://eugeneyan.com/writing/llm-patterns/?utm_source=convertkit&utm_medium=email&utm_campaign=Design+Patterns+for+LLM+Systems+%26+Products%20-%2011386148#retrieval-augmented-generation-to-add-knowledge