TanGentleman / Augmenta

Automate RAG-powered workflows
MIT License
1 stars 0 forks source link

Make Chatbot eval tests modular #45

Open TanGentleman opened 4 months ago

TanGentleman commented 4 months ago

This allows the user to check the content of their vector store and do an initial similarity comparison before integrating a chain into their workflows.

TanGentleman commented 4 months ago

This goes in hand with having better user configurability of the RAG system prompt too.

Essentially, I want visibility into chains, but tweaking internal settings after it has been composed is tricky without learning too hard into statefulness. I'm going to try to keep most everything nice and tidy inside the Config object.