search

ArslanS1997 / Auto-Analyst

AI data scientist
https://medium.com/firebird-technologies/auto-analyst-2-0-the-ai-data-analytics-system-26aec602928e
MIT License
159 stars 32 forks source link

Injecting Domain Knowledge into the Agent system #3

Closed tranhoangnguyen03 closed 2 months ago

tranhoangnguyen03 commented 2 months ago

Hi,

I am very impressed by your work here. I find the way you set up your agents very compelling, and the use of DSPy allows for a very clean and easy to understand agent definition and orchestration. I have been using LangChain and LangGraph to basically achieve the same goal as you (Business Intelligence Analyst Bot), and I must say that I am very tempted to give in to your DSPy way; or at least find a way to marry LangGraph with DSPy.

Anyhow, in my project, I need to inject some domain knowledge (a dictionary of abbreviations and org-specific terminologies as well as their business contexts) into the agentic flow. I achieve this by having a dedicated librarian agent who performs similarity lookup the question (containing the terminologies) against the domain knowledge bm25 embedding. The librarian agent then give hints to the planner query.

I hope it's useful to you. I'd love to hear your take on this, and will be keeping an eye out for this high potential project of yours.

Cheers,

ArslanS1997 commented 2 months ago

Hi Thanks for your kind words and the librarian approach you suggested. I believe it could be tremendously useful.

:thumbsup: