search

deepset-ai / haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
https://haystack.deepset.ai
Apache License 2.0
14.56k stars 1.71k forks source link

Agents / callbacks in 2.x #6687

Open jdb78 opened 6 months ago

jdb78 commented 6 months ago

Is your feature request related to a problem? Please describe. I want to use haystack as backend for chainlit (frontend). There is an integration for haystack 1.x (see here) but I do not want to build on legacy tech. The issue is that haystack 2.x does not have callbacks, so chainlit can show the intermediate steps and what is going on.

Describe the solution you'd like Can we introduce agents or enable callbacks in the pipeline?

Describe alternatives you've considered Use langchain.

ilkersigirci commented 4 months ago

Chainlit integration for 2.x would be awesome. It is the only thing that blocks me to migrate from langchain to haystack.

BTW, is there any unofficial implementation of chainlit integration for simple haystack 2.x RAG pipeline?

TuanaCelik commented 4 months ago

Hi all, had a brief update with the team on this: Callback work will start after the stable release of 2.0. We're tagging this with "follow-up-needed" so that we make sure to update you all as soon as we start working on this issue.

samanvithms2002 commented 3 months ago

Hi team, is it also possible to add the custom callback method to haystack1.x as well as it would benefit us since we would have to migrate to haystack2.x only for accessing that functionality, it also be great to provide references to exisitng implementations of custom callback handlers in haystack1.x

ayush4921 commented 3 months ago

Adding to this discussion, I love Haystack 1.25 and have been using Haystack 1.xx for a long time.

I wanted to confirm whether Agents and Cohere rerankers were in the dev pipeline for haystack 2.xx.

jmdevita commented 2 months ago

Also adding to this thread, I've been looking forward to using agents in my applications, and it's the last piece for me to move off of haystack 1.xx.

jacksteussie commented 2 months ago

any updates on this?

rodrigozoff commented 1 month ago

any updates on this?