Improve ack/response process in message queue

run-llama / llama_deploy

Deploy your agentic worfklows to production

https://docs.llamaindex.ai/en/stable/module_guides/llama_deploy/

MIT License

1.86k stars 193 forks source link

Improve ack/response process in message queue #38

Open logan-markewich opened 5 months ago

logan-markewich commented 5 months ago

Some use-cases require a dedicated response from a messages before a process can continue

tool calls
calls to other services
etc.

Currently this is only possible with some tacky workarounds (see the meta tool for example). We should add more dedicated support for this workflow.

nerdai commented 5 months ago

I'm going to attempt to do this along with #25. My current feeling (🤷) is that in doing #25 we may also be able to complete this ticket, and at the very least inform us greatly on the direction we should take with this issue.

logan-markewich commented 5 months ago

@nerdai that's a pretty good idea. Services that already support an ack or similar will inform the design a ton