search

run-llama / llama_deploy

Deploy your agentic worfklows to production
https://docs.llamaindex.ai/en/stable/module_guides/llama_deploy/
MIT License
1.82k stars 186 forks source link

Introduce concept of sessions to control plane/orchestrator #180

Closed logan-markewich closed 2 months ago

logan-markewich commented 2 months ago

Ideally, a user should be able to have a consistent conversation with an LLM using llama-agents. And this idea should extend to multi-tenancy.

To do this, we should have a way to encapsulate the idea of a "session" to handle the state attached to a particular session.

We already have the idea of managing state per-task, but a task is basically a single input, so we just need to extend this slightly in the control plane to be aware of sessions.

Ideally, we can even support some sort of auth, but I might leave this to a future issue

logan-markewich commented 2 months ago

@masci I saw you moved this from Done to Todo -- its actually already completed

There might be more work to do here with llama-agents in the future once the session UX in the workflow class itself gets fleshed out

masci commented 2 months ago

@logan-markewich I noticed it was still open so I thought it was a mis-click, thanks for clarifying! Side note, I've enabled automation in the project so next time we move anything under "done" the issue will be automatically closed!