meta-llama / llama-stack

Composable building blocks to build Llama Apps
MIT License
4.63k stars 588 forks source link

Question regarding agents and sessions APIs #197

Open Minutis opened 1 month ago

Minutis commented 1 month ago

Hello,

I have a question regarding the API with Agents. I did not find a way to get an agent that is already created. Or list the agents available. Did I miss something or is the agent not supposed to be a longer lived entity (than let's say a method call)? I imagine, that you configure agents and then use them throughout your application.

Same question regarding sessions. Although I think session lifespan is shorter than agent it still would make sense to be able to get existing sessions for w/e the purpose it could be. I see that it's possible to fetch single session but I don't see a way to list all sessions.

yanxi0830 commented 1 month ago

Yes, the ability to get session and list all sessions associated with an agent is not implemented, and is a functionality we should implement.

We currently identify agents via agent_id, and sessions for the agent via session_id. Example snippet: https://github.com/meta-llama/llama-stack-apps/blob/36b04bf3cfb79cbc4383cf6609332da34a6b48c0/common/client_utils.py#L179-L195

tamdogood commented 2 weeks ago

i am working on this. will put up a PR soon