Closed chuenlok closed 6 days ago
@yanxi0830 Can you help review this?
Thanks! Left some questions. Could you rebase the change on top of current main? There have been some refactors done on the agents lib.
Thanks! Left some questions. Could you rebase the change on top of current main? There have been some refactors done on the agents lib.
Rebased!
What does this PR do?
The assert errors from the server are not returned to the client and hid by the 500 internal server error. Updated the server code (https://github.com/meta-llama/llama-stack/pull/493) to send the error and this client can print the error.
Test Plan
Please describe:
llama stack run /Users/henrytai/.llama/distributions/llamastack-ollama/ollama-run.yaml --port 5050
PYTHONPATH=. python -m examples.agents.client localhost 5050
from thellama-stack-apps
repo. The issue details: "This is a known issue with Llama3.2-3B-Instruct on ollama, where the model produces bad tool calling outputs. In this case, the server agent fails due to assert error that "code_interpreter" is not in the AgentConfig's tools field" but the code_interpreter is not really necessary as it is not needed in Llama3.1-8B.client log:
Showing the real error in the client: Tool code_interpreter not found
Sources
Please link relevant resources if necessary.
Before submitting