awslabs / multi-agent-orchestrator

Flexible and powerful framework for managing multiple AI agents and handling complex conversations
https://awslabs.github.io/multi-agent-orchestrator/
Apache License 2.0
1.76k stars 117 forks source link

Feature request: Script to test the classifier #76

Open cornelcroi opened 2 weeks ago

cornelcroi commented 2 weeks ago

Use case

it would be good to have a script to be used to test the classifier with some agents.

Solution/User Experience

The script could be used by the customers to see how the agent is selected for a list of user inputs (read from a file). Also the script would give latency, number of tokens, confidence, etc.

Alternative solutions

No response