Ability to understand the usage and success rate for each category and tools

[bstiawan]

problem:

1. Reliability for categorization
2. Reliability for selecting tools inside a category
3. Which tools resulting into an error or no return

user: Product Manager

resource:

1. GAIA execution log
2. Agent response log

solution:

• data collection and labelling (category and tools)
• create query where we can see all the log and find the relevant connection (e.g correlate with property)
• create overall overview with ranking
• using stack chart include comparison between success and failed case

[bstiawan]

@krisnaBukitVista shouldn't this falls under reliability? Each supervisor should measure the performance of their product.