issues
search
awslabs
/
agent-evaluation
A generative AI-powered framework for testing virtual agents.
https://awslabs.github.io/agent-evaluation/
Apache License 2.0
64
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Address inconsistent evaluation results
#24
tonykchen
closed
2 months ago
0
add junit/ to gitignore and fix ci.yml
#23
sharonxiaohanli
closed
2 months ago
0
pass in configurable work directory
#22
sharonxiaohanli
closed
2 months ago
0
Formalize test plan schema
#21
sharonxiaohanli
opened
3 months ago
1
Add Bedrock knowledge base as target
#20
tonykchen
closed
2 months ago
0
Provide user interface to analyze and compare runs
#19
tonykchen
closed
1 month ago
0
Add diagram on how Agent Evaluation works
#18
tonykchen
closed
2 months ago
0
Dispatch evaluator as Lambda function
#17
tonykchen
opened
3 months ago
0
Add backoff strategy for evaluators and targets
#16
tonykchen
closed
2 months ago
0
Add Amazon Lex as a target
#15
tonykchen
closed
3 weeks ago
1
Add a CLI option to select tests to run
#14
tonykchen
closed
2 months ago
0
Add support for Claude 3 Haiku
#13
tonykchen
opened
3 months ago
1
Add hooks
#12
tonykchen
closed
3 months ago
0
Add example for REST API as a target
#11
tonykchen
closed
3 months ago
0
Add documentation regarding traces
#10
tonykchen
closed
3 months ago
0
Rename task docstring reference to test
#9
tonykchen
closed
3 months ago
0
Add Creators section to README
#8
bobbywlindsey
closed
3 months ago
0
Rename task to test
#7
tonykchen
closed
3 months ago
0
Update task to test; some small fixes
#6
bobbywlindsey
closed
3 months ago
0
Add trace handler
#5
tonykchen
closed
3 months ago
0
Update docs
#4
tonykchen
closed
3 months ago
0
Prerelease chores
#3
tonykchen
closed
3 months ago
0
Add CI workflow
#2
tonykchen
closed
3 months ago
0
Update docs
#1
tonykchen
closed
3 months ago
0
Previous