issues
search
Azure-Samples
/
ai-rag-chat-evaluator
Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
161
stars
58
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Tenant provided does not match error code : 400
#94
milind-devlok
opened
2 weeks ago
1
HTTPSConnection object at 0x00000244F06ABA10>: Failed to resolve 'https' ([Errno 11001] getaddrinfo failed)
#93
cetmca
opened
3 weeks ago
5
Update to new Protocol response format, use JMESPath expressions
#92
pamelafox
closed
3 weeks ago
0
Avoid rate-limiting, improve --changed
#91
pamelafox
closed
4 weeks ago
0
Remove unused Bicep
#90
pamelafox
closed
3 weeks ago
1
Hgmd 183/qa dataset generation and evaluation
#89
vovk-vitalii
closed
1 month ago
0
Bump promptflow-evals from 0.2.0.dev0 to 0.3.0
#88
dependabot[bot]
closed
1 month ago
0
Credential failure on evaluate script
#87
diberry
opened
1 month ago
5
Use old env var for model
#86
pamelafox
closed
1 month ago
0
Port to new promptflow-evals SDK
#85
pamelafox
closed
1 month ago
0
Bump promptflow from 1.6.0 to 1.10.1
#84
dependabot[bot]
closed
1 month ago
1
Remove unused infrastructure, disable keyed access for OpenAI service
#83
pamelafox
closed
2 months ago
0
Use Evaluations app whene the login is required in the chat app
#82
biancat821
closed
1 month ago
1
Bump promptflow from 1.6.0 to 1.10.0
#81
dependabot[bot]
closed
1 month ago
1
Getting nan values in results for metrics
#80
PavanMahajan777
opened
2 months ago
1
Bump promptflow from 1.6.0 to 1.9.0
#79
dependabot[bot]
closed
2 months ago
1
Bump promptflow from 1.6.0 to 1.8.0
#78
dependabot[bot]
closed
2 months ago
1
When using the local metrics with prompt getting Key Error during evaluation - values returning as None
#77
guild-ttreece
opened
2 months ago
8
mismatched_organization error
#76
yaqinamy
opened
2 months ago
3
Add keyring setup to CI
#75
pamelafox
closed
2 months ago
0
Fix target URL name
#74
pamelafox
closed
2 months ago
0
Add more OSes to matrix
#73
pamelafox
closed
2 months ago
0
Add optional target URL to evaluate command and CI to test evaluate
#72
pamelafox
closed
2 months ago
0
Fixes for running on GH
#71
pamelafox
closed
2 months ago
0
Adding azd GitHub actions workflow
#70
pamelafox
closed
2 months ago
0
Better debugging for evaluate command
#69
pamelafox
closed
2 months ago
0
Bump promptflow from 1.6.0 to 1.7.0
#68
dependabot[bot]
closed
2 months ago
1
Custom prompt for generating ground truth questions?
#67
samin-batra
opened
2 months ago
7
Connection error when running generator script
#66
rialtolabs-lit
opened
3 months ago
5
Pin promptflow
#65
pamelafox
closed
3 months ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b7 to 1.0.0b8
#64
dependabot[bot]
closed
3 months ago
0
Connection is not found during evaluate
#63
echen101
closed
3 months ago
13
Improving OpenAI support
#62
pamelafox
closed
3 months ago
0
Evaluate fails using openai.com instance
#61
reedrefucher
closed
3 months ago
1
Evaluate script not working
#60
FranciscoMMendes
closed
2 months ago
4
Fixing typo in readme
#59
codemillmatt
closed
3 months ago
0
Generator script not working
#58
killchainrepo
opened
3 months ago
4
Add citation_match metric, changed argument, answer reviewer
#57
pamelafox
closed
3 months ago
0
Incompatible Python Version 3.11, 3.12
#56
singloudly90
closed
2 months ago
2
Handle single directory for diff tool
#55
pamelafox
closed
3 months ago
0
Added citationmatch metric and tools for evaluating "I don't know" answers
#54
pamelafox
closed
4 months ago
0
Handle failures with numeric ratings
#53
pamelafox
closed
4 months ago
0
Fix data mapping to match new evaluate SDK expectations
#52
pamelafox
closed
4 months ago
0
Fix Azure OpenAI bug with API key
#51
sofyanajridi
closed
4 months ago
1
Support/prioritize local prompt metrics
#50
pamelafox
closed
4 months ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b6 to 1.0.0b7
#49
dependabot[bot]
closed
4 months ago
1
Wrong computation of GPT metrics after Update
#48
cpatrickalves
closed
4 months ago
8
yaml file does not exist
#47
Niharika6442
closed
4 months ago
2
Make windows-friendly adjustments to README
#46
pamelafox
closed
4 months ago
0
Upgrade sdk, add latency
#45
pamelafox
closed
4 months ago
0
Next