Azure-Samples ai-rag-chat-evaluator issues

Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

MIT License

163 stars 59 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Tenant provided does not match error code : 400

#94 milind-devlok opened 2 weeks ago
1
HTTPSConnection object at 0x00000244F06ABA10>: Failed to resolve 'https' ([Errno 11001] getaddrinfo failed)

#93 cetmca opened 4 weeks ago
5
Update to new Protocol response format, use JMESPath expressions

#92 pamelafox closed 1 month ago
0
Avoid rate-limiting, improve --changed

#91 pamelafox closed 1 month ago
0
Remove unused Bicep

#90 pamelafox closed 1 month ago
1
Hgmd 183/qa dataset generation and evaluation

#89 vovk-vitalii closed 1 month ago
0
Bump promptflow-evals from 0.2.0.dev0 to 0.3.0

#88 dependabot[bot] closed 1 month ago
0
Credential failure on evaluate script

#87 diberry opened 1 month ago
5
Use old env var for model

#86 pamelafox closed 1 month ago
0
Port to new promptflow-evals SDK

#85 pamelafox closed 1 month ago
0
Bump promptflow from 1.6.0 to 1.10.1

#84 dependabot[bot] closed 1 month ago
1
Remove unused infrastructure, disable keyed access for OpenAI service

#83 pamelafox closed 2 months ago
0
Use Evaluations app whene the login is required in the chat app

#82 biancat821 closed 2 months ago
1
Bump promptflow from 1.6.0 to 1.10.0

#81 dependabot[bot] closed 2 months ago
1
Getting nan values in results for metrics

#80 PavanMahajan777 opened 2 months ago
1
Bump promptflow from 1.6.0 to 1.9.0

#79 dependabot[bot] closed 2 months ago
1
Bump promptflow from 1.6.0 to 1.8.0

#78 dependabot[bot] closed 2 months ago
1
When using the local metrics with prompt getting Key Error during evaluation - values returning as None

#77 guild-ttreece opened 2 months ago
8
mismatched_organization error

#76 yaqinamy opened 3 months ago
3
Add keyring setup to CI

#75 pamelafox closed 3 months ago
0
Fix target URL name

#74 pamelafox closed 3 months ago
0
Add more OSes to matrix

#73 pamelafox closed 3 months ago
0
Add optional target URL to evaluate command and CI to test evaluate

#72 pamelafox closed 3 months ago
0
Fixes for running on GH

#71 pamelafox closed 3 months ago
0
Adding azd GitHub actions workflow

#70 pamelafox closed 3 months ago
0
Better debugging for evaluate command

#69 pamelafox closed 3 months ago
0
Bump promptflow from 1.6.0 to 1.7.0

#68 dependabot[bot] closed 2 months ago
1
Custom prompt for generating ground truth questions?

#67 samin-batra opened 3 months ago
7
Connection error when running generator script

#66 rialtolabs-lit opened 3 months ago
5
Pin promptflow

#65 pamelafox closed 3 months ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b7 to 1.0.0b8

#64 dependabot[bot] closed 3 months ago
0
Connection is not found during evaluate

#63 echen101 closed 3 months ago
13
Improving OpenAI support

#62 pamelafox closed 3 months ago
0
Evaluate fails using openai.com instance

#61 reedrefucher closed 3 months ago
1
Evaluate script not working

#60 FranciscoMMendes closed 3 months ago
4
Fixing typo in readme

#59 codemillmatt closed 3 months ago
0
Generator script not working

#58 killchainrepo opened 3 months ago
4
Add citation_match metric, changed argument, answer reviewer

#57 pamelafox closed 3 months ago
0
Incompatible Python Version 3.11, 3.12

#56 singloudly90 closed 3 months ago
2
Handle single directory for diff tool

#55 pamelafox closed 4 months ago
0
Added citationmatch metric and tools for evaluating "I don't know" answers

#54 pamelafox closed 4 months ago
0
Handle failures with numeric ratings

#53 pamelafox closed 4 months ago
0
Fix data mapping to match new evaluate SDK expectations

#52 pamelafox closed 4 months ago
0
Fix Azure OpenAI bug with API key

#51 sofyanajridi closed 4 months ago
1
Support/prioritize local prompt metrics

#50 pamelafox closed 4 months ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b6 to 1.0.0b7

#49 dependabot[bot] closed 4 months ago
1
Wrong computation of GPT metrics after Update

#48 cpatrickalves closed 4 months ago
8
yaml file does not exist

#47 Niharika6442 closed 4 months ago
2
Make windows-friendly adjustments to README

#46 pamelafox closed 5 months ago
0
Upgrade sdk, add latency

#45 pamelafox closed 5 months ago
0