Azure-Samples ai-rag-chat-evaluator issues

Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

MIT License

226 stars 78 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

promptflow not inheriting CLI credentials

#111 JonathanDench opened 3 days ago
0
Bump azure-ai-evaluation from 1.0.0b3 to 1.0.0b5

#110 dependabot[bot] opened 1 week ago
0
Bump azure-ai-evaluation from 1.0.0b3 to 1.0.0b4

#109 dependabot[bot] closed 1 week ago
1
Bump azure-ai-generative[evaluate] from 1.0.0b8 to 1.0.0b11

#108 dependabot[bot] opened 1 month ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b8 to 1.0.0b10

#107 dependabot[bot] closed 1 month ago
1
Update to azure-ai-evaluations

#106 pamelafox closed 1 month ago
0
Updates to example data

#105 pamelafox closed 1 month ago
0
Prompt updates

#104 pamelafox closed 1 month ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b8 to 1.0.0b9

#103 dependabot[bot] closed 1 month ago
1
More generic, installable

#102 pamelafox closed 3 weeks ago
0
Updated example results

#101 pamelafox closed 2 months ago
0
Billing Escalation Request Due to Undocumented Feature in Azure-Samples Repository

#100 YuxuanZhang49 closed 2 months ago
10
HTTP error 431, Request Header Fields Too Large, when running generate.py

#99 DuboisABB closed 2 months ago
5
Bump promptflow-evals from 0.3.0 to 0.3.2

#98 dependabot[bot] closed 2 months ago
0
Evaluation Script Fails Due to Invalid JSON Response from Authenticated Endpoint

#97 advanced-flow opened 4 months ago
9
Make index citation field name configurable

#96 jakeatmsft closed 4 months ago
0
Bump promptflow-evals from 0.3.0 to 0.3.1

#95 dependabot[bot] closed 3 months ago
1
Tenant provided does not match error code : 400

#94 milind-devlok opened 5 months ago
2
HTTPSConnection object at 0x00000244F06ABA10>: Failed to resolve 'https' ([Errno 11001] getaddrinfo failed)

#93 cetmca opened 5 months ago
5
Update to new Protocol response format, use JMESPath expressions

#92 pamelafox closed 5 months ago
0
Avoid rate-limiting, improve --changed

#91 pamelafox closed 5 months ago
0
Remove unused Bicep

#90 pamelafox closed 5 months ago
1
Hgmd 183/qa dataset generation and evaluation

#89 vovk-vitalii closed 5 months ago
0
Bump promptflow-evals from 0.2.0.dev0 to 0.3.0

#88 dependabot[bot] closed 6 months ago
0
Credential failure on evaluate script

#87 diberry opened 6 months ago
5
Use old env var for model

#86 pamelafox closed 6 months ago
0
Port to new promptflow-evals SDK

#85 pamelafox closed 6 months ago
0
Bump promptflow from 1.6.0 to 1.10.1

#84 dependabot[bot] closed 6 months ago
1
Remove unused infrastructure, disable keyed access for OpenAI service

#83 pamelafox closed 6 months ago
0
Use Evaluations app whene the login is required in the chat app

#82 biancat821 closed 6 months ago
1
Bump promptflow from 1.6.0 to 1.10.0

#81 dependabot[bot] closed 6 months ago
1
Getting nan values in results for metrics

#80 PavanMahajan777 opened 6 months ago
1
Bump promptflow from 1.6.0 to 1.9.0

#79 dependabot[bot] closed 6 months ago
1
Bump promptflow from 1.6.0 to 1.8.0

#78 dependabot[bot] closed 6 months ago
1
When using the local metrics with prompt getting Key Error during evaluation - values returning as None

#77 guild-ttreece opened 7 months ago
8
mismatched_organization error

#76 yaqinamy opened 7 months ago
3
Add keyring setup to CI

#75 pamelafox closed 7 months ago
0
Fix target URL name

#74 pamelafox closed 7 months ago
0
Add more OSes to matrix

#73 pamelafox closed 7 months ago
0
Add optional target URL to evaluate command and CI to test evaluate

#72 pamelafox closed 7 months ago
0
Fixes for running on GH

#71 pamelafox closed 7 months ago
0
Adding azd GitHub actions workflow

#70 pamelafox closed 7 months ago
0
Better debugging for evaluate command

#69 pamelafox closed 7 months ago
0
Bump promptflow from 1.6.0 to 1.7.0

#68 dependabot[bot] closed 7 months ago
1
Custom prompt for generating ground truth questions?

#67 samin-batra opened 7 months ago
7
Connection error when running generator script

#66 rialtolabs-lit opened 7 months ago
5
Pin promptflow

#65 pamelafox closed 7 months ago
0
Bump azure-ai-generative[evaluate] from 1.0.0b7 to 1.0.0b8

#64 dependabot[bot] closed 7 months ago
0
Connection is not found during evaluate

#63 echen101 closed 7 months ago
13
Improving OpenAI support

#62 pamelafox closed 7 months ago
0