issues
search
Azure-Samples
/
ai-rag-chat-evaluator
Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
162
stars
58
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How to compute mean RAG latency?
#44
cpatrickalves
closed
4 months ago
4
Bump azure-ai-generative from 1.0.0b2 to 1.0.0b5
#43
dependabot[bot]
closed
4 months ago
1
Bump azureml-metrics[generative-ai] from 0.0.42 to 0.0.44
#42
dependabot[bot]
closed
4 months ago
1
Add test call to GPT deployment
#41
pamelafox
closed
5 months ago
0
Fix numquestions correctly
#40
pamelafox
closed
5 months ago
0
Make numquestions an optional argument
#39
pamelafox
closed
5 months ago
0
Evaluate script fails after "Starting evaluation...": 'charmap' codec can't encode characters in position 6-10: character maps to <undefined>
#38
sofyan-ajridi-ey
closed
4 months ago
19
Missing option '--numquestions'
#37
KorbinianBraun4ntt
closed
5 months ago
3
Add english-only notes to readme
#36
pamelafox
closed
5 months ago
0
How can I create QA pairs on another language?
#35
cpatrickalves
closed
5 months ago
7
Better error messages, tests, and encoding
#34
pamelafox
closed
5 months ago
0
Computing gpt based metrics failed with the exception : 'charmap' codec can't encode characters
#33
KorbinianBraun4ntt
closed
5 months ago
5
'FileStore' object has no attribute 'get_host_creds'
#32
Niharika6442
closed
4 months ago
8
Bump azureml-metrics[generative-ai] from 0.0.42 to 0.0.43
#31
dependabot[bot]
closed
5 months ago
2
Rename parameters json
#30
pamelafox
closed
5 months ago
0
Summary.app fix for parameters.json
#29
diberry
closed
5 months ago
1
Address feedback from Chris
#28
pamelafox
closed
5 months ago
0
Can you add a link for the overrides?
#27
diberry
closed
5 months ago
1
Review tool errors "No such file or directory: 'my_results/experiment1705604697/parameters.json'"
#26
diberry
closed
5 months ago
3
Pin AzureML metrics
#25
pamelafox
closed
5 months ago
0
Add tests for evaluate
#24
pamelafox
closed
4 months ago
1
Add tests for review_tools
#23
pamelafox
opened
5 months ago
1
Update requirements
#22
pamelafox
closed
5 months ago
0
Remove pre-commit from devcontainer.json
#21
pamelafox
closed
5 months ago
0
Readme improvements
#20
pamelafox
closed
5 months ago
0
pip install for review_tools in postCreateCommand?
#19
diberry
closed
5 months ago
0
new clone today doesn't run generate - AttributeError: module 'azureml.metrics.constants' has no attribute 'QUESTION_ANSWERING'
#18
diberry
closed
5 months ago
1
new clone today has error in postCreateCommand
#17
diberry
closed
5 months ago
1
Check for git directory before pre-commit
#16
pamelafox
closed
5 months ago
0
Support for making a directory
#15
pamelafox
closed
5 months ago
0
Fix keys
#14
pamelafox
closed
5 months ago
1
AZURE_OPENAI_API_KEY mismatch
#13
Loo-Ree
closed
5 months ago
1
AZURE_SEARCH_API_KEY mismatch
#12
Loo-Ree
closed
5 months ago
0
Bump openai from 0.28.1 to 1.7.2
#11
dependabot[bot]
closed
5 months ago
2
Calculating overall metrics occasionally fails with error on return int(rating) >= 4
#10
dfberry
closed
4 months ago
13
Can the generate script create the output dir/path if it doesn't exist?
#9
dfberry
closed
5 months ago
2
Fix env var to match service setup
#8
pamelafox
closed
5 months ago
0
Is the .env.sample correct?
#7
dfberry
closed
5 months ago
1
Update env to match azure-search-openai-demo
#6
dfberry
closed
5 months ago
2
Where to give input data to generate ground truth samples from?
#5
Niharika6442
closed
5 months ago
2
script: module 'openai' has no attribute 'error'
#4
dfberry
closed
5 months ago
3
Deploy in Container apps job?
#3
dfberry
opened
5 months ago
1
Dev Container post-create-command fails b/c GIT isn't installed
#2
diberry
closed
5 months ago
4
Bump actions/setup-python from 4 to 5
#1
dependabot[bot]
closed
6 months ago
0
Previous