stanford-futuredata ARES issues

stanford-futuredata / ARES

Automated Evaluation of RAG Systems

https://ares-ai.vercel.app/

Apache License 2.0

452 stars 49 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

What is meant by contrastive learning objective?

#74 majdsalman opened 5 days ago
0
No strong negative generation

#73 WJ44 opened 1 week ago
0
Difference between Answer Relevance and Answer Faithfulness

#72 WJ44 opened 1 week ago
1
Solve llm judge training error

#71 WJ44 opened 1 month ago
1
Source of nq_labeled_output.tsv

#70 WJ44 opened 1 month ago
0
NQ dataset size in the readme

#69 nikil-algomo opened 2 months ago
0
Error while training classifier

#68 islambs231bi opened 2 months ago
0
Error while evaluating with PPI with API model LLM judge

#67 islambs231bi opened 2 months ago
0
Error while training LLM judge

#66 WJ44 opened 2 months ago
4
Reproducing results

#65 WJ44 closed 1 month ago
3
Unclear about the code of calculate_ppi function

#64 kitkhai opened 2 months ago
1
Training classifiers error

#63 Islam231bi opened 2 months ago
0
The local model needs to pass in a token in order to request it, May I ask if there is such a parameter

#62 starplatinum3 closed 2 months ago
1
OutOfMemoryError when Running Example Code with ARES

#61 chienyutseng closed 2 months ago
1
Other checkpoints

#60 MarineHoche closed 2 months ago
1
Azure OpenAI support

#59 Lilian-Silveira opened 2 months ago
1
LLM approach for synthetic query generation not using specified prompt

#58 WJ44 closed 2 months ago
1
Bump scikit-learn from 1.2.2 to 1.5.0

#57 dependabot[bot] closed 2 months ago
0
TGI Support

#56 ss2342 opened 3 months ago
0
ARES as a Chunk Reranker in a RAG app?

#55 naskovai closed 3 months ago
3
None of the tutorials work

#54 naskovai closed 3 months ago
9
Evaluation process only works with demo datasets, fails with any real dataset (that has only the columns described in the paper)

#53 elsatch opened 3 months ago
2
Bump tornado from 6.3.3 to 6.4.1

#52 dependabot[bot] closed 3 months ago
0
Updated eval loop and output to fix #50

#51 elsatch closed 3 months ago
1
Evaluating more than one dataset at a time returns incorrect results

#50 elsatch closed 3 months ago
0
Missing protobuf dependencies in ARES 0.6.1 PyPi package

#49 elsatch closed 3 months ago
1
[bug] error during import - vLLM not imported.

#48 mglowacki100 closed 3 months ago
1
getting TypeError: 'type' object is not subscriptable when importing the package

#47 kabani7 closed 3 months ago
1
Missing packages in linked Colab notebook

#46 elsatch closed 3 months ago
3
Small fixes

#45 WJ44 closed 4 months ago
0
Iteration over labels and datasets not working in PPI

#44 WJ44 closed 3 months ago
4
Precision-Performance Iteration (PPI) in README

#43 marcjulianschwarz closed 4 months ago
1
Bump requests from 2.31.0 to 2.32.0

#42 dependabot[bot] closed 4 months ago
0
Update README.md

#41 WJ44 closed 4 months ago
0
Bump transformers from 4.36.0 to 4.38.0

#40 dependabot[bot] closed 5 months ago
1
Bump tqdm from 4.65.0 to 4.66.3

#39 dependabot[bot] closed 5 months ago
0
Bump jupyterlab from 4.0.0 to 4.0.11

#38 dependabot[bot] closed 5 months ago
0
Bump langchain from 0.0.329 to 0.1.0

#37 dependabot[bot] closed 5 months ago
0
Bump pydantic from 1.10.7 to 1.10.13

#36 dependabot[bot] closed 5 months ago
0
Bump jupyter-lsp from 2.1.0 to 2.2.2

#35 dependabot[bot] closed 5 months ago
0
Bump jinja2 from 3.1.2 to 3.1.4

#34 dependabot[bot] closed 5 months ago
0
Bump aiohttp from 3.9.0 to 3.9.4

#33 dependabot[bot] closed 5 months ago
0
Bump werkzeug from 2.3.8 to 3.0.3

#32 dependabot[bot] closed 5 months ago
0
Update README.md

#31 elsatch closed 5 months ago
1
Unable to import without setting OpenAI key

#30 sumitsoman closed 5 months ago
1
Update README.md - Fix Step 4

#29 elsatch closed 5 months ago
1
Update README.md - Fixes #27

#28 elsatch closed 5 months ago
1
New README file instructions are incorrect

#27 elsatch closed 5 months ago
1
Updated synth_gen.md

#26 elsatch closed 5 months ago
1
Switch openai embeddings to local multilingual embeddings

#25 elsatch closed 5 months ago
2