explodinggradients ragas issues

explodinggradients / ragas

Supercharge Your LLM Application Evaluations 🚀

https://docs.ragas.io

Apache License 2.0

7.3k stars 746 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Function is_base64 falsely classifies text as image

#1697 VitahuHere opened 8 hours ago
0
MultiHopAbstractQuerySynthesizer testset generation is not working.

#1696 kh-taher opened 19 hours ago
0
Ragas with Llama-Index not working correctly due to misdefined scope

#1695 georgije-conv opened 1 day ago
0
TestsetGenerator() not producing the "response" field

#1694 rcruzgar opened 1 day ago
2
Prompt Error, TimeOut error

#1693 giambascientist86 opened 1 day ago
0
Exception raised in Job APIConnectionError(Connection error.)

#1692 ldzh-97 opened 2 days ago
1
feat: removed critics and rubrics from examples

#1691 jjmachan closed 1 day ago
0
fix: missing embeddings argument in testset and some E2E tests

#1690 jjmachan closed 3 days ago
0
For some RAGAS metrics score is not accurate:

#1689 Jahnavi-pothuri opened 3 days ago
1
AttributeError('StringIO' object has no attribute 'classifications')

#1688 timelesshc opened 3 days ago
0
Added parallel tool call evaluation to ToolCallAccuracy metric

#1687 sahusiddharth opened 4 days ago
1
Update rag.md

#1686 TimWue closed 4 days ago
1
Fixes ToolCallAccuracy raises ZeroDivisionError when called without any arguments.

#1685 sahusiddharth closed 2 days ago
1
ToolCallAccuracy raises ZeroDivisionError when called without any arguments

#1684 sahusiddharth closed 2 days ago
0
AttributeError: object has no attribute 'sentences'

#1683 William8Work opened 5 days ago
0
Duplicate Questions and Spelling Mistakes in Generated Testset

#1682 Jayashree-kalabhavi opened 6 days ago
1
Explicit the "Failed to parse output. Returning None." of RagasoutputParser or add a way to catch it.

#1681 Gwenn-LR opened 6 days ago
1
fixes: handle long context extraction

#1680 shahules786 closed 2 days ago
0
feat: fix llm extractors

#1679 shahules786 closed 1 week ago
0
removed MetricWithLLM from SemanticSimilarity

#1678 Luka958Pixion closed 1 week ago
0
The example in ’https://docs.ragas.io/en/latest/getstarted/rag_testset_generation/‘ is not available

#1677 Createsnow opened 1 week ago
6
fix: upload for testset

#1676 jjmachan closed 1 week ago
0
docs: update readme

#1675 jjmachan closed 1 week ago
0
docs: updated readme

#1674 jjmachan closed 1 week ago
0
fixes: add extraction limit to Extractors

#1673 shahules786 closed 1 week ago
0
fixes: instruction format

#1672 shahules786 closed 1 week ago
0
[R-314] Cost estimation for Transforms

#1671 jjmachan opened 1 week ago
0
`testset_size` Parameter Not Generating Correct Number of Samples

#1670 Jayashree-kalabhavi closed 1 week ago
2
Avoid unnecessary decompose_claims call when mode='precision' in _factual_correctness.py

#1669 dfhssilva closed 1 week ago
0
Added initialize calls for generator methods

#1668 Maneshgpai closed 1 week ago
1
Timeout Error

#1667 Dormiveglia-elf opened 1 week ago
3
feat: make general purpose metrics more general

#1666 jjmachan closed 2 days ago
1
Update tool call accuracy.

#1665 MattZ-99 opened 1 week ago
4
docs: persona generator

#1664 jjmachan closed 1 week ago
0
Exceeding model token limit issues with open-source models locally hosted via vLLM

#1663 YuffieHuang opened 1 week ago
0
docs: reorganise files

#1662 shahules786 closed 1 week ago
0
feat: improvements in default test generation

#1661 shahules786 closed 1 week ago
0
Testset generation broken after migrating from 0.1.x to 0.2.4

#1660 malikbrh opened 1 week ago
4
testset_generation：the max_wait not works

#1659 jackqdldd opened 1 week ago
2
Issue about tool call metrics.

#1658 MattZ-99 opened 1 week ago
2
testset-generation: Embedding issues in apply_transforms

#1657 shashi792 opened 1 week ago
1
Update _factual_correctness.py

#1656 yousoferfani closed 1 week ago
3
ModuleNotFoundError: No module named 'llama_index.core'

#1655 cirezd closed 1 week ago
2
Can I control the concurrency of calling LLM

#1654 jackqdldd opened 1 week ago
1
docs: add cost tracker back

#1653 shahules786 closed 1 week ago
0
docs: tracing and debugging metrics

#1652 shahules786 closed 1 week ago
0
WARNING:ragas.metrics._faithfulness:No statements were generated from the answer.

#1651 kyuz0 opened 1 week ago
2
Bug fixing recall in _factual_correctness.py

#1650 GitMarco27 closed 1 week ago
1
How to evaluate the json data

#1649 landhu closed 1 week ago
5
`FaithfulnesswithHHEM` doesn't match original prompt, leading to inconsistent scores

#1648 AshishSardana opened 1 week ago
0