explodinggradients ragas issues

explodinggradients / ragas

Supercharge Your LLM Application Evaluations 🚀

https://docs.ragas.io

Apache License 2.0

7.3k stars 746 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

`FaithfulnesswithHHEM` doesn't match original prompt, leading to inconsistent scores

#1648 AshishSardana opened 1 week ago
0
feat: upload testset generation upload

#1647 jjmachan closed 1 week ago
0
docs: some metrics were missing from the docs

#1646 jjmachan closed 1 week ago
0
feat: improvements in test gen

#1645 shahules786 closed 2 weeks ago
1
When transforms is a list type, there is no generate_execution_plan function

#1644 frr163 closed 1 week ago
2
docs: fix _arize.md

#1643 suekou closed 1 week ago
1
Seed questions for guiding test generation

#1642 ableiweiss opened 2 weeks ago
2
fixed wrong variable names in starter guide using azure openai

#1641 MichaelPerger closed 2 weeks ago
1
Can't use Ollama?

#1640 hznnnnnn closed 2 weeks ago
1
docs: change setting llm

#1639 shahules786 closed 2 weeks ago
0
feat: aspect critic with reference

#1638 shahules786 closed 2 weeks ago
0
Issue with SSL certificate verification

#1637 AkileshSivaswamy opened 2 weeks ago
6
Add tutorial for evaluating LangGraph agents

#1636 sahusiddharth closed 1 week ago
2
LangGraph Agent Evaluation Tutorial

#1635 sahusiddharth closed 1 week ago
0
docs: Refactor Code for Syntax Highlighting and URL Updates

#1634 suekou closed 2 weeks ago
0
Subject: Issue with Agentic AI Metrics (Topic Adherence and Agent Goal Accuracy)

#1633 Nari995 opened 2 weeks ago
8
Error while using Gemini models with RAGAS

#1632 a-s-poorna opened 2 weeks ago
3
Faithfulness and Response Relevancy have high parse error rate with non-OpenAI model

#1631 ahgraber opened 2 weeks ago
4
failed to parse the output

#1630 amin-kh96 opened 2 weeks ago
0
feat: Unify the use of sentence_segmenter

#1629 jasinliu closed 2 weeks ago
1
Number of generated examples

#1628 MariosKef opened 2 weeks ago
0
fix: remove `.` as a split condition in noise_sensitivity.py

#1627 jasinliu closed 2 weeks ago
0
In NoiseSensitivity, the `.` should be deleted as the split condition.

#1626 jasinliu closed 2 weeks ago
0
feat: added upload for `EvaluationResult`

#1625 jjmachan closed 2 weeks ago
0
Prompt adaptation fails to save to file with unicode error (metric.save_prompts() function)

#1624 LukaszDejneka opened 2 weeks ago
2
Issues with metrics in version 0.1.18

#1623 littlebai3618 closed 2 weeks ago
2
Introduce epsilon in denominators to avoid division by zero

#1622 jltham closed 2 weeks ago
0
feat: improvements in test synthesization

#1621 shahules786 closed 2 weeks ago
0
Can the generated dataset be filled in the blank or true/false questions

#1620 SummerDream233 opened 2 weeks ago
2
feat: Add support for llamaIndex in evaluation

#1619 suekou closed 2 weeks ago
4
feat: automatic persona generation

#1618 shahules786 closed 2 weeks ago
1
[R-313] Adding more LLM/Embedding Providers

#1617 jjmachan opened 2 weeks ago
3
docs: how to add custom metrics

#1616 jjmachan closed 2 weeks ago
0
Creating a Test Dataset fails with IndexError: list index out of range

#1615 dipanjanS opened 2 weeks ago
0
[R-312] support adding metadata into testset generation

#1614 jjmachan opened 3 weeks ago
0
Hello, can RAGAS support Qwen2.5 model？

#1613 13416157913 closed 2 weeks ago
2
docs: add community docs

#1612 Yunnglin closed 3 weeks ago
0
docs: add comment for claude-3-5-sonnet-20241022

#1611 SokiKawashima closed 3 weeks ago
1
docs: added azure openai to default docs

#1610 jjmachan closed 2 weeks ago
0
feat: add support for llamaindex

#1609 jjmachan closed 3 weeks ago
1
Event loop stopped before Future completed -generator.generate_with_langchain_docs

#1608 jackqdldd opened 3 weeks ago
4
Fix: Add instance check before casting ChatGeneration object

#1607 Youngrok123 closed 3 weeks ago
4
docs: Add embedding_model attribute when creating TestsetGenerator object

#1606 Youngrok123 closed 3 weeks ago
1
Fix : Filename in the path

#1605 satodayo closed 3 weeks ago
0
feat: fine-tuning test generation

#1604 shahules786 closed 2 weeks ago
0
fix: remove abstract class in Metric

#1603 jjmachan closed 3 weeks ago
0
[R-311] Adding exact match caching

#1602 jjmachan opened 3 weeks ago
0
chore: added slash commands for github

#1601 jjmachan closed 2 weeks ago
2
Exception raised in Job[300]: ValueError({'code': '3001', 'message': 'HTTP外部调用超时'})

#1600 snailmiss opened 3 weeks ago
3
.adapt_prompt to another language. ValueError with diff. number of statements (input,output)

#1599 rdummarf closed 2 weeks ago
3

Previous Next