-
### Bug Description
data_generator.generate_questions_from_nodes() does not generate questions. Progress bar does not move
### Version
0.10.27
### Steps to Reproduce
llm = AzureOpenAI(
model…
-
### Bug Description
While running the following code block:
```
rag_eval_dataset = LabelledRagDataset.from_json(
path=EVAL_DS_PATH
)
rag_evaluator = RagEvaluatorPack(
judge_llm=judg…
-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please…
-
**Describe the bug**
When evaluate with long context, an error was raised like this:
```
openai.BadRequestError: Error code: 400 - {'error': {'message': "This model's maximum context length is 4097…
-
**Describe the bug**
I am trying to generate synthetic data using Azure Openai api and AzureSearch as the document store. However, when I try to run the code, it throws that AzureSearch object doesn'…
-
Hi,
I'm trying to evulate faithfulness by giving some out of context question and I was getting the score as nan(Not a number).
I took a look at the code adn found that [this line](https://github…
-
### Describe the bug
I am using Langfuse to monitor a LangChain AgentExecutor using AzureOpenAI model.
An error catch and logged by `langfuse.callback.CallbackHandler.on_chain_end`:
```
ERROR:langfu…
-
**Note**: This is just an idea, open to discussions.
**Problem**: For use cases(like financial, legal, health-care) where the data might contain names of people, places, organizations etc, most of …
-
**Is your feature request related to a problem? Please describe.**
Athina AI has open-sourced their approach towards text summarization.
We need to implement this in some sort of summarization cr…
-
I want to use local model that download from huggingface as the provider of the Trulens feedback for RAG Evaluation of Llama-Index project.How to set it and custom prompt?
Thank you.