Open JPonsa opened 1 month ago
Could the problem lie with distributions
? As far as I know, the sum of all distributions must add up to 1.
@omkar-334, thanks for spotting that. This was a typo when copying the code into the ticket. I am passing them as an argument to my script. In my code it is correct and adding to 1. I corrected the info in the ticket description
same issue . i think if context_scoring_parser = RagasoutputParser(pydantic_object=ContextScoring)
in output_parser.py
return None , means llm cannot gen result by right prompt , it will cause this exception.
also , if scoring is None . https://github.com/explodinggradients/ragas/blob/9bc6e6fd44180e658751e15da3a3829c957ee853/src/ragas/testset/filters.py#L60 , it will cause ZeroDivisionError: division by zero
pls fix this.
I am getting an “Failed to parse output. Returning None” error. I I have tried llama3 and mistral8x7b. I believe both models should be able to generate json like outputs.
I need advice on how to solve this.
This could be related to https://github.com/explodinggradients/ragas/issues/859
Error: Note: I had to trim the SimpleEvolution message as it was reporting the content of many documents and their embedding.