Stuck while suing summarisation metric

confident-ai / deepeval

The LLM Evaluation Framework

https://docs.confident-ai.com/

Apache License 2.0

3.04k stars 226 forks source link

Stuck while suing summarisation metric #897

Open Vedant336Neekhra opened 2 months ago

Vedant336Neekhra commented 2 months ago

I was testing my Hindi summarization model and while calculating the evaluation metric for SUMMARIZATION I ran the following cell, but it kept on running for too long and did not give me any output. I have used GPT-3.5-turbo as my evaluation model. So the question is - does Deepeval not support evaluation for Hindi summarization models or I am doing something wrong? Screenshot 2024-07-19 034348

penguine-ip commented 2 months ago

@Vedant336Neekhra your openai is probably rate limited, that's why you're stuck