explodinggradients / ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
https://docs.ragas.io
Apache License 2.0
6.27k stars 597 forks source link

erorr on windows #784

Open frischzenger opened 5 months ago

frischzenger commented 5 months ago

[ ] I have checked the documentation and related resources and couldn't resolve my bug.

i ran following code of ragas on windows 10

Ragas version: 0.1.4 Python version: 3.9

Code to Reproduce `` from datasets import Dataset import os from ragas import evaluate from ragas.metrics import faithfulness, answer_correctness

os.environ["OPENAI_API_KEY"] = "your-openai-key"

data_samples = { 'question': ['When was the first super bowl?', 'Who won the most super bowls?'], 'answer': ['The first superbowl was held on Jan 15, 1967', 'The most super bowls have been won by The New England Patriots'], 'contexts' : [['The First AFL–NFL World Championship Game was an American football game played on January 15, 1967, at the Los Angeles Memorial Coliseum in Los Angeles,'], ['The Green Bay Packers...Green Bay, Wisconsin.','The Packers compete...Football Conference']], 'ground_truth': ['The first superbowl was held on January 15, 1967', 'The New England Patriots have won the Super Bowl a record six times'] }

dataset = Dataset.from_dict(data_samples)

score = evaluate(dataset,metrics=[faithfulness,answer_correctness]) score.to_pandas() ``

Error trace RunTime error: event loop is closed.

monuminu commented 5 months ago

Facing the same issue

shiyoh-goetsu commented 3 months ago

facing the same issue

JIAWENee commented 3 months ago

Facing the same issue

JIAWENee commented 2 months ago

I encountered the same problem in the following environment: Operating system: win 11 python version: 3.8 ragas version: 0.1.8

When I changed the python version to 3.10, the problem was solved.