time limit error while trying to reproduce the results

MetaCopilot / dseval

https://metacopilot.github.io/dseval/

MIT License

19 stars 4 forks source link

Open rsarbhangia opened 6 months ago

rsarbhangia commented 6 months ago

I'm trying to reproduce the results. Facing issue.

Issue: Problem Set: mcdonalds-store-reviews Question: 1 Getting dseval.limit.TimeLimitError.

Even in this I'm assuming this should have been handled.

ultmaster commented 6 months ago

Does it reproduce stably? Or does it just happen randomly?