empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
143 stars 11 forks source link

rag example: add run -> change parameter `model` to `gpt-4` -> script times out but no error shown on the UI #168

Closed saikatmitra91 closed 2 months ago

saikatmitra91 commented 2 months ago

📝 Description

In the RAG example, change the parameter model to gpt-4 and try running it.

You would see the script times out but the UI - webapp - doesnt show any error.

Screenshot 2024-04-22 at 8 12 34 AM

Expected

aditya-67 commented 2 months ago

@saikatmitra91 I tried this and was able to run gpt-4 without any script timed out error. Is this a one-off error? Wasn't able to reproduce it.

empiricalrc.json

Screenshot 2024-05-16 at 09 22 27

Terminal

Screenshot 2024-05-16 at 09 22 52
arjunattam commented 2 months ago

Yes this is fixed with #183. Closing