langchain-ai / auto-evaluator

https://autoevaluator.langchain.com/
Other
742 stars 99 forks source link

Server error when using online Playground #102

Open klein-t opened 1 year ago

klein-t commented 1 year ago

I keep getting this error whenever I try to run an experiment on the online Playground. Any idea on what's wrong? Do I need to run the tool locally?

image

rich5000 commented 1 year ago

getting the same error here as well, are there other requirements to test the online playground?

rlancemartin commented 1 year ago

What inputs (settings and document) are you testing? This indicates a general error with the back-end, but doesn't tell us the specific problem. For example, the LLM API may have thrown an error or there might have been an invalid token in your doc. I can try to reproduce if you send along your inputs.

rich5000 commented 1 year ago

the playground seems to be working fine now with all the same inputs. Maybe there was a server issue yesterday? Once again, thanks for the great work on this repo!

rklostermann commented 1 year ago

I'm having the same issue. Do I need to input any API key to use the front end playground?

TechnicolorGUO commented 1 year ago

even the demo did not work

hwaneric commented 1 year ago

Getting the same server error even when just trying to re-run the experiment on the base demo

karansapolia commented 1 year ago

Getting the same server error even when just trying to re-run the experiment on the base demo

The auto-evaluator tool is basically unusable at the moment for me because of this. Cannot even run the demo.

rlancemartin commented 1 year ago

Ya, back-end is down due to issue w/ provider (Railway). Working on a fix now cc @hwchase17

flyspirit99 commented 1 year ago

Still not working.