search

ethz-spylab / satml-llm-ctf

Code used to run the platform for the LLM CTF colocated with SaTML 2024
https://ctf.spylab.ai
MIT License
23 stars 5 forks source link

An error has occured - very long ime to submit an error. #49

Closed TimVanhamme closed 7 months ago

TimVanhamme commented 7 months ago

While submitting messages to the llama model an error occurs. Below the error message from the json response. It happens consitently for all llama models. Suddenly it takes very long to get a single response.

What is weird is that despite querying a llama model the error message refers to the OpenAI API

{'detail': ['OpenAI API error: A timeout error occurred. The function call took longer than 60 second(s).. If you have a team budget,note that your team budget has NOT been consumed.']}

dedeswim commented 7 months ago

Hi! We are using a library for which the same exceptions are thrown no matter if they are from issues with Together or OpenAI APIs. Looks like Together was having some issues, but it seems to be fine now as I can't reproduce your error anymore. I'm going to close this issue tomorrow unless the error comes up again

TimVanhamme commented 7 months ago

The problem is indeed gone now.