ethz-spylab / satml-llm-ctf

Code used to run the platform for the LLM CTF colocated with SaTML 2024
https://ctf.spylab.ai
MIT License
23 stars 5 forks source link

Some actions are steadily getting slower #61

Closed dpaleka closed 7 months ago

dpaleka commented 7 months ago

We've figured that creating new chats has been getting steadily slower since the peak, in a way that's not directly related to the overload. (There's also that factor, but it's slow even when there is a single active create chat request.) Working on a fix, hopefully less than 24 hours from now.

dedeswim commented 7 months ago

We should've solved this now through some better optimised DB queries. We'll leave it open for a while in case it becomes slower again.

As a reference, creating a chat went from taking >30s to taking <1s