search

rijnb / chatty-server

Chatty - A new front-end to ChatGPT
Apache License 2.0
14 stars 7 forks source link

gpt 4 takes very long and most importantly hangs up almost every time. #186

Closed NilsHampe-TomTom closed 7 months ago

NilsHampe-TomTom commented 7 months ago

Usually it only hangs up sometimes but right now it is almost always. It then shows connection error and sops mid answer. I could imagine that it has to do with peak and off-peak hours.

RijnBuve-TomTom commented 7 months ago

Hi Nils, this behaviour is caused not by the Chatty front-end, but by the GPT-4 instance that it's using. This open-source project only addresses problems with the front-end. Latency and responsiveness issues for the GPT-4 model are handled through CCoE (for TomTom deployments). Please raise this issue in the tomtom-chatgpt Slack channel to be heard there. Thanks!

NilsHampe-TomTom commented 7 months ago

I see. Thanks for the response. And btw, incredible work, in general this is insanely helpful!!