Closed NereaCassian closed 1 year ago
I noticed streaming stopped working for me, so went back and set everything up again. It all worked fine until I enabled HTTPS (using certbot for nginx). Once I was using HTTPS streaming stopped working.
This appears to be an issue when using nginx as a reverse proxy. Adding proxy_buffering off;
in the location block fixed it.
Yep doing that solved it.
The responses of the AI are not being streamed
i have the ui deployed o a linux VPS with 11gigs and 8vcores