cogentapps / chat-with-gpt

An open-source ChatGPT app with a voice
https://www.chatwithgpt.ai
MIT License
2.3k stars 489 forks source link

Scaling chat-with-gpt across servers #139

Open aspdev91 opened 1 year ago

aspdev91 commented 1 year ago

First off, thanks for building and open-sourcing this project @cogentapps. It's extremely helpful and was my gateway into generative AI.

Quick question: In terms of scaling, I'm trying to determine if I need to change any of the code to deploy this across multiple servers to be load balanced. It seems like all auth information is all stored in a database which can be shared amongst servers and none of that info is stored in server memory. For the audio buffers from Eleven Labs though, I'm not sure if this will be a problem. I'm not too familiar with audio buffering/streaming.

I'm curious how you ended up deploying chatwithgpt.ai I'd appreciate your help on this and look forward to hearing from you.