Infrastructure for multiple sessions

collabora / WhisperLive

A nearly-live implementation of OpenAI's Whisper.

MIT License

2.1k stars 286 forks source link

Infrastructure for multiple sessions #244

Open alpcansoydas opened 5 months ago

alpcansoydas commented 5 months ago

I wanna ask about the deployment whisperLive for multiple users. Which GPU model and how many do I need to use for multiple parallel sessions? Do you have any experiments or best practice about it?