search

ahmetoner / whisper-asr-webservice

OpenAI Whisper ASR Webservice API
https://ahmetoner.github.io/whisper-asr-webservice
MIT License
1.99k stars 357 forks source link

Request for Parallel Processing in Web Service #80

Open RishishPandey opened 1 year ago

RishishPandey commented 1 year ago

Hi,

I recently used your web service and attempted to make multiple requests together. However, I noticed that the service handled them in a sequential manner only. I was wondering if it's possible to process them in parallel instead?

As a newcomer to this field, I'm not sure if multiple GPUs are necessary to achieve parallel processing. If that's the case, please let me know.

Thank you for your time and assistance. Please feel free to ask if you need any further information.

Best regards, Rishish Pandey

ostrolucky commented 10 months ago

Indeed. When container processes a request, even calling /docs endpoint fails