Adjusting max batch size in order to build TRT models on smaller GPUs

Wordcab / wordcab-transcribe

💬 ASR FastAPI server using faster-whisper and Multi-Scale Auto-Tuning Spectral Clustering for diarization.

https://wordcab.github.io/wordcab-transcribe/

MIT License

198 stars 29 forks source link

Closed aleksandr-smechov closed 8 months ago