search

SYSTRAN / faster-whisper

Faster Whisper transcription with CTranslate2
MIT License
11.39k stars 951 forks source link

Possible to abort transcription? #984

Open mariano54 opened 2 weeks ago

mariano54 commented 2 weeks ago

I am performing a large number of transcriptions on limited GPU space.

I would like to cancel the model forwarding as soon as I know that I won't need the result. Is it possible to do this with faster-whisper?

If not, can you help guide me to where I'm Ctranslate2 I would need to modify to add this feature?

Thank you for your great work.

MahmoudAshraf97 commented 1 week ago

you can use multithreading, one thread per transcription using the same model instance, and kill the thread when you don't need it anymore