search

SYSTRAN / faster-whisper

Faster Whisper transcription with CTranslate2
MIT License
12.6k stars 1.05k forks source link

Possible to abort transcription? #984

Open mariano54 opened 2 months ago

mariano54 commented 2 months ago

I am performing a large number of transcriptions on limited GPU space.

I would like to cancel the model forwarding as soon as I know that I won't need the result. Is it possible to do this with faster-whisper?

If not, can you help guide me to where I'm Ctranslate2 I would need to modify to add this feature?

Thank you for your great work.

MahmoudAshraf97 commented 2 months ago

you can use multithreading, one thread per transcription using the same model instance, and kill the thread when you don't need it anymore