search

SYSTRAN / faster-whisper

Faster Whisper transcription with CTranslate2
MIT License
11.4k stars 950 forks source link

Is there a way to further convert the model to tensorRT? #247

Closed arnavmehta7 closed 1 year ago

arnavmehta7 commented 1 year ago

Is there a way to further convert the model to tensorRT? I think the model speed could be improved.

guillaumekln commented 1 year ago

Maybe other people will try to convert to TensorRT, but this will not happen in this project which is designed to use CTranslate2.

See for example https://github.com/openai/whisper/discussions/169.