Is it possible to get this on Jetson using the GPU?

ahmetoner / whisper-asr-webservice

OpenAI Whisper ASR Webservice API

https://ahmetoner.github.io/whisper-asr-webservice

MIT License

1.86k stars 332 forks source link

Is it possible to get this on Jetson using the GPU? #133

Closed vinniyo closed 9 months ago

vinniyo commented 9 months ago

There's latest and latest-gpu but the gpu wont run on arm64. Doesn anyone know of a workaround? Thanks.

ayancey commented 9 months ago

You may need to use custom wheels for pytorch that support Jetson. If you are able to get it working, please let me know. We might be able to add a new docker build for Jetson.