search

maxbbraun / whisper-edge

OpenAI Whisper for edge devices
MIT License
107 stars 16 forks source link

Not working on Jetson Nano 2GB #4

Open grahameth opened 1 year ago

grahameth commented 1 year ago

Thanks for this repository! I was able to download and run it on my Jetson Nano 2GB. Sadly, even the tiny model causes an Out Of Memory error. Do you have an idea why it consumes so much memory? According the the whisper models page, tiny, base and small should fit into 2GB.

maxbbraun commented 1 year ago

I haven't looked into where exactly the memory is going, but my understanding is that the 2GB are shared, so it'll need to fit the model and any RAM the OS or application needs. It might be possible to optimize the system for a reduced memory footprint.

lunard commented 4 months ago

Hello to all!! I'll try the repo in my Jetson Nano 4GB.

did you find the leak ? Thanks a lot !!

grahameth commented 4 months ago

It's not a memory leak. The memory usage is just so high that it doesn't work with the 2GB version. But it should work with the 4GB version.