Const-me / Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
Mozilla Public License 2.0
8.46k stars 724 forks source link

Released binary (cpi-1.11) do not start in total silence #86

Open nms42 opened 1 year ago

nms42 commented 1 year ago

As it was discovered with great help of SubtitleEdit author due to lack of AVX stuff in my CPU.

Screenshot 2023-04-11 at 14 43 08

Any hope to see binaries for not so advanced CPUs? Is it possible for CUDA based project? For a legacy CUDA hardware?

emcodem commented 1 year ago

Hm actually i am not sure if it is neccessary/helpful to utilize AVX stuff in the Const-Me Version. Are you able to build the stuff on your own? .. If yes, try to disable all optimisations and intrinsics. If no, i made a build with VS options "C++/Optimisation- Enable Intrinsic Functions: No

Just for interest, please try if it works, if it does at least we have the solution here. Whisper_built_with_intrinsics_disabled.zip

nms42 commented 1 year ago

Sorry for long delay with answer - RealLife(r) took its lion share ;-(

No, it still fails with the same error. Is it possible to make binaries with explicitly disabled cpu features above SSE2?