search

ggerganov / whisper.cpp

Port of OpenAI's Whisper model in C/C++
MIT License
34.26k stars 3.48k forks source link

Base on Pixel 7 devices, Android devices testing, Slowing,Should not used GPU library, How to support GPU via Metal in Android devices. #1637

Open skyxiaobai opened 8 months ago

skyxiaobai commented 8 months ago

System Info: AVX = 0 | AVX2 = 0 | AVX512 = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | METAL = 0 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | CUDA = 0 | COREML = 0 | OPENVINO = 0 | Loading data... Copying jfk.wav... All data copied to working directory. Loading model... Loaded model ggml-base.bin. Reading wave samples... 11001 ms Transcribing data... Done (30141 ms): And so my fellow Americans, ask not what your country can do for you, ask what you can do for your country.

bobqianic commented 8 months ago

How to support GPU via Metal in Android device

Android does not inherently support Metal

Try using OpenBLAS and OpenCL to see if they bring any speed improvements.

AndreaChiChengdu commented 8 months ago

How to support GPU via Metal in Android device

Android does not inherently support Metal

Try using OpenBLAS and OpenCL to see if they bring any speed improvements.

hello bobqianic, I met the same question in my xiaomi14 pro when i use the whisperCppDemo,I found that it works only on cpu(without openblas). any suggestion for accelerate on android devices？ thanks～