Why coreml is so slow? - Githubissues

ggerganov / whisper.cpp

Port of OpenAI's Whisper model in C/C++

MIT License

34.88k stars 3.56k forks source link

Why coreml is so slow? #1616

Open ILG2021 opened 10 months ago

ILG2021 commented 10 months ago

I use whisper.cpp to transcribe a short sentence, when i use coreml, it cost 36 s to finish it. But without coreml, it cost 13s, what's the problem?

tjwangji commented 9 months ago

I have the same issue. For the same 6-minute audio file, after git cloning and running make, it completes in 140 seconds. However, when using CoreML, it takes 220 seconds on an M1 MacBook Pro. I'm not sure what the problem is.