Can Bark.cpp support acceleration with AMD GPU with ROCM? - Githubissues

PABannier / bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech

MIT License

630 stars 48 forks source link

Can Bark.cpp support acceleration with AMD GPU with ROCM? #165

Open eliranwong opened 2 months ago

eliranwong commented 2 months ago

Can Bark.cpp support acceleration with AMD GPU with ROCM?

PABannier commented 2 months ago

Hello @eliranwong ! We are currently working on ggml to support the necessary operations in CuBLAS. I think with CuBLAS we should be able to support AMD GPU.