search

matatonic / openedai-speech

An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
GNU Affero General Public License v3.0
192 stars 32 forks source link

AMD GPU #13

Closed G4Zz0L1 closed 1 month ago

G4Zz0L1 commented 1 month ago

As the title suggests, is there any chance that this project could work with PyTorch for AMD GPUs?

matatonic commented 1 month ago

I don't have any way to test with AMD, but I did find this forked repo yesterday and it seems promising, maybe you can let me know if it works: https://github.com/jamfor352/openedai-speech They include the rocm torch and a few other details (devices). No Idea if it works!

Airradda commented 1 month ago

Based on the spike in GPU usage and faster response time, it appears to be properly utilizing my AMD GPU. :+1:

matatonic commented 1 month ago

Thanks for the report! I wasn't able to test it myself.