search

matatonic / openedai-speech

An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
GNU Affero General Public License v3.0
317 stars 44 forks source link

CPU support for Coqui.ai #47

Closed nkeilar closed 3 weeks ago

nkeilar commented 1 month ago

I noted that CPU only support seems possible:

https://docs.coqui.ai/en/latest/docker_images.html

Is there any technical reason we could not utilize this, even if slower, on CPU?

matatonic commented 1 month ago

Not at all, you certainly can. Use --xtts_device cpu if you want to force loading xtts onto CPU. If you don't have a GPU, this should happen automatically.

matatonic commented 1 month ago

If using the docker, just set this in your speech.env:

EXTRA_ARGS=--xtts_device cpu