i have no idea how to use Koila in my code

[saleham5]

Hey, I use Coqui-ai TTS through a simple Python code.

from TTS.api import TTS

tts = TTS(model_name="MODEL NAME",
          progress_bar=True,
          gpu=True)

tts.tts_to_file(text="TEXT", file_path='Audio.wav')

but I always get CUDA out of memory. and I'm not really sure how to use Koila with my code or Coqui-ai tts in general. any help?

[rentruewang]

Hi, thanks for taking time to ask this!

Koila is used for when you are directly interacting with PyTorch tensors, since TTS is a higher abstraction above, unfortunately, it's impossible to use Koila here.

If I may make a suggestion, although I don't personally use TTS library, it seems like you are doing only inference here. Inference is pretty cheap so doing it on CPU wouldn't be a problem (you basically only needs GPU when training). Hope that helps!

[saleham5]

Thank you so much for the fast reply. And I didn't know that, I might actually go full CPU and see what will happen. Thank you again you are an amazing Dev

[rentruewang]

You're welcome :)