Fast API on CPU + MPS GPU

neonbjb / tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

Apache License 2.0

12.84k stars 1.78k forks source link

Fast API on CPU + MPS GPU #658

Open fakerybakery opened 10 months ago

fakerybakery commented 10 months ago

Hi @manmay-nakhashi, are you planning to support the fast API work on CPU + MPS GPU? Thanks!

fakerybakery commented 10 months ago

Just realized this can't work on MPS since the fast API requires autocast and autocast isn't yet supported on MPS. I guess we'll have to wait for that to get merged before the fast API will work