coqui-ai / TTS

πŸΈπŸ’¬ - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
http://coqui.ai
Mozilla Public License 2.0
35.84k stars 4.38k forks source link

[Feature request] faster load at startup #3841

Open kalle07 opened 4 months ago

kalle07 commented 4 months ago

πŸš€ Feature Description faster laod at startup 12sec and i use an NVSSD with 2GB/sec

Solution leave unnessesary compling , checking, hash generation, save for next session ?!?

Additional context Not sure to be honest, take a look through the xtts loader and all its imports: https://github.com/coqui-ai/TTS/blob/dev/TTS/tts/models/xtts.py

and the config loader and all its imports: https://github.com/coqui-ai/TTS/blob/dev/TTS/tts/configs/xtts_config.py

To get to exactly whats going on. Obviously there is interactions with Huggingface transformers too, so not sure what specifically where the pre-calcuations come in e.g. it may be specifically in the calls made within huggingface transformers, which would require hugggingface to look at that, however, I

stale[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.