FunAudioLLM / CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
https://funaudiollm.github.io/
Apache License 2.0
5.42k stars 557 forks source link

Execute CosyVoice on the local deployment following the step-by-step instructions in ReadMe.md. Cosyvoice fails to start. #86

Closed zhanbei1 closed 2 months ago

zhanbei1 commented 3 months ago

Describe the bug Follow the instructions in README.md step by step, deploy on a personal server, execute python3 webui.py --port 50000 --model_dir speech_tts/CosyVoice-300M Unable to start, error reported.

After executing the startup command, all the logs are as follows (this is all the logs) : ` 2024-07-10 15:46:16, 963-modelscope-INFO-PyTorch version 2.0.1+cu118 Found. The 15:46:16 2024-07-10, 964 - modelscope - INFO - Loading ast index from/root/cache/modelscope/ast_indexer

2024-07-10 15:46:17, 372-modelscope-INFO-Loading done! Current index file version is 1.15.0, with md5 9f4fb120384b6702f0cca427af528ecb and a total number of 980 components indexed / root/miniconda3 / envs/cosyvoice/lib/python3.8 / site - packages/torch / _jit_internal. Py: 726: FutureWarning: ignore(True) has been deprecated. TorchScript will now drop the function call on compilation. Use torch.jit.unused now. {} warnings.warn( Killed `

Expected behavior I want to deploy CosyVoice on my personal server and run it successfully.

Screenshots

 Screenshot 2024-07-10 15 52 23 截屏2024-07-10 15 57 47

Desktop (please complete the following information):

Additional context The first time it starts, an error is reported saying that a Tensorflow is missing. I installed it. After many times to start, will report the error, has been unable to start. I don't have enough resources? Or is there something else that doesn't operate? If resources are not enough, how do I add resources

younger027 commented 3 months ago

你这个应该是内存爆了吧,被系统kill了

zhanbei1 commented 3 months ago

你这个应该是内存爆了吧,被系统kill了

运行这个服务,最少的资源是多少??

aluminumbox commented 3 months ago

你这个应该是内存爆了吧,被系统kill了

运行这个服务,最少的资源是多少??

at least 16g memory

zhanbei1 commented 2 months ago

你这个应该是内存爆了吧,被系统kill了

运行这个服务,最少的资源是多少??

at least 16g memory

OK,感谢评论,这个Issue我将会关闭

wen0320 commented 1 month ago

如果说,我是说如果哈,我没有16G的GPU内存设备。我应该怎么优化呢?目前尝试了在代码中添加 torch.cuda.empty_cache() 也没有多大作用,还是会被kill掉