search

suno-ai / bark

🔊 Text-Prompted Generative Audio Model
MIT License
36.19k stars 4.26k forks source link

Torch 2.5.0 very low performance #609

Open rsxdalv opened 4 weeks ago

rsxdalv commented 4 weeks ago

I believe the last working version was 2.4.1

with 2.5.0 I am seeing 10x slowdown and low GPU usage:

Bark(
    _type='bark',
    seed='2493791119',
    text='test',
    burn_in_prompt='',
    text_temp=0.7,
    waveform_temp=0.7,
    max_length=15,
    history_prompt='voices\\Alice.npz',
    history_prompt_semantic='voices\\Alice.npz',
    long_prompt_radio='Short prompt (<15s)',
    long_prompt_history_radio='Use old generation as history',
    outputs=dict
)
C:\Users\admin\Desktop\one-click-installers-tts-main\tts-generation-webui\installer_files\env\lib\site-packages\bark\generation.py:175: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` 
instead.
  with InferenceContext(), torch.inference_mode(), torch.no_grad(), autocast():
100%|█████████████████████████████████████████████████████████████████████████████████████| 149/149 [01:52<00:00,  1.33it/s] 
 25%|██████████████████████▎                                                                  | 2/8 [01:32<04:38, 46.37s/it]

image