[QUESTION] How Bark is being trained?

gitmylo / audio-webui

A webui for different audio related Neural Networks

MIT License

1.01k stars 94 forks source link

[QUESTION] How Bark is being trained? #76

Closed alexander-rakhlin closed 1 year ago

alexander-rakhlin commented 1 year ago

Is there general understanding how to train Bark itself?

gitmylo commented 1 year ago

Not in audio-webui.

I believe https://github.com/serp-ai/bark-with-voice-clone recently implemented fine-tuning of bark based on HuBERT quantizer tokens.

This has not been implemented into audio-webui, as i haven't heard such great outputs as i was hoping for yet, and i'm working on something else to add, which might sound better.