[ONNX export] Bark for realistic text-to-speech generation

huggingface / optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

https://huggingface.co/docs/optimum/main/

Apache License 2.0

2.5k stars 447 forks source link

Open xenova opened 1 year ago

xenova commented 1 year ago

Bark was recently added to 🤗 Transformers (model doc) and it would be great to be able to export those models to ONNX with Optimum.

This will allow me to support high-quality TTS models in Transformers.js

I will integrate into transformers.js once available in optimum.

snowyu commented 1 year ago

@xenova The PR #1199 has been merged. Maybe this is what you want.

fxmarty commented 1 year ago

Hi @snowyu, @xenova relies on the ONNX export for transformers.js so it is still to be done!

rakirs3333 commented 4 months ago

Is the Bark text to speech available in onnx format?

MithrilMan commented 4 months ago

I'm interested too

JE4GLE commented 2 months ago

What can we do to help with this issue? I'd be really interested in transformers.js supporting Bark!