Request to support suno-ai/bark model

xenova / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

https://huggingface.co/docs/transformers.js

Apache License 2.0

9.71k stars 571 forks source link

Request to support suno-ai/bark model #767

Open ttys026 opened 1 month ago

ttys026 commented 1 month ago

Model description

model github model huggingface

Prerequisites

[X] The model is supported in Transformers (i.e., listed here)
[ ] The model can be exported to ONNX with Optimum (i.e., listed here)

Additional information

Sorry I am pretty new to this field, I am not sure if this model is supported to be exported as ONNX format. This model generate highly realistic speech, and has great multilingual ability.

Your contribution

...

flatsiedatsie commented 1 month ago

Is this the model that can generate sounds / sound effects? If so, I'd dig support for it too, as a companion to Musicgen.

xenova commented 1 month ago

I opened a feature request to Optimum quite some time ago: https://github.com/huggingface/optimum/issues/1214. Adding support there is a prerequisite for Transformers.js support :)

flatsiedatsie commented 1 week ago

It seems Stable AI has also released a new sound effects model a few weeks ago: https://huggingface.co/stabilityai/stable-audio-open-1.0