Add transformers hub usage mbd

facebookresearch / audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

MIT License

20.59k stars 2.09k forks source link

Add transformers hub usage mbd #202

Closed ylacombe closed 1 year ago

ylacombe commented 1 year ago

In order to democratize usage and facilitate access to MBD models, I've added the MultiBand Diffusion weights to an HF hub repo here: facebook/multiband-diffusion.

This PR thus aims to facilitate access to these weights by slightly changing the loading mechanism of these MBD diffusion weights, similarly to what has been done for Encodec.

Many thanks for the great work behind audiocraft! I would be happy to get feedback on this PR!

adefossez commented 1 year ago

@ylacombe thanks for the PR, can you please pull from main and merge ? due to the bug in Transformers that was requiring protobuf be installed this PR is currently failing the CI.