Magnet xformers 0.0.22 compatibility fix

facebookresearch / audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

MIT License

20.17k stars 2.01k forks source link

Magnet xformers 0.0.22 compatibility fix #394

Closed lonzi closed 5 months ago

lonzi commented 5 months ago

MAGNeT - Fix for xformers 0.0.22 compatibility, thanks to @nateraw catch.

Inference was already tested
Testing now training as well

In addition, the following smaller fixes are also contained in this PR:

MAGNeT notebook - change to stride1 span arrangement by default which works better than the nonoverlap reported in the paper
MAGNeT doc fix of a typo
MAGNeT music training grid typo fix

nateraw commented 5 months ago

Can confirm this resolves #390 :) thanks!!

lonzi commented 5 months ago

Validated also that training functions correctly. Generation results after 25 epochs sound totally sane. Ready for merge.