facebookresearch / audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
MIT License
20.86k stars 2.13k forks source link

KV Cache? #195

Open wilson97 opened 1 year ago

wilson97 commented 1 year ago

Awesome repo, thanks for opensourcing it.

I was looking in transformer.py and I don't see kv-cache implemented. It should speed up inference by quite a bit. I'm wondering if you guys are planning to do this.

Thanks.