GrandaddyShmax / audiocraft_plus

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
MIT License
521 stars 60 forks source link

Is melody conditioning supported ? #18

Open timtensor opened 1 year ago

timtensor commented 1 year ago

Hi , I am trying to run the colab notebook and i got a bit confused by the webui . Is melody conditioning not supported ? Like melofy +text ?

Also , is there a guide or preferred way of writing good prompts ( like a prompt guide ) . Perhaps it is specific for text2audio , melody conditioning ? (Different prompts for different task)

Info on this could be helpful

GrandaddyShmax commented 1 year ago
  1. Yep there is, it is in the Audio Tab, You will see there an area to input audio and a selection of input mode on the left side between sample and melody. Also there is an entire explanation for everything in the wiki tab.

  2. There isn't any definitive way to write them but I guess i can create few example ones that worked for me and add it to the colab in some additional tab

Fronscavenger commented 11 months ago

Also, for me... Melody even downloads. If you update this let me know :)