Skuldur / Classical-Piano-Composer

MIT License
602 stars 318 forks source link

Do you have any idea about how to handle multiple instrument or orchestration? #23

Closed Pikaurd closed 5 years ago

Pikaurd commented 5 years ago

Hi Skuldur, Thanks for your great job. I want to create a tool that take a melody as input (a piano midi for example) and output with many instrument like symphony. Maybe we can have two midi file, one of single instrument and another have many instrument. Using the first one as input sequence and second one as output sequence. Perhaps like translation?

Do you think that works? Any idea will appreciate. Thank you.

Skuldur commented 5 years ago

Hi Pikaurd,

I would try using a variation of GAN. Where instead of using a randomized vector as the input of the generator the input would be a vector of the melody.

The input the discriminator would be expecting would be a symphony. This is the rough idea I would start working with. This problem is heavily reliant on getting good data that might be hard to find, but let me know how it goes. Hope this helps. :)

Pikaurd commented 5 years ago

Thanks