search

MusicLang / musiclang_predict

AI Prediction api of the MusicLang package
GNU General Public License v3.0
250 stars 16 forks source link

Flash Forward - Live Jamming #21

Open fire17 opened 3 months ago

fire17 commented 3 months ago

Flash forward a few months from now, you can stream this in realtime, analyze and sync with microphone, ai jam along to us playing live music.

Please let me know of your estimation for when we could expect something like this, from this project it looks like only a couple steps away.. I cant wait !

Thanks and all the best! Amazing project

Ps - on the practical side, to achieve this, you would need to listen to the mic and optionally other live midi inputs, auto determine the musical parameters, generate a bar , wait for and sync with the beat, continue listening, continue generating the next bar with respect to ongoing music, listen for key /chord changes , harmonize existing patterns, and motifs, predict drops/suspense/scilence (can also be clued in with dedicated signs from a human player) and play along live midi. Essentially creating an ai live-band

mehdizatar commented 3 months ago

Hi @fire17 ,

Thanks for the suggestion! We unfortunately don’t have any milestone for such a feature as of now. This is a use case that we have in mind indeed, yet (very) ambitious :slightly_smiling_face:

fire17 commented 3 months ago

Thanks! @mehdizatar Happy to hear you have it in mind

Though it will take effort, I think on your end is to mostly to optimize the core and make the realtime generation/streaming possible, from there I think the community, myself included, will contribute the rest :)

All the best!