search

Keytoyze / Mug-Diffusion

High-quality and controllable charting AI for rhythm games, modifed from stable diffusion
MIT License
186 stars 14 forks source link

Setting Weights for Different Instruments in Music #10

Open Jqliany opened 1 year ago

Jqliany commented 1 year ago

I am not a programmer. I have just learned some Python and I'm not able to contribute to the project's development yet. However, as a rhythm game enthusiast, I believe accuracy is crucial in AI-generated music game charts. It would be great to have the ability to adjust the emphasis of different instruments at specific rhythmic points. For example, utilizing Demucs to separate audio and set weights for each instrument, allowing for the generation of charts that lean more towards vocals or drums. This would be highly beneficial for creating game charts for different types of music.

Keytoyze commented 1 year ago

I think it's a good proposal. Maybe it can be achieved without retraining the model, just use Demucs to seperate and use this tool to create charts for the seperated audio manually.