Open OnlineDynamic opened 1 year ago
@OnlineDynamic Integrating spleeter into xLights has been proposed. See issue #2715.
+1 Spleeter integration would be friggin' awesome! But there are many different websites and software packages that will generate stems, including doing it manually in Audacity or other audio editor. Some sites/programs do better/worse than others depending on the style of music. So ability to have multiple audio tracks will still be handy (even with Spleeter integration). Would also be nice to use the VU meter effect or other audio-effect modifier to render with one of the stems/spleets instead of the main track (example: bass or piano track). Would also be nice to have integrated way to run the Vamp plugins on the stems. Much of this can already be done manually, but boy is it cumbersome.
To aid with sequencing to music...
It would be really cool if in addition to the main audio track which is used as the final output to accompany a sequence if you were able to have multiple sync'd audio tracks to aid in the generation of timing tracks.
AI tools like https://moises.ai/ have some great functionality to be able to seperate individual instruments and voices from an original song and output them as different mp3 files.
If xlights were able to have each of the mp3's loaded into the timelines and be able to use the music plugins to analyse just the 'drums' or guitar or piano track for example I think it could be a game changer in helping sequence to music. Even just being able to playback one of these construction audio files whilst finger tapping timing would be really helpful.