xLightsSequencer / xLights

xLights is a sequencer for Lights. xLights has usb and E1.31 drivers. You can create sequences in this object oriented program. You can create playlists, schedule them, test your hardware, convert between different sequencers.
GNU General Public License v3.0
539 stars 200 forks source link

Mutliple Audio Tracks #3620

Open OnlineDynamic opened 1 year ago

OnlineDynamic commented 1 year ago

To aid with sequencing to music...

It would be really cool if in addition to the main audio track which is used as the final output to accompany a sequence if you were able to have multiple sync'd audio tracks to aid in the generation of timing tracks.

AI tools like https://moises.ai/ have some great functionality to be able to seperate individual instruments and voices from an original song and output them as different mp3 files.

If xlights were able to have each of the mp3's loaded into the timelines and be able to use the music plugins to analyse just the 'drums' or guitar or piano track for example I think it could be a game changer in helping sequence to music. Even just being able to playback one of these construction audio files whilst finger tapping timing would be really helpful.

sslupsky commented 1 year ago

@OnlineDynamic Integrating spleeter into xLights has been proposed. See issue #2715.

DoctorWiz commented 1 year ago

+1 Spleeter integration would be friggin' awesome! But there are many different websites and software packages that will generate stems, including doing it manually in Audacity or other audio editor. Some sites/programs do better/worse than others depending on the style of music. So ability to have multiple audio tracks will still be handy (even with Spleeter integration). Would also be nice to use the VU meter effect or other audio-effect modifier to render with one of the stems/spleets instead of the main track (example: bass or piano track). Would also be nice to have integrated way to run the Vamp plugins on the stems. Much of this can already be done manually, but boy is it cumbersome.