search

christian-byrne / audio-separation-nodes-comfyui

Separate stems (vocals, bass, drums, other) from audio. Recombine, tempo match, slice/crop audio
152 stars 11 forks source link
comfyui comfyui-nodes

readme

worklow picture

https://github.com/user-attachments/assets/c5cf20de-a17f-438d-81ac-0c392af669cf

Examples

Separating Voices in a Video

  Show > [!NOTE] > > In order to load videos into the LoadAudio Node, change [this line](https://github.com/comfyanonymous/ComfyUI/blob/faa57430b0ff882275b1afcf6610e8e9f8a5929b/comfy_extras/nodes_audio.py#L185) in your Comfy install to include the video's extension (e.g., `.mp4`) [workflow.json](./wiki/workflows/isolate-vocals-video.json) https://github.com/user-attachments/assets/c5af418e-7137-4c36-b86e-3352cf558ea8

Replacing BGM with StableAudio-Generated BGM

  Show > [!NOTE] > > In order to load videos into the LoadAudio Node, change [this line](https://github.com/comfyanonymous/ComfyUI/blob/faa57430b0ff882275b1afcf6610e8e9f8a5929b/comfy_extras/nodes_audio.py#L185) in your Comfy install to include the video's extension (e.g., `.mp4`) You can use this to replace copyrighted BGM in a video with new BGM. You can set the denoise low, so that the new BGM is still stimilar to the original. [workflow json](./wiki/workflows/replace-bgm.json) https://github.com/user-attachments/assets/a7d5656b-5f8b-439a-936f-6ebb6a0d538a

Remixing Songs with StableAudio

  Show - [workflow json](./wiki/workflows/remix-songs.json) - [example output (audio file) with embedded workflow](./wiki/examples/ComfyUI_temp_iaepj_00001_.flac) - [example output (audio file) with embedded workflow](./wiki/examples/ComfyUI_00002_.flac)

Separating Song Vocals

  Show [workflow.json](./wiki/workflows/isolate-vocals-song.json) https://github.com/user-attachments/assets/c5cf20de-a17f-438d-81ac-0c392af669cf

Extracting Instrumentals from Songs

  Show - [workflow json](./wiki/workflows/extract-instrumental.json)

 

Requirements

librosa==0.10.2
torchaudio>=2.3.0
numpy
moviepy

Installation

  1. git clone this repository in ComfyUI/custom_nodes folder
  2. cd into the cloned repository
  3. pip install -r requirements.txt