search

YuantongL / YToke

Mac Karaoke app, open source, free, based on Youtube videos.
https://ytoke.app
GNU General Public License v3.0
18 stars 1 forks source link

Investigate human voice removal from MV videos. #5

Open YuantongL opened 4 years ago

YuantongL commented 4 years ago

Investigate the feasibility of removing human voice from either video stream or downloaded video.

YuantongL commented 4 years ago

Tested this awesome repository https://github.com/tsurumeso/vocal-remover in python, it works great. Needs to figure out a way to integrate to our project.

YuantongL commented 4 years ago

After a few days investigation, both Vocal-remover on pytorch and Spleeter on TensorFlow works well. But it is a pain to integrate it with macOS app. Feels like 2 steps is needed

  1. Make a library that can split a piece of audio (I'm going to open up a new project to experiment this, possibly open up a new repo)
  2. Figure out how to download Youtube video and apply the outcome of step 1

One other approach is to embed python in Xcode project as static library, and ship the whole thing. Downside is it is huge (a few hundred MBs), seems not acceptable.