search

jerivl / Deepcut

A robot that raps
Apache License 2.0
1 stars 1 forks source link

MIDI Rhythm Input #9

Open jerivl opened 3 years ago

jerivl commented 3 years ago

Issue: Our current design only has a fixed rhythm (evenly spaced notes)

Solution: This can be remedied by using MIDI to control timings.

Desired Input: MIDI Input (.mid), Syllable Audio, Tempo?

Desired Output: Syllables Alligned to rhythm specified in MIDI file

Notes: This builds on the quantization functionality of the speech-to-rap conversion. Requires isolated syllables: See https://github.com/jluckenbaugh2/Deepcut/issues/5

jerivl commented 3 years ago

2 Steps required for this task: 1) Extract rhythm from file (only one channel needed for this) 2) Use tempo and rhythm to put syllables at the intended start time of each note