search

magenta / ddsp-vst

Realtime DDSP Neural Synthesizer and Effect
Apache License 2.0
701 stars 67 forks source link

Pitch tracking hiccups #4

Open jesseengel opened 2 years ago

jesseengel commented 2 years ago

The distilled CREPE model we use for pitch tracking is pretty good, but every once and a while it makes a small pitch error "hiccup", usually at the end or beginning of a note. There are several different options to explore for smoothing the pitch output (heuristic filter, low-pass, HMM) each with their own tradeoffs and/or latency.

Turkrosoft commented 8 months ago

Why can't we just disable it altogether, have a portamento parameter with adjustable speed, and allow/disallow or enable/disable certain notes? Manual microtonal adjustments would also be great! You know, a typical violin would already have no frets at all, so chromatic auto-tune doesn't really sound natural. Same for the trumpet. Sorry if some or all of these things I listed already exist, but I can't use the plug-in conveniently with a screen reader so it should also be optimized for use with screen readers.