magenta / ddsp-vst

Realtime DDSP Neural Synthesizer and Effect
Apache License 2.0
714 stars 71 forks source link

Polyphonic Support? [Feature Request] #38

Open acfsas opened 1 year ago

acfsas commented 1 year ago

I play guitar and am interested in using this program, but the main issue I see is the lack of polyphonic support. The only way I try to over come this issue is by installing a hexaphonic pickup and having 6 separate instances of DDSP open, which might tax my current hardware.

Would it be possible to have some sort of frequency filter separating out say a G chord into 6 separate sounds, that I could playback either at once or one-by-one into DDSP, using a similar technique as this paper? https://ieeexplore.ieee.org/document/9768242

Also I'm curious as to why polyphonic might be more of or less of a hassle to attempt with DDSP.

Thanks.