shiranaziz / audio_enhancement_multiple_recordings

4 stars 0 forks source link

[SUGGESTION] Autoalign tracks and phase issues fix #2

Open MarcoRavich opened 2 months ago

MarcoRavich commented 2 months ago

Hi there, given that I honestly don't know if you've already considered these important aspects in your procedure, it would be really useful to integrate it with pre-autoalignment of tracks processed and subsequent correction possible phase issues.

I've collected some useful resources about in the Treatments page for the HyMPS project:

Hope that inspires.

MarcoRavich commented 1 month ago

Bump. As suggested by DNN Auto Align's author in this comment, the most interesting (open source) "AI" approach to get rid of phase issues is implemented in @abargum's Differentiable APFs repository: To overcome these artifacts we propose differentiable signal processing tools and deep optimization structures for automatically tuning all-pass filters to predict the phase response of different VA simulations, and align processed signals that are out of phase. The approaches are assessed using objective metrics while listening tests evaluate their ability to enhance the quality of parallel path processing techniques. Ultimately, an over-parameterized, BiasNet-based, all-pass model is proposed for the optimization problem under consideration, resulting in models that can estimate all-pass filter coefficients to align a dry signal with its affected, wet, equivalent.

Hope that inspires !