gdalsanto / diff-fdn-colorless

Companion code of DAFx23 "Differentiable Feedback Delay Network for Colorless Reverberation"
http://research.spa.aalto.fi/publications/papers/dafx23-colorless-fdn/
MIT License
37 stars 3 forks source link
feedback-delay-networks optimization room-impulse-response

diff-fdn-colorless

In this work we introduce an optimization framework to tune a set of Feedback Delay Network (FDN) parameters (feedback matrix, input gains, and output gains) to achieve a smoother and less colored reverberation.

This is the companion code to the Feedback Delay Network Optimization paper submitted for EURASIP Journal on Audio, Speech, and Music Processing, special issue on Digital Audio Effects [1].
This is an extension to our previous work, which you can find in the branch dafx23 of this repository and documented in the relative DAFx paper [2].

Main updates from the previous framework:

Getting started

When cloning this repository, make sure to clone all the submodules, namely fdnToolbox and DecayFitNet, by running

git clone --recurse-submodules git@github.com:gdalsanto/diff-fdn-colorless.git

To install the required packages using conda environments open the terminal at the repo directory and run the following command

conda env create -f diff-colorless-fdn-gpu.yml

Alternatively, use the CPU compatible environement diff-colorless-fdn.yml

The optimization is coded in PyTorch. Run the solver.py file to launch training, the delay lines lengths must be given as arguments for the code to run. Check solver.py for the complete list of arguments. The initial and optimized parameters values are saved in output/..

Demo

The MATLAB demo code inference.m shows how to load the optimized FDN parameters on Sebastian Schlecht's fdnToolbox

References

Audio demos are published in: Feedback Delay Network Optimization.
The paper is now on arXiv!

[1] Dal Santo G., Prawda K., Schlecht S. J., and Välimäki V., "Feedback Delay Network Optimization." in EURASIP Journal on Audio, Speech, and Music Processing - sumbitted for reviews on 31.01.2024
[2] Dal Santo G., Prawda K., Schlecht S. J., and Välimäki V., "Differentiable Feedback Delay Network for colorless reverberation." in the 26th International Conference on Digital Audio Effects (DAFx23), Copenhagen, Denmark, Sept. 4-7 2023