fakufaku / fast_bss_eval

A fast implementation of bss_eval metrics for blind source separation
https://fast-bss-eval.readthedocs.io/en/latest/
MIT License
126 stars 8 forks source link

Application Extension: How to use this metric in Short-Time Fourier Transform (STFT) domain? #12

Open litianyu93 opened 2 years ago

litianyu93 commented 2 years ago

Lots of BSS work make efforts to find coefficients in Short-Time Fourier Transform (STFT) domain, and multiply them with signal in the same domain. I think that this metric is evaluated in time domain, and wondering how can use it directly in STFT domain (maybe need to find out the frequency mapping of distortion filter?). If it worked, this metric can be directly extend to these neural network in STFT domain? Thank for your brilliant creative work!

fakufaku commented 2 years ago

This metric is actually also used to train systems working in the STFT domain. The signals are first brought back to time-domain by doing iSTFT. This is not really an issue. Now, my experience (which is similar to what is found in the literature), is that the time-domain metric gives better performance than those applied in the STFT domain directly.