search

facebookresearch / denoiser

Real Time Speech Enhancement in the Waveform Domain (Interspeech 2020)We provide a PyTorch implementation of the paper Real Time Speech Enhancement in the Waveform Domain. In which, we present a causal speech enhancement model working on the raw waveform that runs in real-time on a laptop CPU. The proposed model is based on an encoder-decoder architecture with skip-connections. It is optimized on both time and frequency domains, using multiple loss functions. Empirical evidence shows that it is capable of removing various kinds of background noise including stationary and non-stationary noises, as well as room reverb. Additionally, we suggest a set of data augmentation techniques applied directly on the raw waveform which further improve model performance and its generalization abilities.
Other
1.62k stars 299 forks source link

How to achieve audio split frame and window in the code? #116

Open Yaho-b opened 2 years ago

Yaho-b commented 2 years ago

Hi,thanks for the great job! I have some question，Can u tell me about audio split frame and window in the code?if I want to achieve it in my PC，How to do? Looking forward your answer.

adefossez commented 2 years ago

I am not sure what is your question exactly. what do you call split frame and window ? do you just want to run the denoiser ?

Yaho-b commented 2 years ago

Sorry, I want to know is the test wav being split frame befor it goes on the demucs network?I cannot find the code about split frame. If it is a microphone typing a long sentence, it should be split?

adefossez commented 2 years ago

you can use the --streaming option if you want to separate a long file with denoiser.enhance. For programmatic use, you can use DemucsStreamer: https://github.com/facebookresearch/denoiser/blob/main/denoiser/live.py#L87