facebookresearch / demucs

Code for the paper Hybrid Spectrogram and Waveform Source Separation
MIT License
8.38k stars 1.07k forks source link

【Help】high-frequency noise #579

Open jackguo6 opened 11 months ago

jackguo6 commented 11 months ago

❓ Questions

The model we trained ourselves has high-frequency noise in the audio data of the tracks, each track of data has similar noise. Adding additional data makes it more obvious.Any useful suggestions?

20231222-140620 20231222-140522

jarredou commented 11 months ago

It looks a bit like dithering noise.

jackguo6 commented 11 months ago

It looks a bit like dithering noise.

We still don't know how it came about,any suggestions?

jarredou commented 11 months ago

I've checked on my side, and it's not dithering, it's noise created by demucs during training, but maybe that seems to disappear when model is trained enough (as baseline models don't have that noise ?)

Here's a spectrogram with that obvious "synthetic" high freq noise with a model trained only with a few epochs: demucs noise

btw, this repo is inactive as Demucs developpement was stopped and as A. Defossez has left Meta, the new demucs main repo is (for major bug reporting) : https://github.com/adefossez/demucs