We provide a PyTorch implementation of the paper Voice Separation with an Unknown Number of Multiple Speakers In which, we present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while maintaining the speaker in each output channel fixed. A different model is trained for every number of possible speakers, and the model with the largest number of speakers is employed to select the actual number of speakers in a given sample. Our method greatly outperforms the current state of the art, which, as we show, is not competitive for more than two speakers.
Hello,
can you please guide me on how to add data in the mix directory for more than 2 speakers like 3 or 4 speakers overlapped audio with different overlapped ratios (like 50 or 80 or 100)
I can see a pattern in the given data which is file_name.wav in the mix then this s1 and s2 both have the same file_name but what if I want to create more than one mix file like 50% overlapped or 100 % overlapped then how I can do it
Hello, can you please guide me on how to add data in the mix directory for more than 2 speakers like 3 or 4 speakers overlapped audio with different overlapped ratios (like 50 or 80 or 100) I can see a pattern in the given data which is file_name.wav in the mix then this s1 and s2 both have the same file_name but what if I want to create more than one mix file like 50% overlapped or 100 % overlapped then how I can do it