We provide a PyTorch implementation of the paper Voice Separation with an Unknown Number of Multiple Speakers In which, we present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while maintaining the speaker in each output channel fixed. A different model is trained for every number of possible speakers, and the model with the largest number of speakers is employed to select the actual number of speakers in a given sample. Our method greatly outperforms the current state of the art, which, as we show, is not competitive for more than two speakers.
The code is working well when separating two speakers, but when I increase the number of speakers to 4 ( and I changed swave C=4) .. I got the following error !!
RuntimeError: Caught RuntimeError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/kaggle/working/svoice/svoice/data/data.py", line 65, in getitem
tgt_sig = [self.sets[i][index] for i in range(len(self.sets))]
File "/kaggle/working/svoice/svoice/data/data.py", line 65, in
tgt_sig = [self.sets[i][index] for i in range(len(self.sets))]
File "/kaggle/working/svoice/svoice/data/audio.py", line 78, in getitem
num_frames=num_frames)[0]
File "/opt/conda/lib/python3.7/site-packages/torchaudio/backend/sox_backend.py", line 56, in load
filetype
RuntimeError: Offset past EOF
The code is working well when separating two speakers, but when I increase the number of speakers to 4 ( and I changed swave C=4) .. I got the following error !!
RuntimeError: Caught RuntimeError in DataLoader worker process 0. Original Traceback (most recent call last): File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop data = fetcher.fetch(index) File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch data = [self.dataset[idx] for idx in possibly_batched_index] File "/opt/conda/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/kaggle/working/svoice/svoice/data/data.py", line 65, in getitem
tgt_sig = [self.sets[i][index] for i in range(len(self.sets))]
File "/kaggle/working/svoice/svoice/data/data.py", line 65, in
tgt_sig = [self.sets[i][index] for i in range(len(self.sets))]
File "/kaggle/working/svoice/svoice/data/audio.py", line 78, in getitem
num_frames=num_frames)[0]
File "/opt/conda/lib/python3.7/site-packages/torchaudio/backend/sox_backend.py", line 56, in load
filetype
RuntimeError: Offset past EOF
Any help would be appreciated.