We provide a PyTorch implementation of the paper Voice Separation with an Unknown Number of Multiple Speakers In which, we present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while maintaining the speaker in each output channel fixed. A different model is trained for every number of possible speakers, and the model with the largest number of speakers is employed to select the actual number of speakers in a given sample. Our method greatly outperforms the current state of the art, which, as we show, is not competitive for more than two speakers.
When I run this command: python train.py dset=librimix lr=0.001 swave.R=8, an error occurred,like this :Traceback (most recent call last):
File "train.py", line 126, in
main()
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/main.py", line 37, in decorated_main
strict=strict,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 347, in _run_hydra
lambda: hydra.run(
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 201, in run_and_report
raise ex
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 198, in run_and_report
return func()
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 350, in
overrides=args.overrides,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/hydra.py", line 104, in run
run_mode=RunMode.RUN,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/hydra.py", line 512, in compose_config
from_shell=from_shell,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 156, in load_configuration
from_shell=from_shell,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 262, in _load_configuration
run_mode=run_mode,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 805, in _merge_defaults_into_config
hydra_cfg = merge_defaults_list_into_config(hydra_cfg, user_list)
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 783, in merge_defaults_list_into_config
package_override=default1.package,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 715, in _merge_config
raise MissingConfigException(msg, new_cfg, options)
hydra.errors.MissingConfigException: Could not load dset/librimix.
Available options:
debug
When I run this command: python train.py dset=librimix lr=0.001 swave.R=8, an error occurred,like this :Traceback (most recent call last): File "train.py", line 126, in
main()
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/main.py", line 37, in decorated_main
strict=strict,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 347, in _run_hydra
lambda: hydra.run(
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 201, in run_and_report
raise ex
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 198, in run_and_report
return func()
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/utils.py", line 350, in
overrides=args.overrides,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/hydra.py", line 104, in run
run_mode=RunMode.RUN,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/hydra.py", line 512, in compose_config
from_shell=from_shell,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 156, in load_configuration
from_shell=from_shell,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 262, in _load_configuration
run_mode=run_mode,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 805, in _merge_defaults_into_config
hydra_cfg = merge_defaults_list_into_config(hydra_cfg, user_list)
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 783, in merge_defaults_list_into_config
package_override=default1.package,
File "/home/zhang/anaconda3/envs/svoice/lib/python3.7/site-packages/hydra/_internal/config_loader_impl.py", line 715, in _merge_config
raise MissingConfigException(msg, new_cfg, options)
hydra.errors.MissingConfigException: Could not load dset/librimix.
Available options:
debug
Did I not install the dataset of librimix?