Open thpun opened 4 years ago
cc @tangyuq
Does translation_multi_simple_epoch
support sampling method other than temperature sampling at this moment?
translation_multi_simple_epoch only supports "temperature" sampling right now.
Is there any plan to support the rest of the options in --sampling-method
, i.e. uniform
, Concat
& RoundRobin
in near future?
🐛 Bug
To Reproduce
Steps to reproduce the behavior:
translation_multi_simple_epoch
task) with RoundRobin as sampling methodThe training starts smoothly if using temperature sampling, but it failed if using RoundRobin.
-- Process 3 terminated with the following error: Traceback (most recent call last): File "/opt/conda/lib/python3.6/site-packages/torch/multiprocessing/spawn.py", line 20, in _wrap fn(i, *args) File "/workspace/fairseq/fairseq/distributed_utils.py", line 156, in distributed_main main(args, kwargs) File "/workspace/fairseq/fairseq_cli/train.py", line 106, in main extra_state, epoch_itr = checkpoint_utils.load_checkpoint(args, trainer) File "/workspace/fairseq/fairseq/checkpoint_utils.py", line 188, in load_checkpoint epoch=1, load_dataset=True, passthrough_args File "/workspace/fairseq/fairseq/trainer.py", line 350, in get_train_iterator epoch=epoch File "/workspace/fairseq/fairseq/tasks/translation_multi_simple_epoch.py", line 303, in get_batch_iterator seed=seed, num_shards=num_shards, shard_id=shard_id, num_workers=num_workers, epoch=epoch, File "/workspace/fairseq/fairseq/tasks/fairseq_task.py", line 184, in get_batch_iterator required_batch_size_multiple=required_batch_size_multiple, TypeError: 'bool' object is not callable