search

tensorflow / nmt

TensorFlow Neural Machine Translation Tutorial
Apache License 2.0
6.35k stars 1.96k forks source link

About shuffle operation #408

Open yapingzhao opened 5 years ago

yapingzhao commented 5 years ago

Hi, I have a question: does the tensorflow / NMT model shuffle after each epoch when training the translation model?Also, how do we perform shuffle operations?

Looking forward to your advice or answers. Best regards, Thank you very much!

ranjita-naik commented 5 years ago

yes, it does shuffle each time it's iterated over. line # 114 in https://github.com/tensorflow/nmt/blob/master/nmt/utils/iterator_utils.py

yapingzhao commented 5 years ago

@ranjita-naik Thank you very much!

yapingzhao commented 5 years ago

Hi,I have a question: Can the encoder be processed in different formats with the decoder? The encoder uses BPE and the decoder uses character processing. Looking forward to your advice or answers. Thank you very much.