During GNMT 8LSTM training, can we train on full paragraphs, or must we break it to sentences?

[ndvbd]

During GNMT 8LSTM training, can we train on full paragraphs (from source language to target language), or must we break it to sentences?

Can the model be trained well to cope will full paragraphs?

[lmthang]

In our experiments, we can train on longer sequences, e.g., lengths 200-400 (though depending on your model sizes, you might run out of memory). Training on long sequences will also take longer time. Running experiments is the best way to answer your question :)

[ndvbd]

Thanks. I found it beneficial to train on around 3 sentences, in order to provide some beyond-sentence context to the model.

[lmthang]

Thanks for the info! Closing this for now.