search

jayparks / tf-seq2seq

Sequence to sequence learning using TensorFlow.
392 stars 109 forks source link

BPE and validation data #18

Open ghost opened 6 years ago

ghost commented 6 years ago

Can you clarify a bit on how you are taking the validation data and why bpe is used in such cases ?

tf.app.flags.DEFINE_string('source_valid_data', 'data/newstest2012.bpe.de', 'Path to source validation data') tf.app.flags.DEFINE_string('target_valid_data', 'data/newstest2012.bpe.fr', 'Path to target validation data')