tensorflow / nmt

TensorFlow Neural Machine Translation Tutorial
Apache License 2.0
6.37k stars 1.96k forks source link

After 194K training steps the French to English translation is not improving #328

Open frajos100 opened 6 years ago

frajos100 commented 6 years ago

After 194k training steps the French to English translation is not improving. Is there any setting that needs to be done for better translation output?

French : Marie détestait habituellement lundi matin, mais cette année était différente. Thomas était dans sa classe d'art et elle aimait Thomas. Elle a attendu à l'extérieur de la classe quand son amie Camille est arrivée. Translation should be: Marie usually hated Monday morning, but this year was different. Thomas was in her art class and she liked Thomas. She waited outside the classroom when her friend Camille arrived. NMT translation: @96k steps: Marie usually on Monday , but this year was Thomas was in her middle-class class and she she waited for the class when his was released . @166k steps: Marie , but this year was Thomas was in his favorite class and she she waited at of the class when her was .

hackerwei commented 6 years ago

@frajos100 how to prepare the French -English train set? I do not find any script to preprocess French-English.

frajos100 commented 6 years ago

You would need to modify the German-English script to download the files for the French to English repository.

hpulfc commented 6 years ago

make sure that the corpus is cleaning. also, you can consider that use coverage. Unfortunately , it hard to implement it !!!

luozhouyang commented 6 years ago

You can try to use a different learning rate decay strategy.