search

mozilla / translate

Translations website utilizing Bergamot proceedings
https://mozilla.github.io/translate
Mozilla Public License 2.0
61 stars 15 forks source link

Punctuation marks influence translation results. #9

Open acornestean opened 3 years ago

acornestean commented 3 years ago

[Affected versions]: Firefox Nightly (94.0a1/20210920212918)

[Affected Platforms]: Windows 10 x64

[Prerequisites]: Access https://mozilla.github.io/translate/.

[Steps to reproduce]:

  1. Translate a short text from EN to RU. For example (please don’t mind the stupid example): “I went to school to learn English, German and math. I love school. I love apples too. Apples have vitamin C.”
  2. Delete the full stop at the end of the “Apples have vitamin C.” sentence.
  3. Notice some words change in the translation results.

[Expected]: Punctuation marks should not change the translation results as no modifications have been brought to the actual wording of the text.

[Actual]: Punctuation marks can change the translation results.

https://user-images.githubusercontent.com/50236075/134163715-eb6a1a11-1895-4394-88bd-aba859cde490.mp4

kpu commented 3 years ago

This is expected Punctuation can and does change the meaning of text doesnt it Youll also find that even translating on a different machine produces slightly different output The score of nbest sentences is very close and slight changes can completely change the output all we aim for is that the quality of the translation is high which it isnt for the current ru model