GlotPress / gp-translation-helpers

GlotPress plugin to add features like discussions
https://glotpress.blog
4 stars 4 forks source link

According to @amieiro OpenAI should use the glossary words provided within the request #199

Open psmits1567 opened 1 year ago

psmits1567 commented 1 year ago

Testing reveals that there are situations where that does not seem to work So it needs further investigation. After advice from Amieiro, I removed some of the glossary words I added into my prompt Result is that the words are not translated according the Dutch glossary Example "Website" should be translated as "site" which does not happen if a combination is formed while translating https://translate.wordpress.org/projects/wp-plugins/squirrly-seo/stable/nl/default/?filters%5Boriginal_id%5D=13174709 Translation from OpenAI Voeg je websitepictogram toe aan de browsertabs en op andere apparaten zoals iPhone, iPad en Android-telefoons. My prompt I tested it with . I want you to evaluate these instructions every time I provide you input. . Please make sure to remove any instances of "Please",and "Sorry" and avoid using formal words such as "alsjeblieft" and "alstublieft". . Do not capitalize the words except the start of the sentence. . Maintain placeholders like "%s", "%d", "tabs" and "%1$s on their respective places. . Do not combine the following words with other words when translating: "brand", "link", "Icon". . I want you to check if the text I provide you ends with a period before translation, if that is not the case than do not add a period to the translation. . Translate the following text into neutral Dutch without using formal language or politeness, without adding a period, point, dot, full stop, or extra text. I want you to remove punctuation, periods, dots or full stop at the end of the text before providing the translation.

Translation with ChatGPT where no glossary is used Voeg je website-icoon toe in de browser-tabbladen en op andere apparaten zoals iPhone, iPad en Android-telefoons. So here the word "icon" is not translated into our glossary value! That implicates that when OpenAI forms combined words, it ignores the glossary value for the first word "website" If you give this instruction to OpenAI: "Do not combine the word 'website' with any other words." the translation does use the glossary for "website" I also noticed that if "website" is in the second sentence, it is not translated according our glossary

psmits1567 commented 7 months ago

Part of those problems cannot be resolved by GlotPress, as currently GPT3 model is used. That model does not always use the keywords provided. Even if you clearly instruct to use "site" instead of "website", it does not work in longer texts