Evaluate against DeepL

[caugner]

It would be nice to compare the quality of the translations against DeepL Translator, which is very well received:

(Wikipedia:) Reception of DeepL Translator in 2017 has been generally positive, with TechCrunch appreciating it for the accuracy of its translations, stating that it was more accurate and nuanced than Google Translate,[6] and Le Monde thanking its developers for translating French text into more 'French-sounding' expressions.

• Access: You can sign-up for DeepL Pro here: https://www.deepl.com/pro#developer
• Pricing: API access is free up to 500,000 characters per month, and €4.99/month + 20€/1M characters otherwise.
• Docs: API is simple and documented here: https://www.deepl.com/docs-api/translating-text/request/
• Usage: You can translate multiple texts (up to 50 if I remember correctly) in a single request:

  curl https://api.deepl.com/v2/translate \
  -d auth_key=your_auth_key \
  -d "text=This is the first sentence."  \
  -d "text=This is the second sentence."  \
  -d "text=This is the third sentence."  \
  -d "source_lang=EN-US"
  -d "target_lang=DE"

Note that the DeepL API has two particularities:

• The language identifiers are all UPPERCASE.
• The API only supports multiple text parameters, not text[].

[Lightningblade]

https://www.top500.org/news/startup-launches-language-translator-that-taps-into-five-petaflop-supercomputer/ states "(...)DeepL achieved a BLEU score of 31.1 using those same texts."