search

ssut / py-googletrans

(unofficial) Googletrans: Free and Unlimited Google translate API for Python. Translates totally free of charge.
http://py-googletrans.rtfd.io
MIT License
3.89k stars 717 forks source link

Worse performance than Google Translation API or translate.google.com #333

Closed salvacarrion closed 2 years ago

salvacarrion commented 2 years ago

I have computed the BLEU score for several test sets obtaining a significantly worse performance (-12.52pts BLEU) than the ones obtained by using the official Google Translation API, or by translating a document (Word and Excel) directly with the website.

Method BLEU
API (official) 42.4157
API (unofficial) 29.8926
Web (Word - break lines) 42.2661
Web (Word - bullets) 42.2661
Web (Excel) 42.2065

This data corresponds to the Multi30k/2016 (en-de) testset, downloaded with sacrebleu (no further preprocessing was done). From english to german. sacrebleu -t multi30k/2016 -l en-de --echo src > multi30k_2016-src.txt sacrebleu -t multi30k/2016 -l en-de --echo ref > multi30k_2016-ref.txt

Others:

Links: https://translate.google.com/ https://github.com/googleapis/python-translate

leifadev commented 2 years ago

Thanks for sharing! I am going to scrape the google translate webpage with lxml :p

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.