Performance improvements for webserver

Helsinki-NLP / Opus-MT

Open neural machine translation models and web services

MIT License

592 stars 71 forks source link

Closed santhoshtr closed 4 years ago

santhoshtr commented 4 years ago

marian-server accepts a set of sentences delimited by \n at once and returns the result in same fashion. This is faster than we sending each sentence one by one. So, remove the for loop and just sent everything together.
Use batch translation with marian-server