OpenNMT / CTranslate

Lightweight C++ translator for OpenNMT Torch models (deprecated)
https://opennmt.net/
MIT License
79 stars 50 forks source link

implement parallel translation #28

Closed jsenellart closed 6 years ago

jsenellart commented 6 years ago

new option parallel running parallel translation at the batch level - can combine with --threads - minimal benchmark show x2.5 speed-up on top of fastest configuration using 4 parallels.