add warm-up method for inference engines

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

https://opennmt.net/

MIT License

6.73k stars 2.25k forks source link

Closed l-k-11235 closed 5 months ago

l-k-11235 commented 6 months ago

It is useful to reset the translator when running multiple inferences (when several prompts are used successively for instance).