search

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch
https://opennmt.net/
MIT License
6.67k stars 2.24k forks source link

Reset rotary embeddings for chained inference #2573

Closed l-k-11235 closed 1 week ago

l-k-11235 commented 3 months ago

This fix is necessary if we use multiple calls to inference methods of inference engines.