search

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch
https://opennmt.net/
MIT License
6.67k stars 2.24k forks source link

fix generation with large sequences when flash2 is False #2564

Closed l-k-11235 closed 4 months ago

l-k-11235 commented 4 months ago

fix generation with large sequences when flash2 is False