search

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
https://docs.rs/llm/latest/llm/
Apache License 2.0
6.06k stars 350 forks source link

Fix rewind crash #432

Closed olexiyb closed 8 months ago

olexiyb commented 9 months ago

n_past can be bigger then tokens.len() it should not be used to drain tokens array