Add "context swap" functions to session and add "decoded_tokens" to snapshot read/write

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

https://docs.rs/llm/latest/llm/

Apache License 2.0

6.06k stars 350 forks source link

Closed Andreybest closed 9 months ago