rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
https://docs.rs/llm/latest/llm/
Apache License 2.0
6.06k stars 350 forks source link

Updated tokenizers crate to 0.13.4 #406

Closed clarkmcc closed 10 months ago

clarkmcc commented 10 months ago

Fixes #405

philpax commented 10 months ago

much obliged