search

hack-ink / AiR

AI with Rust.
GNU General Public License v3.0
118 stars 6 forks source link

Better tokenizer #36

Closed AurevoirXavier closed 2 months ago

AurevoirXavier commented 3 months ago

Additionally, regarding #42:

At present, I utilize llm_utils, which introduces over 300 dependencies. Moreover, it necessitates the installation of libxml2 on the host machine.

AurevoirXavier commented 2 months ago

https://github.com/hack-ink/AiR/commit/d3feddd772191d93825e7746113d8c2abe39f945