search

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
6 stars 2 forks source link

Support quantization #37

Open kerthcet opened 7 months ago

kerthcet commented 7 months ago