search

allwefantasy / byzer-llm

Easy, fast, and cheap pretrain,finetune, serving for everyone
Apache License 2.0
257 stars 36 forks source link

llama, llama2, and falcon support 4bit and 8bit configurations when q… #8

Closed coding-yuhui closed 1 year ago

coding-yuhui commented 1 year ago

…uantization is turned on