search

microsoft / BitBLAS

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
MIT License
190 stars 21 forks source link

About Model Bitnet #27

Closed littlefive5 closed 2 months ago

littlefive5 commented 2 months ago

Hello, where can I get the reproduced weight of bitnet_b1_58? The code in the integration can support the checkpoint in huggingface 1bitLLM/bitnet_b1_58-3B?

LeiWang1999 commented 2 months ago

yeah, we use the weight from the 1bitLLM/bitnet_b1_58-3B directly.