is there a complete tutorial that guides me through using BitNet from scratch？

microsoft / BitNet

Official inference framework for 1-bit LLMs

MIT License

11.43k stars 773 forks source link

is there a complete tutorial that guides me through using BitNet from scratch？ #92

Closed hjc3613 closed 2 weeks ago

hjc3613 commented 4 weeks ago

Is there a complete tutorial that guides me through using BitNet from scratch, for example, starting with an 8B LLaMA model, first quantizing it to 1-bit, and then performing inference?

grctest commented 3 weeks ago

https://github.com/microsoft/BitNet?tab=readme-ov-file#build-from-source