Closed MekkCyber closed 4 months ago
Implementation of 1.58bit LLM with Llama following the paper & handbook released by Microsoft :
https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
cc @NouamaneTazi @xrsrke @thomwolf
Implementation of 1.58bit LLM with Llama following the paper & handbook released by Microsoft :
https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
cc @NouamaneTazi @xrsrke @thomwolf