-
tried to compile the routines unsuccefully
would you please hlp ?
(bitnet-cpp) triumph@triumph-HP-Z6-G5-Workstation-Desktop-PC:~/github/BitNet/src$ $CC
aarch64-ostl-linux-gcc: fatal error: no input …
-
My os is Windows , when I manually download the model and run with local path :
### huggingface-cli download HF1BitLLM/Llama3-8B-1.58-100B-tokens --local-dir models/Llama3-8B-1.58-100B-tokens
### p…
-
I am quite a newbie to LLM's, but was running into the following issue:
Command: `python setup_env.py --hf-repo HF1BitLLM/Llama3-8B-1.58-100B-tokens -q i2_s --quant-embd`
Output: `ERROR:root:Error oc…
-
Some commits lead to incorrect output of bitnet.
To reproduce:
```bash
python ./integration/BitNet/eval_correctness.py
```
The output is abnormal.
```
Replacing module layers.25.mlp.dow…
-
Hello,
After thoroughly reviewing the source code of both BitNet and T-MAC, I noticed a high degree of overlap between the two. The code implementation seems quite similar, which raises some questions…
-
Hi all,
We recently developed a fully open-source quantization method called VPTQ (Vector Post-Training Quantization) [https://github.com/microsoft/VPTQ](https://github.com/microsoft/VPTQ) which en…
-
```
CMake Error at 3rdparty/llama.cpp/ggml/src/CMakeLists.txt:1324 (add_library):
Cannot find source file:
../../../../include/bitnet-lut-kernels.h
Tried extensions .c .C .c++ .cc .cpp .cxx …
-
Amazing work and fantastic resource, thanks for sharing your work - this should jump start usage of llm on low resource devices.
Quick question - is there a guide to convert existing models to bitnet…
-
First of all, thanks. We need more ramps.
I was curious what you think of BitNet, and if llm.c is a place where experimenting with it could be facilitated. The papers were extremely promising and g…
-
Hi the bitnet paper looked promising, would the code be release? :)