kyegomez / BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
https://discord.gg/qUtxnK2NMf
MIT License
1.69k stars 155 forks source link

[BUG] cant compile the cuda #60

Closed huynhducloi00 closed 1 month ago

huynhducloi00 commented 3 months ago

build_pytorch/pytorch/.venv/lib/python3.12/site-packages/bitnet-1.1-py3.12-linux-x86_64.egg/gemm_lowbit_ext.cpython-312-x86_64-linux-gnu.so: undefined symbol: _ZNK2at10TensorBase8data_ptrI6__halfEEPT_v

have anyone seen that issue i just try to run the example/kernel_test.py

Upvote & Fund

Fund with Polar

github-actions[bot] commented 1 month ago

Stale issue message

Dayun0925 commented 2 weeks ago

change the code "typedef half fp8" in gemm_lowbit_kernel.cu into "typedef at::Half fp8"