search

qwopqwop200 / GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ
Apache License 2.0
2.98k stars 457 forks source link

Build issue with newer torch pybind11 cast.h - workaround inside #241

Open ilikenwf opened 1 year ago

ilikenwf commented 1 year ago

This may be out of the scope of current development, but the workaround of patching cast.h as described in this issue allows builds for me

https://github.com/pybind/pybind11/issues/4606

I realize we can't really go modifying that file ourselves however manually it is acceptable - maybe worthy of being in a readme somewhere.