search

casper-hansen / AutoAWQ_kernels

MIT License
51 stars 21 forks source link

awq_ext is not defined #34

Open Yarflam opened 2 days ago

Yarflam commented 2 days ago

Hello

The module awq_ext can't be load:

image

I'm using CUDA 11.8, it's work with: transformers, unsloth and peft. Impossible to use it with awq/awq_ext.

When I try to execute pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.git the install is never stop it.

  building 'awq_ext' extension
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/layernorm
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/position_embedding
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/quantization
  creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/vllm
  Emitting ninja build file /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/build.ninja...
  Compiling objects...
  Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
^C  Building wheel for autoawq_kernels (setup.py) ... canceled

How to fix this?

Thank you!

Yarflam commented 2 days ago

Maybe, it's the same error in this issue: https://github.com/casper-hansen/AutoAWQ_kernels/issues/21