search

SqueezeBits / QUICK

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
MIT License
112 stars 5 forks source link

ModuleNotFoundError: No module named 'quick' #5

Open Quang-elec44 opened 8 months ago

Quang-elec44 commented 8 months ago

Hi, I cannot import the lib when installing from the source. Can you check again? The current version is quick==0.1.0+cu121

JHLEE17 commented 8 months ago

HI, @Quang-elec44

Thank you for your interest in our QUICK repo. I've reviewed the reported problem but was unable to reproduce the issue. To assist you better, could you please provide the details like command, error message and environments?

And please confirm if you have installed AutoAWQ_kernels prior to installing our kernel, as it is a necessary prerequisite for our project to function correctly.

Quang-elec44 commented 8 months ago

@JHLEE17 Here is my environment after installing all required packages

autoawq                   0.2.2
autoawq_kernels           0.0.6
quick                     0.1.0+cu121

I installed QUICK by running the command:

pip install git+https://github.com/SqueezeBits/QUICK
JHLEE17 commented 8 months ago

Can you try this?

git clone https://github.com/SqueezeBits/QUICK
cd QUICK
pip install -e .