casper-hansen / AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
https://casper-hansen.github.io/AutoAWQ/
MIT License
1.74k stars 207 forks source link

request: update prereq list to show supported python versions #569

Open AartBluestoke opened 3 months ago

AartBluestoke commented 3 months ago

[previously titled "unable to install autoawq, prerequisites are present."] autoAWQ doesn't currently support python 3.12, even though some things that require it do. could the requirements please be updated to reflect that .

current requirements are shown as: image


when i attempted an install on my computer:

Python 3.12.3 torch: 2.4.0+cu121 cuda: 12.1 compute compatibility: 8.6

(aimodels) aartbluestoke@DESKTOP-KUFRT7B:~$ pip install autoawq
ERROR: Could not find a version that satisfies the requirement autoawq (from versions: none)
ERROR: No matching distribution found for autoawq

trying to download the source and install (as suggested):

(aimodels) aartbluestoke@DESKTOP-KUFRT7B:
~/$git clone https://github.com/casper-hansen/AutoAWQ
~/$cd AutoAWQ
~/AutoAWQ$ pip install -e .
Obtaining file:///home/aartbluestoke/AutoAWQ
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... error
  error: subprocess-exited-with-error

  × Getting requirements to build editable did not run successfully.
  │ exit code: 1
  ╰─> [23 lines of output]
      Traceback (most recent call last):
...
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build editable did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
(aimodels) aartbluestoke@DESKTOP-KUFRT7B:~/AutoAWQ$

attempting to install straight from git fails to unpack for some reason.

(aimodels) aartbluestoke@DESKTOP-KUFRT7B:~/AutoAWQ$ pip install autoawq@https://github.com/casper-hansen/AutoAWQ.git
Collecting autoawq@ https://github.com/casper-hansen/AutoAWQ.git
  Downloading https://github.com/casper-hansen/AutoAWQ.git
     - 418.4 kB 1.0 MB/s 0:00:00
  ERROR: Cannot unpack file /tmp/pip-unpack-p_jyga69/AutoAWQ.git (downloaded from /tmp/pip-install-cz89dngf/autoawq_02f881b0397c48d79b8be5d8522d5d1b, content-type: text/html; charset=utf-8); cannot detect archive format
ERROR: Cannot determine archive format of /tmp/pip-install-cz89dngf/autoawq_02f881b0397c48d79b8be5d8522d5d1b
(aimodels) aartbluestoke@DESKTOP-KUFRT7B:~/AutoAWQ$

this isn't caused by missing torch - both pip, and inside a jupyter notebook think torch, cuda, and associated dependencies are there

(aimodels) aartbluestoke@DESKTOP-KUFRT7B:~/AutoAWQ$ pip list | grep torch
torch                     2.4.0

image

casper-hansen commented 3 months ago

AutoAWQ does not yet support Python 3.12

AartBluestoke commented 2 months ago

thanks for that - i've edited the title of this issue to better reflect my issue :) current requirements list don't mention python version restrictions image

frei-x commented 1 day ago

+1