search

quic / aimet

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
https://quic.github.io/aimet-pages/index.html
Other
2.02k stars 366 forks source link

aimet v 1.31.0 installation #3037

Open jianbin-zhang opened 1 month ago

jianbin-zhang commented 1 month ago

My Local environment is ubuntu20.04 + py3.8 + cuda-11.7.

We are referring the wiki - https://quic.github.io/aimet-pages/releases/latest/install/install_host.html to set up AIMET - 1.31.0 , but stuck in downloading torch. It show the below errors.

ERROR: Could not find a version that satisfies the requirement torch==1.13.1+cu116 (from aimet-torch==torch-gpu-1.31.0) (from versions: 1.4.0, 1.5.0, 1.5.1, 1.6.0, 1.7.0, 1.7.1, 1.8.0, 1.8.1, 1.9.0, 1.9.1, 1.10.0, 1.10.1, 1.10.2, 1.11.0, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1) ERROR: No matching distribution found for torch==1.13.1+cu116 (from aimet-torch==torch-gpu-1.31.0)

e-said commented 1 month ago

Hello @jianbin-zhang,

Your link is pointing to the "latest" AIMET version, which is not 1.31.0.

Please follow this link for AIMET 1.31.0.

Based on the error message, it appears that torch 1.13.1+cu116 is not installed. You can find the installation instructions for this in the link I shared.

Additionally, I recommend using Docker, Conda, or an equivalent environment manager to install AIMET or any new framework. This can help avoid compatibility issues in your setup.