mit-han-lab / smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
https://arxiv.org/abs/2211.10438
MIT License
1.26k stars 150 forks source link

circular import #50

Open breaddance opened 1 year ago

breaddance commented 1 year ago

Hello everyone, recently I encountered the following issue while installing this code repository. Does anyone know how to resolve it? If you could give me some guidance, I would be extremely grateful.

Traceback (most recent call last): File "./generate_act_scales.py", line 7, in import torch File "/opt/conda/envs/smoothquant/lib/python3.8/site-packages/torch/init.py", line 778, in _C._initExtension(manager_path()) AttributeError: partially initialized module 'torch' has no attribute 'UntypedStorage' (most likely due to a circular import)