search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.05k stars 1.03k forks source link

Wrong import in inference quantization example #774

Open Epliz opened 1 year ago

Epliz commented 1 year ago

Hi,

At https://github.com/microsoft/DeepSpeedExamples/blob/master/inference/huggingface/zero_inference/README.md , the referenced import from deepspeed.compression.inference.quantization import _init_group_wise_weight_quantization is wrong. The correct one is from deepspeed.inference.quantization import _init_group_wise_weight_quantization .

Can you please correct it? Best regards, Epliz

teis-e commented 5 months ago

I get this error using from deepspeed.compression.inference.quantization import _init_group_wise_weight_quantization : ModuleNotFoundError: No module named 'deepspeed.compression.inference'

And this with 'from deepspeed.inference.quantization import _init_group_wise_weight_quantization': File "/home/sw/bulldozer/code/deepspeed/DeepSpeedExamples/inference/huggingface/zero_inference/deep.py", line 1, in <module> from deepspeed.inference.quantization import _init_group_wise_weight_quantization ImportError: cannot import name '_init_group_wise_weight_quantization' from 'deepspeed.inference.quantization' (/home/sw/anaconda3/envs/deepseed/lib/python3.10/site-packages/deepspeed/inference/quantization/__init__.py)