Qwen1.5-32B-Chat-AWQ 加载模型报错No module named 'transformers.models.starcoder2'

微信图片_20240513163545 请问我加载量化版本时，出现了上图问题，请问这是哪个版本出现了问题？具体改如何修改呢

代码如下：

from transformers import AutoModelForCausalLM, AutoTokenizer
device = "cuda"  # the device to load the model onto

model = AutoModelForCausalLM.from_pretrained("/media/ubuntu/Date/IndentifyModules/Qwen1.5-32B-Chat-AWQ", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("/media/ubuntu/Date/IndentifyModules/Qwen1.5-32B-Chat-AWQ")

prompt = "Give me a short introduction to large language model."
messages = [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(device)

generated_ids = model.generate(
    model_inputs.input_ids,
    max_new_tokens=512
)
generated_ids = [
    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]

response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]

版本为：

Package                                  Version
---------------------------------------- -----------
absl-py                                  2.1.0
accelerate                               0.29.3
aiohttp                                  3.9.5
aiosignal                                1.3.1
annotated-types                          0.6.0
anyio                                    3.7.1
archspec                                 0.2.3
asgiref                                  3.8.1
astunparse                               1.6.3
async-timeout                            4.0.3
attrs                                    23.2.0
autoawq                                  0.2.5
autoawq_kernels                          0.0.6
backoff                                  2.2.1
bcrypt                                   4.1.2
beautifulsoup4                           4.12.3
blinker                                  1.7.0
boltons                                  23.0.0
Brotli                                   1.0.9
build                                    1.2.1
cachetools                               5.3.3
certifi                                  2024.2.2
cffi                                     1.16.0
chardet                                  5.2.0
charset-normalizer                       2.0.4
chroma-hnswlib                           0.7.3
chromadb                                 0.5.0
click                                    8.1.7
cmake                                    3.29.2
coloredlogs                              15.0.1
conda                                    24.3.0
conda-libmamba-solver                    24.1.0
conda-package-handling                   2.2.0
conda_package_streaming                  0.9.0
dataclasses-json                         0.6.4
datasets                                 2.19.1
decorator                                4.4.2
deepface                                 0.0.90
Deprecated                               1.2.14
dill                                     0.3.8
distro                                   1.8.0
exceptiongroup                           1.2.1
fastapi                                  0.110.3
filelock                                 3.13.1
fire                                     0.6.0
Flask                                    3.0.3
flatbuffers                              24.3.25
frozenlist                               1.4.1
fsspec                                   2024.3.1
gast                                     0.4.0
gdown                                    5.1.0
gmpy2                                    2.1.2
google-auth                              2.29.0
google-auth-oauthlib                     1.0.0
google-pasta                             0.2.0
googleapis-common-protos                 1.63.0
graphlib_backport                        1.1.0
greenlet                                 3.0.3
grpcio                                   1.62.2
gunicorn                                 22.0.0
h11                                      0.14.0
h5py                                     3.11.0
httptools                                0.6.1
huggingface-hub                          0.22.2
humanfriendly                            10.0
idna                                     3.4
imageio                                  2.34.1
imageio-ffmpeg                           0.4.9
importlib-metadata                       7.0.0
importlib_resources                      6.4.0
itsdangerous                             2.2.0
Jinja2                                   3.1.3
joblib                                   1.4.0
jsonpatch                                1.33
jsonpointer                              2.1
keras                                    2.13.1
kubernetes                               29.0.0
langchain                                0.0.335
langchain-community                      0.0.31
langchain-core                           0.1.45
langchain-text-splitters                 0.0.1
langsmith                                0.1.50
libclang                                 18.1.1
libmambapy                               1.5.8
lit                                      18.1.3
llava                                    0.0.1.dev0
llvmlite                                 0.41.1
Markdown                                 3.6
markdown-it-py                           3.0.0
MarkupSafe                               2.1.3
marshmallow                              3.21.1
mdurl                                    0.1.2
menuinst                                 2.0.2
mkl-fft                                  1.3.8
mkl-random                               1.2.4
mkl-service                              2.4.0
mmh3                                     4.1.0
monotonic                                1.6
more-itertools                           10.2.0
moviepy                                  1.0.3
mpmath                                   1.3.0
mtcnn                                    0.1.1
multidict                                6.0.5
multiprocess                             0.70.16
mypy-extensions                          1.0.0
networkx                                 3.1
numba                                    0.58.1
numpy                                    1.24.3
nvidia-cublas-cu11                       11.10.3.66
nvidia-cuda-cupti-cu11                   11.7.101
nvidia-cuda-nvrtc-cu11                   11.7.99
nvidia-cuda-runtime-cu11                 11.7.99
nvidia-cudnn-cu11                        8.5.0.96
nvidia-cufft-cu11                        10.9.0.58
nvidia-curand-cu11                       10.2.10.91
nvidia-cusolver-cu11                     11.4.0.1
nvidia-cusparse-cu11                     11.7.4.91
nvidia-nccl-cu11                         2.14.3
nvidia-nvtx-cu11                         11.7.91
oauthlib                                 3.2.2
onnxruntime                              1.17.3
openai-whisper                           20231117
opencv-python                            4.9.0.80
opentelemetry-api                        1.24.0
opentelemetry-exporter-otlp-proto-common 1.24.0
opentelemetry-exporter-otlp-proto-grpc   1.24.0
opentelemetry-instrumentation            0.45b0
opentelemetry-instrumentation-asgi       0.45b0
opentelemetry-instrumentation-fastapi    0.45b0
opentelemetry-proto                      1.24.0
opentelemetry-sdk                        1.24.0
opentelemetry-semantic-conventions       0.45b0
opentelemetry-util-http                  0.45b0
opt-einsum                               3.3.0
orjson                                   3.10.1
overrides                                7.7.0
packaging                                23.2
pandas                                   2.0.3
pillow                                   10.2.0
pip                                      23.3.1
platformdirs                             3.10.0
pluggy                                   1.0.0
posthog                                  3.5.0
proglog                                  0.1.10
protobuf                                 4.25.3
psutil                                   5.9.8
pyarrow                                  16.0.0
pyarrow-hotfix                           0.6
pyasn1                                   0.6.0
pyasn1_modules                           0.4.0
pycosat                                  0.6.6
pycparser                                2.21
pydantic                                 2.7.1
pydantic_core                            2.18.2
Pygments                                 2.17.2
PyPika                                   0.48.9
pyproject_hooks                          1.1.0
PySocks                                  1.7.1
python-dateutil                          2.9.0.post0
python-dotenv                            1.0.1
pytz                                     2024.1
PyYAML                                   6.0.1
regex                                    2023.12.25
requests                                 2.31.0
requests-oauthlib                        2.0.0
retina-face                              0.0.17
rich                                     13.7.1
rsa                                      4.9
ruamel.yaml                              0.17.21
ruamel.yaml.clib                         0.2.6
safetensors                              0.4.3
scikit-learn                             1.3.2
scipy                                    1.10.1
sentence-transformers                    2.7.0
setuptools                               68.2.2
shellingham                              1.5.4
six                                      1.16.0
sniffio                                  1.3.1
soupsieve                                2.5
SQLAlchemy                               2.0.29
starlette                                0.37.2
sympy                                    1.12
tenacity                                 8.2.3
tensorboard                              2.13.0
tensorboard-data-server                  0.7.2
tensorflow                               2.13.1
tensorflow-estimator                     2.13.0
tensorflow-io-gcs-filesystem             0.34.0
termcolor                                2.4.0
threadpoolctl                            3.4.0
tiktoken                                 0.6.0
tokenizers                               0.15.2
tomli                                    2.0.1
torch                                    2.0.1
torchaudio                               2.0.2
torchvision                              0.15.2
tqdm                                     4.65.0
transformers                             4.38.2
triton                                   2.0.0
typer                                    0.12.3
typing_extensions                        4.11.0
typing-inspect                           0.9.0
tzdata                                   2024.1
urllib3                                  2.1.0
uvicorn                                  0.29.0
uvloop                                   0.19.0
watchfiles                               0.21.0
websocket-client                         1.8.0
websockets                               12.0
Werkzeug                                 3.0.2
wheel                                    0.41.2
wrapt                                    1.16.0
xxhash                                   3.4.1
yarl                                     1.9.4
zipp                                     3.18.1
zstandard                                0.19.0

QwenLM / Qwen2

Qwen1.5-32B-Chat-AWQ 加载模型报错No module named 'transformers.models.starcoder2' #404