alibaba / MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
http://www.mnn.zone/
8.76k stars 1.67k forks source link

onnx_export.py 报错 #3072

Open BigFaceBoy opened 2 weeks ago

BigFaceBoy commented 2 weeks ago

从https://hf-mirror.com/下载的模型 ./hfd.sh IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1 --tool wget -x 6. 使用 MNN/transformers/diffusion/export/onnx_export.py 转换出错:

[root@localhost export]$ python onnx_export.py --model_path ../../../../huggingface/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/ --output_path ./
Loading pipeline components...:  14%|██████████████████▌                                                                                                               | 1/7 [00:00<00:00, 46.34it/s]
Traceback (most recent call last):
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/transformers/modeling_utils.py", line 586, in load_state_dict
    return torch.load(
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/torch/serialization.py", line 1369, in load
    raise RuntimeError(
RuntimeError: mmap can only be used with files saved with `torch.save(../../../../huggingface/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/safety_checker/pytorch_model.bin, _use_new_zipfile_serialization=True), please torch.save your checkpoint with this option in order to use mmap.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/transformers/modeling_utils.py", line 595, in load_state_dict
    if f.read(7) == "version":
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x86 in position 196: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/home/root/Code/MNN/transformers/diffusion/export/onnx_export.py", line 212, in <module>
    convert_models(args.model_path, args.output_path, args.opset, args.fp16)
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
  File "/data/home/root/Code/MNN/transformers/diffusion/export/onnx_export.py", line 80, in convert_models
    pipeline = StableDiffusionPipeline.from_pretrained(model_path, torch_dtype=dtype).to(device)
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
    return fn(*args, **kwargs)
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/diffusers/pipelines/pipeline_utils.py", line 896, in from_pretrained
    loaded_sub_model = load_sub_model(
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/diffusers/pipelines/pipeline_loading_utils.py", line 704, in load_sub_model
    loaded_sub_model = load_method(os.path.join(cached_folder, name), **loading_kwargs)
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/transformers/modeling_utils.py", line 4020, in from_pretrained
    state_dict = load_state_dict(resolved_archive_file, weights_only=weights_only)
  File "/data/home/root/mambaforge/envs/taiyi/lib/python3.9/site-packages/transformers/modeling_utils.py", line 607, in load_state_dict
    raise OSError(
OSError: Unable to load weights from pytorch checkpoint file for '../../../../huggingface/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/safety_checker/pytorch_model.bin' at '../../../../huggingface/Taiyi-Stable-Diffusion-1B-Chinese-v0.1/safety_checker/pytorch_model.bin'. If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

系统版本:CentOS Linux release 7.9.2009 显卡:nvidia-l40 NVIDIA-SMI 550.54.15

jxt1234 commented 2 weeks ago

是不是模型没有下载完全?