从modelscope上下载了模型的config，Bin文件等，将inference示例代码的model_path改为本地，报错，好像没有从本地加载，而是去huggingface上找repo了？
Traceback (most recent call last): File "/checkpoint/binary/train_package/inference/inference.py", line 75, in <module> main() File "/checkpoint/binary/train_package/inference/inference.py", line 33, in main tokenizer, model, image_processor, context_len = load_pretrained_model(model_path, None, model_name, load_8bit=False, load_4bit=False, device="cuda") File "/checkpoint/binary/train_package/mplug_owl2/model/builder.py", line 105, in load_pretrained_model tokenizer = AutoTokenizer.from_pretrained(model_path, use_fast=False) File "/root/.local/lib/python3.8/site-packages/transformers/models/auto/tokenization_auto.py", line 652, in from_pretrained tokenizer_config = get_tokenizer_config(pretrained_model_name_or_path, **kwargs) File "/root/.local/lib/python3.8/site-packages/transformers/models/auto/tokenization_auto.py", line 496, in get_tokenizer_config resolved_config_file = cached_file( File "/root/.local/lib/python3.8/site-packages/transformers/utils/hub.py", line 417, in cached_file resolved_file = hf_hub_download( File "/root/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 110, in _inner_fn validate_repo_id(arg_value) File "/root/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 158, in validate_repo_id raise HFValidationError( huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/data/oss_bucket_0/guolianghui/damo/mPLUG-Owl2'. Userepo_typeargument if needed.
LianghuiGuo
commented
10 months ago
从modelscope上下载了模型的config，Bin文件等，将inference示例代码的model_path改为本地，报错，好像没有从本地加载，而是去huggingface上找repo了？
Traceback (most recent call last): File "/checkpoint/binary/train_package/inference/inference.py", line 75, in <module> main() File "/checkpoint/binary/train_package/inference/inference.py", line 33, in main tokenizer, model, image_processor, context_len = load_pretrained_model(model_path, None, model_name, load_8bit=False, load_4bit=False, device="cuda") File "/checkpoint/binary/train_package/mplug_owl2/model/builder.py", line 105, in load_pretrained_model tokenizer = AutoTokenizer.from_pretrained(model_path, use_fast=False) File "/root/.local/lib/python3.8/site-packages/transformers/models/auto/tokenization_auto.py", line 652, in from_pretrained tokenizer_config = get_tokenizer_config(pretrained_model_name_or_path, **kwargs) File "/root/.local/lib/python3.8/site-packages/transformers/models/auto/tokenization_auto.py", line 496, in get_tokenizer_config resolved_config_file = cached_file( File "/root/.local/lib/python3.8/site-packages/transformers/utils/hub.py", line 417, in cached_file resolved_file = hf_hub_download( File "/root/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 110, in _inner_fn validate_repo_id(arg_value) File "/root/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 158, in validate_repo_id raise HFValidationError( huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/data/oss_bucket_0/guolianghui/damo/mPLUG-Owl2'. Userepo_typeargument if needed.