modelscope / swift

ms-swift: Use PEFT or Full-parameter to finetune 300+ LLMs or 50+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3, Llava-Video, Internvl2, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
https://swift.readthedocs.io/zh-cn/latest/
Apache License 2.0
2.5k stars 228 forks source link

model_type: 'internvl2-8b' is not registered #1324

Open Jiax323 opened 2 weeks ago

Jiax323 commented 2 weeks ago

CUDA_VISIBLE_DEVICES=0 swift sft \ --model_type internvl2-8b \ --dataset /home/admin/workspace/aop_lab/inf_extr_data/train_dataset_ocr_pic_intern.json \ --max_length 4096

显示model_type: 'internvl2-8b' is not registered
Jintao-Huang commented 2 weeks ago

从main分支 安装呢

Jiax323 commented 2 weeks ago

[INFO:swift] Downloading the model from ModelScope Hub, model_id: OpenGVLab/InternVL2-8B [ERROR:modelscope] The request model: OpenGVLab/InternVL2-8B does not exist! 会出现这个错误

hjh0119 commented 2 weeks ago

该模型是申请制下载, 你需要申请下载后用ModelScope Hub登录

Jiax323 commented 1 week ago

下载之后如何在python代码中进行调用呢,有相关参考文档吗?

GoudyGe commented 4 days ago

我也遇到这个问题:我的是internvl2-1b 想微调提示模型没有注册,我snapshot download下载下来了之后,依然有这个提醒。

hjh0119 commented 4 days ago

@GoudyGe 见FQA第一条 https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/internvl%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

GoudyGe commented 4 days ago

@GoudyGe 见FQA第一条 https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/internvl%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

hjh0119 commented 4 days ago

@GoudyGe hub_token的逻辑最近几天有更新, 你试下更新swift会不会还有问题

GoudyGe commented 4 days ago

@GoudyGe hub_token的逻辑最近几天有更新, 你试下更新swift会不会还有问题

而且我看了微调命令的help里面是没有1b的模型的,但是文档里面写了有1b,2b的才有。

hjh0119 commented 4 days ago

@GoudyGe 1b是昨天新支持的, 需要你用源码安装swift

GoudyGe commented 4 days ago

@GoudyGe 1b是昨天新支持的, 需要你用源码安装swift

ok··· 明白了