llava_llama3.1_8B当中pixel_values报错

modelscope / ms-swift

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

https://swift.readthedocs.io/zh-cn/latest/Instruction/index.html

Apache License 2.0

4.34k stars 381 forks source link

llava_llama3.1_8B当中pixel_values报错 #2483

Open JHL328 opened 1 day ago

JHL328 commented 1 day ago

[x] ms-swift已拉取最新版本使用的脚本如下 NPROC_PER_NODE=8 CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 swift sft \ --model_type llava1_6-llama3_1-8b-instruct \ --model_id_or_path /.cache/modelscope/hub/swift/llava-llama3___1-8b \ --dataset /html.jsonl \ --sft_type full \ --output_dir /ms-swift/output \ --max_length 16384 \ --ddp_backend nccl \ --freeze_vit True \ --deepspeed default-zero3 \ 报错信息如下：