是不是不支持在推理代码里面设置MiniCPM3-4B

modelscope / ms-swift

Use PEFT or Full-parameter to finetune 350+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

https://swift.readthedocs.io/zh-cn/latest/Instruction/index.html

Apache License 2.0

3.93k stars 347 forks source link

是不是不支持在推理代码里面设置MiniCPM3-4B #2310

Open learn01one opened 4 hours ago

learn01one commented 4 hours ago

推理代码设置： model_type = ModelType.MiniCPM3-4B template_type = get_default_template_type(model_type) 好像会报错，现在是否不支持额，谢谢～

Jintao-Huang commented 3 hours ago

ModelType.minicpm3_4b

https://swift.readthedocs.io/zh-cn/latest/Instruction/%E6%94%AF%E6%8C%81%E7%9A%84%E6%A8%A1%E5%9E%8B%E5%92%8C%E6%95%B0%E6%8D%AE%E9%9B%86.html