search

UbiquitousLearning / mllm

Fast Multimodal LLM on Mobile Devices
https://ubiquitouslearning.github.io/mllm_website
MIT License
499 stars 57 forks source link

feat: add Qwen 1.8B demo #100

Closed yirongjie closed 3 months ago

yirongjie commented 3 months ago

You need to change example/demo_qwen.cpp

cmdParser.add<string>("model", 'm', "specify mllm model path", false, "../models/qwen-1.5-1.8b-q4_k.mllm");

QWenConfig config(tokens_limit, "1.8B", RoPEType::HFHUBROPE);

You can download model here.