How did you obtain the two model files, qwen-1.5-1.8b-chat-int8.mllm and qwen-1.5-1.8b-chat-q4k.mllm? - Githubissues

UbiquitousLearning / mllm

Fast Multimodal LLM on Mobile Devices

https://ubiquitouslearning.github.io/mllm_website

MIT License

528 stars 59 forks source link

How did you obtain the two model files, qwen-1.5-1.8b-chat-int8.mllm and qwen-1.5-1.8b-chat-q4k.mllm? #126

Open yhwang-hub opened 2 months ago

yhwang-hub commented 2 months ago

How did you obtain the two model files, qwen-1.5-1.8b-chat-int8.mllm and qwen-1.5-1.8b-chat-q4k.mllm?

oreomaker commented 2 months ago

The model files are in here. The link in readme is needed to be fixed.

yhwang-hub commented 2 months ago

How are these two models converted?

Vinayak006 commented 2 months ago

Where should the model be placed?