[Model Request] Phi-3-Vision

mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation

https://llm.mlc.ai/

Apache License 2.0

18.8k stars 1.54k forks source link

Open NSTiwari opened 4 months ago

NSTiwari commented 4 months ago

Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/microsoft/Phi-3-vision-128k-instruct
Is this model architecture supported by MLC-LLM? (the list of supported models) No

It would be great if MLC can start supporting vision language models, one such model being the Phi-3-Vision tiny model.

NSTiwari commented 4 months ago

@MasterJH5574: OpenBMB have modified MLC LLM for multi-modal support on Android. https://github.com/OpenBMB/mlc-MiniCPM

Is it possible to add MiniCPM-V model as a new "model-type" parameter?

federicoparra commented 4 months ago

This would be awesome !

changye-chen commented 4 months ago

very cool if it comes true

zw0241 commented 4 months ago

Looking forward to it!

Single430 commented 3 months ago

Looking forward to it!

kalyan-nakka commented 3 months ago

Looking forward to it !!!