search

Meituan-AutoML / MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices
Apache License 2.0
996 stars 66 forks source link

实现移动端部署的路径 #4

Closed JennieGao-njust closed 8 months ago

JennieGao-njust commented 9 months ago

mobileVLM 实现移动端部署的路径是什么呢，我不太了解模型的mobile部署方式，是用什么框架推理呢，mnn或者fastllm可以用吗

huyiming2018 commented 9 months ago

We exploit https://github.com/ggerganov/llama.cpp as the inference framework for mobile phone and Jetson AGX Orin platform.

YangYang-DLUT commented 9 months ago

The specific deployment plan is still being organized and will be released in one or two weeks. We will release all of the necessary technical details, coming soon with our MobileVLM-v2.

YangYang-DLUT commented 8 months ago

We have updated README.md with the deployment instruction on Android devices with customized llama.cpp. Have a try!

er-muyue commented 8 months ago

Hi, we are closing this issue due to the inactivity. Hope your question has been resolved. If you have any further concerns, please feel free to re-open it or open a new issue. Thanks!