Can mllm support MTK APU via NeuroPilot SDK?

UbiquitousLearning / mllm

Fast Multimodal LLM on Mobile Devices

https://ubiquitouslearning.github.io/mllm_website

MIT License

466 stars 56 forks source link

Can mllm support MTK APU via NeuroPilot SDK? #156

Open FranzKafkaYu opened 2 weeks ago

FranzKafkaYu commented 2 weeks ago

Hello developers,I have noticed that you already support QNN backend,what a excellent work!
Do you have any plan to support MTK APU via its NeuroPilot SDK?

lx200916 commented 2 weeks ago

Thanks for your interest in our project. Our framework is currently incompatible with Neuron SDK. Since Neuron SDK composes a graph by converting a model from TFLite framework, which is different from our library and QNN.

FranzKafkaYu commented 2 weeks ago

thanks for your reply,so sad to hear that.so what's the major difference between mllm and other projects such as llama.cpp/MNN/MediaPipe etc.