ggml-jni: add code skeleton for minicpm-v(a GPT-4V style multimodal LLM MiniCPM-Llama3-V 2.5)

zhouwg / kantv

workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg

Apache License 2.0

96 stars 17 forks source link

ggml-jni: add code skeleton for minicpm-v(a GPT-4V style multimodal LLM MiniCPM-Llama3-V 2.5) #198

Closed zhouwg closed 1 month ago

zhouwg commented 1 month ago

code skeleton works fine as expected for minicpm-v

but

there are so many issues(because latest source code of llama.cpp should be used with dev version but dev version crash on Xiaomi 14 and I did not find out the rootcause)