llamacpp:integrate ggml's excellent and amazing llama.cpp to kantv

zhouwg / kantv

workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg

Apache License 2.0

117 stars 19 forks source link

llamacpp:integrate ggml's excellent and amazing llama.cpp to kantv #104

Closed zhouwg closed 5 months ago

zhouwg commented 5 months ago

This is a simple integration work(I did it in less then one day, just a few hours).

I still don't know/have no ide how llama.cpp is really used in project kantv like whisper.cpp based real-time subtitle in online tv.

a GPT-style chat tool?