zhouwg / kantv

workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
Apache License 2.0
96 stars 17 forks source link

ggml-jni: update latest source code of ggml/whispercpp/llamacpp from upstream #201

Closed zhouwg closed 1 month ago

zhouwg commented 1 month ago

Purpose

This PR is intend to

Status

  1. update source code of ggml/whispercpp/llamacpp from upstream and refine ggml-jni/project accordingly

There are many issues during update source code from upstream ggml due to the huge changes in the latest source of ggml/whispercpp/llamacpp from upstream.

the following is a example which I can't believe this because this change cause crash in ggml-qnn.cpp:

//from
//
//void ggml_compute_forward(struct ggml_compute_params * params, struct ggml_tensor * tensor) {
//
//to
//
//void ggml_compute_forward(struct ggml_compute_params * params, struct ggml_tensor * tensor, struct ggml_compute_state * state) {
//

some issues already fixed and I'm working on figure out why ggml-qnn.cpp does not works fine with latest source code from upstream llamacpp as expected(ggml-qnn.cpp works fine as expected with llamacpp in branch kantv-1.3.7).

it seems the maintainers of upstream llamacpp are working on backward inference(for model training?) in upstream ggml. respect!

  1. validation on Xiaomi14

close and move to #203