OpenBMB / MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.
Apache License 2.0
4.38k stars 313 forks source link

在手机端输入长文本报告维度不对错误 #154

Open rudaoshi opened 1 week ago

rudaoshi commented 1 week ago

输入约1134字,错误信息如下

MLCChat failed

Stack trace: org.apache.tvm.Base$TVMError: TVMError: Check failed: value->shape[0] <= max_cache_size - num_attention_sinks (768 vs. 764) : dim 0 of value too large Stack trace: File "/Users/acha/Desktop/mlc-MiniCPM/3rdparty/tvm/src/runtime/relax_vm/lm_support.cc", line 124

at org.apache.tvm.Base.checkCall(Base.java:173)
at org.apache.tvm.Function.invoke(Function.java:130)
at com.modelbest.mlcllm.ChatModule.prefill(ChatModule.java:55)
at com.modelbest.minicpm.AppViewModel$ChatState$requestGenerate$1$3.invoke(AppViewModel.kt:665)
at com.modelbest.minicpm.AppViewModel$ChatState$requestGenerate$1$3.invoke(AppViewModel.kt:665)
at com.modelbest.minicpm.AppViewModel$ChatState.callBackend(AppViewModel.kt:516)
at com.modelbest.minicpm.AppViewModel$ChatState.requestGenerate$lambda$5(AppViewModel.kt:665)
at com.modelbest.minicpm.AppViewModel$ChatState.$r8$lambda$yk6a3ARBHb2puBgO5yGFGVmJ5V4(Unknown Source:0)
at com.modelbest.minicpm.AppViewModel$ChatState$$ExternalSyntheticLambda4.run(Unknown Source:10)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:487)
at java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:644)
at java.lang.Thread.run(Thread.java:1012)

Error message: TVMError: Check failed: value->shape[0] <= max_cache_size - num_attention_sinks (768 vs. 764) : dim 0 of value too large Stack trace: File "/Users/acha/Desktop/mlc-MiniCPM/3rdparty/tvm/src/runtime/relax_vm/lm_support.cc", line 124