search

WisdomShell / codeshell-vscode

An intelligent coding assistant plugin for Visual Studio Code, developed based on CodeShell
Apache License 2.0
569 stars 70 forks source link

Illegal instruction running the codeshell in termux for android #18

Closed wangmu0579 closed 8 months ago

wangmu0579 commented 8 months ago

Hi, I have build visx and server success on termux which is running in Android phone. But illegal instruction appeared and server stopped. Do you have any clue to let server continue running?

e.g which source code I should try to debug or do the modification?

./server -m codeshell-chat-q4_0.gguf --host 127.0.0.1 --port 8081 .............................................................................................. llama_new_context_with_model: n_ctx = 8192 llama_new_context_with_model: freq_base = 10000.0 llama_new_context_with_model: freq_scale = 1 llama_new_context_with_model: kv self size = 1344.00 MB llama_new_context_with_model: compute buffer total size = 558.13 MB Illegal instruction ~/llama_cpp_for_codeshell $ free -m -h

wangmu0579 commented 8 months ago

I have executed the codeshell in another Android phone, maybe another phone have much memory.But executed with huge slow. Will try to let GPU work for codeshell in android. Hope luckcy on me.

wangmu0579 commented 8 months ago

Screenshot_20231020_214101 Huge slow and no mem anymore after server in full speed.