ohmplatform / FreedomGPT

This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface
http://www.freedomgpt.com
GNU General Public License v3.0
2.58k stars 347 forks source link

Mining process exited with code 2 and signal null #136

Open geezluise opened 2 months ago

geezluise commented 2 months ago

Just finished setting up an orange pi 5b with 16GB of ram and I get this error

Starting mining /home/bill/Desktop/freedom-gpt/miner/mac/fgptminer: 1: Syntax error: word unexpected (expecting ")")

Mining process exited with code 2 and signal null

the app runs and all is well but it can't mine.

it also has this Inference error

Failed to start Inference process: (1) Error: spawn /home/bill/Desktop/freedom-gpt/llama.cpp/server ENOENT at ChildProcess._handle.onexit (node:internal/child_process:283:19) at onErrorNT (node:internal/child_process:476:16) at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { errno: -2, code: 'ENOENT', syscall: 'spawn /home/bill/Desktop/freedom-gpt/llama.cpp/server', path: '/home/bill/Desktop/freedom-gpt/llama.cpp/server', spawnargs: [ '-m', '/home/bill/Documents/dolphin-2.9-llama3-8b.Q8_0.gguf', '-c', '2048', '--port', '8887' ] }

geezluise commented 2 months ago

I made a fresh install of Ubuntu 20.04 and the only thing installed are the dependencies. I am running it on a OrangePi 5B 16GB ram. Unit has an NPU and 6 TOPS of compute power. I get this error when turning on the minerer

4:37:06.001 › Starting mining process 14:37:06.073 › xmrigProcess.stderr /home/billy/Desktop/freedom-gpt/miner/mac/fgptminer: 1: Syntax error: word unexpected (expecting ")")

14:37:06.077 › Mining process exited with code 2 and signal null

Inference mining has improved it loads a bunch of stuff and no error messages. However it is not generating any tokens or using CPU power. The end of its load are this.

14:39:22.240 › inferenceProcess.stderr llama_new_context_with_model: n_ctx = 2048 llama_new_context_with_model: freq_base = 10000.0 llama_new_context_with_model: freq_scale = 1

14:39:22.664 › inferenceProcess.stderr llama_new_context_with_model: kv self size = 1024.00 MiB

14:39:22.665 › inferenceProcess.stderr llama_build_graph: non-view tensors processed: 740/740 llama_new_context_with_model: compute buffer total size = 159.07 MiB

14:39:23.151 › inferenceProcess.stderr Available slots: -> Slot 0 - max context: 2048

llama server listening at http://127.0.0.1:8887

all slots are idle and system prompt is empty, clear the KV cache

14:39:23.152 › inferenceProcess.stdout {"timestamp":1714329563,"level":"INFO","function":"main","line":2564,"message":"HTTP server listening","hostname":"127.0.0.1","port":8887}

thats just the end of it, it is a long log in the shell

geezluise commented 2 months ago

if it helps here are the warnings I get when upgrading.

yarn upgrade v1.22.22 warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json. [1/4] Resolving packages... warning @zeit/next-typescript@1.1.1: Next.js now has built-in TypeScript support that is integrated into the framework by default: https://nextjs.org/docs/basic-features/typescript warning machine-uuid > uuid@3.4.0: Please upgrade to version 7 or higher. Older versions may use Math.random() in certain circumstances, which is known to be problematic. See https://v8.dev/blog/math-random for details. warning rehype-mathjax > jsdom > abab@2.0.6: Use your platform's native atob() and btoa() methods instead warning rehype-mathjax > jsdom > data-urls > abab@2.0.6: Use your platform's native atob() and btoa() methods instead warning rehype-mathjax > jsdom > domexception@4.0.0: Use your platform's native DOMException instead warning @electron-forge/cli > @electron-forge/core > electron-packager@17.1.2: Please use @electron/packager moving forward. There is no API change, just a package name change warning @electron-forge/cli > @electron-forge/shared-types > electron-packager@17.1.2: Please use @electron/packager moving forward. There is no API change, just a package name change warning @electron-forge/cli > @electron-forge/core > @electron/rebuild > node-gyp > make-fetch-happen > cacache > @npmcli/move-file@2.0.1: This functionality has been moved to @npmcli/fs warning @electron-forge/maker-deb > electron-installer-debian > electron-installer-common > asar@3.2.0: Please use @electron/asar moving forward. There is no API change, just a package name change warning @electron-forge/maker-deb > electron-installer-debian > get-folder-size > gar@1.0.4: Package no longer supported. Contact Support at https://www.npmjs.com/support for more info. warning @electron-forge/plugin-webpack > @electron-forge/web-multi-logger > xterm-addon-fit@0.5.0: This package is now deprecated. Move to @xterm/addon-fit instead. warning @electron-forge/plugin-webpack > @electron-forge/web-multi-logger > xterm@4.19.0: This package is now deprecated. Move to @xterm/xterm instead. warning @electron-forge/plugin-webpack > webpack-dev-server > webpack-dev-middleware > memfs@3.6.0: this will be v4 warning @electron-forge/plugin-webpack > @electron-forge/web-multi-logger > xterm-addon-search@0.8.2: This package is now deprecated. Move to @xterm/addon-search instead. warning @vitest/coverage-c8@0.29.8: v8 coverage is moved to @vitest/coverage-v8 package warning electron-builder > app-builder-lib > @electron/universal > asar@3.2.0: Please use @electron/asar moving forward. There is no API change, just a package name change warning electron-builder > app-builder-lib > electron-osx-sign@0.6.0: Please use @electron/osx-sign moving forward. Be aware the API is slightly different warning fork-ts-checker-webpack-plugin > memfs@3.6.0: this will be v4 warning jsdom > abab@2.0.6: Use your platform's native atob() and btoa() methods instead warning jsdom > domexception@4.0.0: Use your platform's native DOMException instead warning jsdom > data-urls > abab@2.0.6: Use your platform's native atob() and btoa() methods instead [2/4] Fetching packages... [3/4] Linking dependencies... warning "react-hot-toast > goober@2.1.14" has unmet peer dependency "csstype@^3.0.10". warning " > babel-loader@9.1.3" has unmet peer dependency "webpack@>=5". warning " > copy-webpack-plugin@11.0.0" has unmet peer dependency "webpack@^5.1.0". warning " > fork-ts-checker-webpack-plugin@7.3.0" has unmet peer dependency "webpack@^5.11.0". warning " > node-loader@2.0.0" has unmet peer dependency "webpack@^5.0.0". warning " > style-loader@3.3.4" has unmet peer dependency "webpack@^5.0.0". warning " > ts-loader@9.5.1" has unmet peer dependency "webpack@^5.0.0".