search

dikkietrom / KITT-AI-Browser

KITT In Twenty Three
7 stars 0 forks source link

Node.js version error #1

Open chronic8000 opened 1 year ago

chronic8000 commented 1 year ago

Error: The module '\?\C:\Users\chron\KITT\node_modules\robotjs\build\Release\robotjs.node' was compiled against a different Node.js version using NODE_MODULE_VERSION 108. This version of Node.js requires NODE_MODULE_VERSION 113. Please try re-compiling or re-installing the module (for instance, using npm rebuild or npm install).

Do I just need a different version of node.js? I am using the latest version node-v18.16.0-x64.msi Should I be using an older version? If I can get this working I will knock up a tutorial on setting it up.

chronic8000 commented 1 year ago

Getting a lot of different errors this is just one of them.

dikkietrom commented 1 year ago

sorry for the late reply I was not anticipating usage yet. I just have the auto coder ready, it is on fire. I am on mac and cannot test it in windows. I had that issue also and doing a full rebuild solved it.

first do rm -rf node_modules

then npm install

then ./node_modules/.bin/electron-rebuild

the robotjs is not actually in use but it will be soon to physically act as an agent on your pc, supervised and/or auto. I don't believe in autoGPT but with user supervision, guidance and intervention it works very well. I am just at the point that it reads its own code and makes documentation. The only limit is the 25 messages per 3 hours of gpt4, otherwise the whole project would be documented already. Check the latest readme for what I mean. I hope you can get it up and running, otherwise I have binaries also for windows. You can build all binaries also with

npm run build

dikkietrom commented 1 year ago

ps I added all info in the readme beginning, hopefully an improvement for a stable install, which is a challenge

chronic8000 commented 1 year ago

OK that is great good work on the documentation. I tried however to get it working in WSL2 Ubuntu and natively on Windows. The issue seems to be in WSL2 with dbus:

The error message suggests that there is an issue connecting to the D-Bus system bus socket in your WSL2 environment. D-Bus is a system message bus that allows communication between different processes on the system.

Please note that using Electron in WSL2 might have limitations or unexpected behavior due to the differences in the underlying system architecture. It is recommended to develop and run Electron applications on a native Linux or Windows environment whenever possible.

I also tried it in Windows and can't get it to install because of all the dependencies. The commands I used to get it working on Ubuntu that should work on bare metal hardware are below in no paticular order I just copied them as I was using them. I got help from GPT4 on getting this as far as I did :)

sudo apt-get install libx11-dev sudo apt-get install libxtst-dev sudo apt-get install libxtst-dev sudo apt-get install libgtk2.0-0 sudo apt-get install libxss1 sudo apt-get install libgconf-2-4 sudo apt-get install libnss3 sudo apt-get install libasound2 sudo apt-get install libatk-bridge2.0-0 sudo apt-get install build-essential libxtst-dev libpng++-dev sudo apt-get install libgtk-3-0 sudo apt-get install libgbm1

npm install electron-is-dev rm -rf node_modules package-lock.json npm install

Are you running it on OSX did you say? Could you bootcamp get it running on Windows? I could get it running in a VMware virtual machine but I wanted GPU access (if it's even needed?). Be good to get this working.

chronic8000 commented 1 year ago

(base) chronic@Nemesis:~/KITT-AI-Browser$ npm install dmg-license npm ERR! code EBADPLATFORM npm ERR! notsup Unsupported platform for iconv-corefoundation@1.1.7: wanted {"os":"darwin"} (current: {"os":"linux"}) npm ERR! notsup Valid os: darwin npm ERR! notsup Actual os: linux

npm ERR! A complete log of this run can be found in: /home/chronic/.npm/_logs/2023-05-02T11_41_40_237Z-debug-0.log (base) chronic@Nemesis:~/KITT-AI-Browser$

I was debugging getting npm run build to work and ended up with this when I tried to install one of the dependencies it needs.

dikkietrom commented 1 year ago

Are you able to do a npm run build? I have all binaries on my pc. I can make a torrent link for them. The autoupdate should preferable work so that everybody is always on the latest version. If you want I can upload binaries to icloud and give you the links for windows and linux. I should be able to find linux and windows machines online. I used to work with nwjs but that was constantly crashing. I learned quite a lot about Electron in short time but I am by no means an Electron specialist. Yes I am on mac M1, usually mac is the hardest to install stuff on. Why are you installing npm install dmg-license? KITT does not need GPU since it encapsulated online services. I tried a couple of local running llms but at this point that is completely useless for what I want need it to do. I do want to train my own network. Actually I want KITT to do everything, with the current plugins it is at a tipping point of supervised autonomous self modification. As if you can change your DNA on the fly as a human being ;)

please update me if you have some progress with installing stuff and encounter new issues, I might have also had them. Great that you are putting effort in getting it up and running!

chronic8000 commented 1 year ago

(base) chronic@Nemesis:~/KITT-AI-Browser$ npm run build

kitt@1.0.0 build electron-builder --win --mac --linux --x64 --arm64

• electron-builder version=24.3.0 os=5.15.90.1-microsoft-standard-WSL2 • loaded configuration file=package.json ("build" field) • writing effective config file=dist/builder-effective-config.yaml ⨯ Cannot find module 'dmg-license' Require stack:

That is as far as I have got it to go. I managed to get past npm install with the help of GPT but the npm run build resulted in the above error. I have bashed other bugs with getting npm run build working however before getting to this point. I think I already included everything I installed to get to this point but it looks like this is as far as I can go as this package requires a mac :( I could spin up my emulator but I am a PC guy it runs so awfully even on my machine I can't bring myself to do it :)

chronic8000 commented 1 year ago

I was trying to get dmg-builder and dmg-license packages to install. Seemed like they were required to go futher.

dikkietrom commented 1 year ago

ah ok that is so that you can build for mac, like I can build for win and lin also

chronic8000 commented 1 year ago

Aha ok. Could you not upload the binaries as a release to github?

dikkietrom commented 1 year ago

they are to big but I can maybe make it a complete empty node_modules and get it under 100mb. There is also a release section on github, not sure if the 100mb max also applies there.

chronic8000 commented 1 year ago

they are to big but I can maybe make it a complete empty node_modules and get it under 100mb. There is also a release section on github, not sure if the 100mb max also applies there.

Not sure, if not just whack a magnet link here

dikkietrom commented 1 year ago

I forgot something vital, I update the readme and added the remove package-lock.json.

rm -rf node_modules rm package-lock.json npm install ./node_modules/.bin/electron-rebuild

dikkietrom commented 1 year ago

I will also try to remove the build stuff so that these issues are solved. I can pushed it to a test branch. You can try it too if you want, I removed and rebuild everything and it startsup ok. I am just now thinking I should do that in a conda env so that nothing is pre installed

{ "name": "KITT", "version": "1.0.0", "description": "Knight Industries Two Thousand", "main": "./back-end/main.js", "permissions": [ "audioCapture" ], "author": { "name": "KITT", "email": "your.email@example.com" }, "homepage": "https://your-project-homepage.com", "scripts": { "start": "electron back-end/main.js --inspect"

}, "dependencies": { "electron": "^23.2.4", "applescript": "^1.0.0", "electron-devtools-installer": "^3.2.0", "electron-is-dev": "^2.0.0", "electron-prompt": "^1.7.0", "electron-rebuild": "^3.2.9", "electron-store": "^8.1.0", "electron-updater": "^5.3.0", "jsdom": "^21.1.1", "mic": "^2.1.2", "node-pty": "^0.10.1", "openai": "^3.2.1", "robotjs": "^0.6.0", "stream-buffers": "^3.0.2", "wav": "^1.0.2" } }

dikkietrom commented 1 year ago

hi, i did a little more cleaning. It installs and runs ok in a clean env don't forget to clean package-lock , hmm maybe I should just add a simple install and reset batch file

{ "name": "KITT", "version": "1.0.0", "description": "Knight Industries Two Thousand", "main": "./back-end/main.js", "permissions": [ "audioCapture" ], "author": { "name": "KITT", "email": "your.email@example.com" }, "homepage": "https://your-project-homepage.com", "scripts": { "start": "electron back-end/main.js --inspect" }, "dependencies": { "electron": "^23.2.4", "electron-devtools-installer": "^3.2.0", "electron-is-dev": "^2.0.0", "electron-prompt": "^1.7.0", "electron-rebuild": "^3.2.9", "electron-store": "^8.1.0", "electron-updater": "^5.3.0", "mic": "^2.1.2", "node-pty": "^0.10.1", "openai": "^3.2.1", "stream-buffers": "^3.0.2", "wav": "^1.0.2" } }

chronic8000 commented 1 year ago

Does the EXE keep logs I can send you anywhere? I am getting a lot of errors here in Windows land.

chronic8000 commented 1 year ago

Is it meant to come up with all this text at the start? I don't seem to be able to type anywhere either it's like the box loads of the bottom of the screen and I can't get to it.

chronic8000 commented 1 year ago

When I run it in Ubuntu from cloning the github repo it seems to get further I have got a text box to type in but get this error when saying hi:

Me :
Broker :
Cannot read properties of undefined (reading 'send') Me : Hi

It doesn't have any of the options at the top either looks pretty broken still but loads up at least now :) Getting further.

chronic8000 commented 1 year ago

√ Rebuild Complete

E:\KITT-AI-Browser>npm install

up to date, audited 300 packages in 969ms

45 packages are looking for funding run npm fund for details

found 0 vulnerabilities

E:\KITT-AI-Browser>npm start

KITT@1.0.0 start electron back-end/main.js --inspect

Debugger listening on ws://127.0.0.1:9229/e640c324-7ba4-4cb2-8f09-a44826281df8 For help, see: https://nodejs.org/en/docs/inspector main log no web window yet : web-contents-created main log no web window yet : web-contents-created [MAIN-LOG] ITT-AI-Browser\lib\shared.js:64 at initShared : init shared Skip checkForUpdates because application is not packed and dev update config is not forced [MAIN-LOG] ITT-AI-Browser\back-end\main.js:168 at initMainScript : try ./ipcMain.js [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:10 at init : ipcMain init checkForUpdatesAndNotify called, downloadPromise is null [32268:0503/133953.877:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [32268:0503/133953.877:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [32268:0503/133953.885:ERROR:disk_cache.cc(205)] Unable to create cache [32268:0503/133953.885:ERROR:gpu_disk_cache.cc(673)] Gpu Cache Creation failed: -2 [32268:0503/133953.886:ERROR:disk_cache.cc(205)] Unable to create cache [32268:0503/133953.886:ERROR:gpu_disk_cache.cc(673)] Gpu Cache Creation failed: -2 [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:14 at IpcMainImpl. : plugin-request [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:94 at initPlugins : initPlugins sortedDirs before sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:98 at initPlugins : initPlugins sortedFiles after sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins agent-gpt [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins bark [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\bark\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins bash [MAIN-LOG] ITT-AI-Browser\plugins\bash\main.js:11 at Object.init : bash init [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\bash\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins broker [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\broker\main.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\broker\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins ceo-test [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins coder [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\coder\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins dall-e [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\dall-e\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins elevenlabs [MAIN-LOG] ITT-AI-Browser\plugins\elevenlabs\main.js:12 at init : tts-main init api [MAIN-LOG] ITT-AI-Browser\plugins\elevenlabs\main.js:15 at init : tts-main init no api key [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created [30448:0503/133956.641:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [30448:0503/133956.641:ERROR:disk_cache.cc(205)] Unable to create cache [32268:0503/133956.900:ERROR:service_worker_storage.cc(1945)] Failed to delete the database: Database IO error [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created [MAIN-LOG] ITT-AI-Browser\plugins\elevenlabs\main.js:18 at init : tts-main got key 7cd706becc7b30afd941b3457e252b2e [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\elevenlabs\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins feed [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\feed\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins file [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\file\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins google [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt [MAIN-LOG] ITT-AI-Browser\plugins\gpt\main.js:16 at init : gpt-main init no api key [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created [MAIN-LOG] ITT-AI-Browser\plugins\gpt\main.js:19 at init : gpt-main got key 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 [MAIN-LOG] ITT-AI-Browser\plugins\gpt\main.js:29 at init : gpt-main init no organization key [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created ReferenceError: openAIKey is not defined at init (E:\KITT-AI-Browser\plugins\gpt\main.js:36:36) at async initPlugins (E:\KITT-AI-Browser\back-end\ipcMain.js:119:21) [MAIN-LOG] ITT-AI-Browser\lib\shared.js:57 at err : ReferenceError: openAIKey is not defined [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt-api-hack [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\gpt-api-hack\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt-edit [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\gpt-edit\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins midjourney [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins open-assistant [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins summariser [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\summariser\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins user [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\user\main.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\user\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins whisper [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:18 at init : stt-main init [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:74 at init : pyt E:\KITT-AI-Browser\plugins\whisper\whisper.py [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\whisper\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins youtube [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:101 at ChildProcess. : whisper process exited with code 1

E:\KITT-AI-Browser>npm start

KITT@1.0.0 start electron back-end/main.js --inspect

Debugger listening on ws://127.0.0.1:9229/f27717ad-04e4-484c-ab2f-8448cc40b4e6 For help, see: https://nodejs.org/en/docs/inspector main log no web window yet : web-contents-created main log no web window yet : web-contents-created [MAIN-LOG] ITT-AI-Browser\lib\shared.js:64 at initShared : init shared Skip checkForUpdates because application is not packed and dev update config is not forced [MAIN-LOG] ITT-AI-Browser\back-end\main.js:168 at initMainScript : try ./ipcMain.js [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:10 at init : ipcMain init checkForUpdatesAndNotify called, downloadPromise is null [4888:0503/134212.465:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [4888:0503/134212.465:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [4888:0503/134212.472:ERROR:disk_cache.cc(205)] Unable to create cache [4888:0503/134212.472:ERROR:gpu_disk_cache.cc(673)] Gpu Cache Creation failed: -2 [4888:0503/134212.472:ERROR:disk_cache.cc(205)] Unable to create cache [4888:0503/134212.473:ERROR:gpu_disk_cache.cc(673)] Gpu Cache Creation failed: -2 [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:14 at IpcMainImpl. : plugin-request [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:94 at initPlugins : initPlugins sortedDirs before sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:98 at initPlugins : initPlugins sortedFiles after sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins agent-gpt [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins bark [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\bark\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins bash [MAIN-LOG] ITT-AI-Browser\plugins\bash\main.js:11 at Object.init : bash init [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\bash\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins broker [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\broker\main.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\broker\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins ceo-test [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins coder [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\coder\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins dall-e [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\dall-e\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins elevenlabs [MAIN-LOG] ITT-AI-Browser\plugins\elevenlabs\main.js:12 at init : tts-main init api 7cd706becc7b30afd941b3457e252b2e [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\elevenlabs\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins feed [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\feed\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins file [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\file\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins google [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt [MAIN-LOG] ITT-AI-Browser\plugins\gpt\main.js:29 at init : gpt-main init no organization key [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created [1256:0503/134214.801:ERROR:cache_util_win.cc(20)] Unable to move the cache: Access is denied. (0x5) [1256:0503/134214.802:ERROR:disk_cache.cc(205)] Unable to create cache [4888:0503/134215.492:ERROR:service_worker_storage.cc(1945)] Failed to delete the database: Database IO error ReferenceError: openAIKey is not defined at init (E:\KITT-AI-Browser\plugins\gpt\main.js:36:36) at async initPlugins (E:\KITT-AI-Browser\back-end\ipcMain.js:119:21) [MAIN-LOG] ITT-AI-Browser\lib\shared.js:57 at err : ReferenceError: openAIKey is not defined [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt-api-hack [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\gpt-api-hack\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins gpt-edit [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\gpt-edit\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins midjourney [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins open-assistant [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins summariser [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\summariser\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins user [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\user\main.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\user\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins whisper [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:18 at init : stt-main init [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:74 at init : pyt E:\KITT-AI-Browser\plugins\whisper\whisper.py [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins : [INFO] : E:\KITT-AI-Browser\plugins\whisper\preload.js does not exist [MAIN-LOG] ITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins : initPlugins youtube [MAIN-LOG] ITT-AI-Browser\back-end\main.js:118 at App. : web-contents-created [MAIN-LOG] ITT-AI-Browser\plugins\whisper\main.js:101 at ChildProcess. : whisper process exited with code 1 [MAIN-LOG] ITT-AI-Browser\back-end\main.js:73 at EventEmitter. : devtools-closed [4888:0503/134237.284:ERROR:crashpad_client_win.cc(844)] not connected

E:\KITT-AI-Browser>

Got it running again and got some error logs this time

chronic8000 commented 1 year ago

On native Windows this time. I found out it won't run on WSL2 because DBUS kernel access doesn't exist in WSL2.

dikkietrom commented 1 year ago

Hey that is more starting to look like it. There might be an issue with me renaming the repo to KITT-AI-Browser instead of just KITT. I will do a fresh git init and see what goes down.

When I run it in Ubuntu from cloning the github repo it seems to get further I have got a text box to type in but get this error when saying hi:

Me : Broker : Cannot read properties of undefined (reading 'send') Me : Hi

It doesn't have any of the options at the top either looks pretty broken still but loads up at least now :) Getting further.

There are no more options at the top,

it moved all to plugins, stt and tts are in the path when needed, like eg

»stt»gpt»tts would make both talk

I changed tts to the more realtime, and free, html5 tts. The browser can also do better stt than whisper even I noticed. Elevenlabs has much better voices but during development with all the cycles credits are gone quickly. For demo's it is great though and it could be like eg

»stt»gpt»11 would use elevenlabs

I am thinking that I can reuse all these instruction to learn KITT about the prompt path domain language. I added parameters like eg

»file . »feed from=1 to=5 »gpt will only send the first 5 16k chunks.

last thing I did yesterday was testing the bash plugin ok. When you want that gpt is allowed to try something 3 times you can do eg

make a bash script that writes a C source file, compiles it and executes it »bsh

will only return the result to you and

make a bash script that writes a C source file, compiles it and executes it »bsh»gpt

will return the result to gpt and when there is an error it will reply with a fix to you

for now you can manually define the amounts of attempts by doing

make a bash script that writes a C source file, compiles it and executes it »bsh»gpt»bsh»gpt

would give it 2 chances to make it work, I had it on automatic at errors but you do want to set some boundaries. I am thinking to control it with a parameter max like

make a bash script that writes a C source file, compiles it and executes it »bsh max=3 »gpt

dikkietrom commented 1 year ago

btw I uploaded all binaries, it is quite a drag to upload it all. Most are under 100mb now so much is removed and can be hosted in the repo. KITT needs github contol and run the whole thing. With robotjs and html5 text from image I can probably give it kindof physical mouse and key control. It seems there is already some kind of neuralnetwork installed in the Chromium browser. I will make a video about how to deal with all the logging and debugging when the plugin cannot be found

dikkietrom commented 1 year ago
image
dikkietrom commented 1 year ago

yeah we have an issue here ~/git/KITT/front-end/plugin.js: 15 let dir = error.stack.split('\n') 16 dir = dir[dir.length - 1] 17: let part = '/KITT/plugins' 18 let index = dir.indexOf(part) 19 if (index == -1) {

~/git/KITT/lib/shared.js: 7 let last = parts.pop() 8
9: last = last.substring(last.indexOf('/KITT/') + 6) 10 last = last.substring(0, last.lastIndexOf(':')) 11 let ret = [last, parts.join(' '), ':'].join(' ')

~/git/KITT/plugins/elevenlabs/main.js:

I'am at this point not sure how the binaries deal with this but for npm it should fix that you have no active plugins. I think I understand better what you mean now with nothing showing, also not the plugin tabbar. My screen looks like this now when I startup. When you have it like that then you should be able to work with it. First time go into the webview to logon to your account at openAI, thereafter you can close the webview when you want.

image
chronic8000 commented 1 year ago

Some debug info for my electron-rebuild I just done from a fresh clone.

C:\Users\chron\Script Work\KITT-AI-Browser>node_modules.bin\electron-rebuild.cmd

\ Searching dependency treeAttempting to build a module with a space in the path See https://github.com/nodejs/node-gyp/issues/65#issuecomment-368820565 for reasons why this may not work

C:\Users\chron\Script Work\KITT-AI-Browser>

chronic8000 commented 1 year ago

Results of npm start, stuff disappears when I click on it.

C:\Users\chron\Script Work\KITT-AI-Browser>npm start

KITT@1.0.0 start electron back-end/main.js --inspect

Debugger listening on ws://127.0.0.1:9229/2cdeecd1-701f-4d29-86fa-9987f2c29f87 For help, see: https://nodejs.org/en/docs/inspector main log no web window yet : web-contents-created main log no web window yet : web-contents-created [MAIN-LOG] KITT-AI-Browser\lib\shared.js:64 at initShared (C:\Users\chron\Script : init shared Skip checkForUpdates because application is not packed and dev update config is not forced [MAIN-LOG] KITT-AI-Browser\back-end\main.js:168 at initMainScript (C:\Users\chron\Script : try ./ipcMain.js [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:10 at init (C:\Users\chron\Script : ipcMain init checkForUpdatesAndNotify called, downloadPromise is null [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:14 at IpcMainImpl. (C:\Users\chron\Script : plugin-request [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:94 at initPlugins (C:\Users\chron\Script : initPlugins sortedDirs before sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:98 at initPlugins (C:\Users\chron\Script : initPlugins sortedFiles after sort agent-gpt,bark,bash,broker,ceo-test,coder,dall-e,elevenlabs,feed,file,google,gpt,gpt-api-hack,gpt-edit,midjourney,open-assistant,summariser,user,whisper,youtube [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins agent-gpt [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins bark [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\bark\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins bash [MAIN-LOG] KITT-AI-Browser\plugins\bash\main.js:11 at Object.init (C:\Users\chron\Script : bash init [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\bash\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins broker [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\broker\main.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\broker\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins ceo-test [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins coder [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\coder\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins dall-e [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\dall-e\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins elevenlabs [MAIN-LOG] KITT-AI-Browser\plugins\elevenlabs\main.js:12 at init (C:\Users\chron\Script : tts-main init api [MAIN-LOG] KITT-AI-Browser\plugins\elevenlabs\main.js:15 at init (C:\Users\chron\Script : tts-main init no api key [MAIN-LOG] KITT-AI-Browser\back-end\main.js:118 at App. (C:\Users\chron\Script : web-contents-created [MAIN-LOG] KITT-AI-Browser\back-end\main.js:118 at App. (C:\Users\chron\Script : web-contents-created [MAIN-LOG] KITT-AI-Browser\plugins\elevenlabs\main.js:21 at init (C:\Users\chron\Script : no tts-main key [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\elevenlabs\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins feed [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\feed\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins file [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\file\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins google [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins gpt [MAIN-LOG] KITT-AI-Browser\plugins\gpt\main.js:16 at init (C:\Users\chron\Script : gpt-main init no api key [MAIN-LOG] KITT-AI-Browser\back-end\main.js:118 at App. (C:\Users\chron\Script : web-contents-created [MAIN-LOG] KITT-AI-Browser\plugins\gpt\main.js:19 at init (C:\Users\chron\Script : gpt-main got key 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 [MAIN-LOG] KITT-AI-Browser\plugins\gpt\main.js:29 at init (C:\Users\chron\Script : gpt-main init no organization key [MAIN-LOG] KITT-AI-Browser\back-end\main.js:118 at App. (C:\Users\chron\Script : web-contents-created ReferenceError: openAIKey is not defined at init (C:\Users\chron\Script Work\KITT-AI-Browser\plugins\gpt\main.js:36:36) at async initPlugins (C:\Users\chron\Script Work\KITT-AI-Browser\back-end\ipcMain.js:119:21) [MAIN-LOG] KITT-AI-Browser\lib\shared.js:57 at err (C:\Users\chron\Script : ReferenceError: openAIKey is not defined [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins gpt-api-hack [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\gpt-api-hack\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins gpt-edit [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\gpt-edit\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins midjourney [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins open-assistant [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins summariser [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\summariser\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins user [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:128 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\user\main.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\user\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins whisper [MAIN-LOG] KITT-AI-Browser\plugins\whisper\main.js:18 at init (C:\Users\chron\Script : stt-main init [MAIN-LOG] KITT-AI-Browser\plugins\whisper\main.js:74 at init (C:\Users\chron\Script : pyt C:\Users\chron\Script Work\KITT-AI-Browser\plugins\whisper\whisper.py [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:138 at initPlugins (C:\Users\chron\Script : [INFO] : C:\Users\chron\Script Work\KITT-AI-Browser\plugins\whisper\preload.js does not exist [MAIN-LOG] KITT-AI-Browser\back-end\ipcMain.js:107 at initPlugins (C:\Users\chron\Script : initPlugins youtube [MAIN-LOG] KITT-AI-Browser\plugins\whisper\main.js:101 at ChildProcess. (C:\Users\chron\Script : whisper process exited with code 1 [16368:0503/211618.990:ERROR:gpu_init.cc(523)] Passthrough is not supported, GL is disabled, ANGLE is

dikkietrom commented 1 year ago

ok I removed node-py, it is a leftover from the start with the first alpaca model. Maybe it is needed later but it seems to only be in the way now. I added a useGl false to the browserwindow init, and just pushed it

let mainWindow = new BrowserWindow({
    width: 2000,
    height: 1000,
    webPreferences: {
        nodeIntegration: false,
        contextIsolation: false,
        enableRemoteModule: false,
        webviewTag: true,
        useGL: false,
        preload: path.join(__dirname, '../front-end/preload.js'),
    },
});