Does not work on ubuntu 22.04 & node 20

[Temtaime]

Please refer to the troubleshooting before opening an issue. You might find the solution there.

Describe the bug Followed instructions, when catai up is used it only opens a page for 1 time, then process exits.

Screenshots

$ catai up
CatAI client on http://127.0.0.1:3000
New connection
$ echo $?
0

Desktop (please complete the following information):

• OS: Ubuntu
• Browser [e.g. chrome, safari] Chrome
• CatAI version [e.g. 0.3.10] (catai --version) 3.0.0
• Node.js version [e.g 19] (node --version) 20

[ido-pluto]

It happened before when I did not have enough RAM for the model to run. Which model do you try to run? How many GB of memory do you have? What is the CPU of your computer?

[Temtaime]

I have 64gb ram, tried wizard-vicuna-30b-uncensored-q4_k_s, cpu is ryzen 5900x.

[ido-pluto]

Do other models work for you?

Try this:

# cd to catai directory
cd `where catai | rev | cut -c10- | rev`/lib/node_modules/catai/

# update node-llama-cpp to the latest version
npm i node-llama-cpp@latest

If it also does not work, we can try to recompile it:

npx node-llama-cpp download

After that tell me if it works, I want to check the issue more deeply :)

[github-actions[bot]]

:tada: This issue has been resolved in version 3.0.1 :tada:

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot :package::rocket:

[Temtaime]

Hello

npm i node-llama-cpp@latest executed without errors, but it still was not working

After recompiling with npx node-llama-cpp download it started to work, thanks !

[0xGoenka]

Not working on Ubuntu 22.04.3 LTS and node 18

[0xGoenka]

[ido-pluto]

On it, I think the cpp binaries for AMD do not work properly

[github-actions[bot]]

:tada: This issue has been resolved in version 3.1.0-beta.1 :tada:

The release is available on:

• npm package (@beta dist-tag)
• GitHub release

Your semantic-release bot :package::rocket:

[ido-pluto]

You can fix this issue, by using catai beta and rebuilding the binaries

npm i -g catai@beta
catai cpp