-
I'm trying to run Wizard-Vicuna-13B-Uncensored model on a VM (16GB RAM), but i'm getting the below error:
Error: Missing field `nGpuLayers`
at LLamaCpp. (file:///usr/local/lib/node_modules/cat…
-
Hi, I'm new to using node, so I'm not sure what's going on. I can't use catai because it says it doesn't find my node installation.
Steps:
1. I already had node installed, so installed catai. I o…
-
I tried this on the 22nd and was able to install models but not get it to serve (it complains model not found).
With the latest version it doesn't appear to be installing models anymore.
```
…
-
The interface starts, and after entering the first request, it crashes
```
PS C:\Users\pomazan> catai serve
$ cd C:\Users\pomazan\AppData\Roaming\npm\node_modules\catai
$ npm start -- --product…
-
`catai server --ui chatGPT` should be `catai serve --ui chatGPT `
-
The `|| true` in this line:
https://github.com/ido-pluto/catai/blob/c53b1b2dc6af8bcbbaf53c9a0d4e45f1187b2caf/server/src/config.js#L4
prevents setting CATAI_OPEN_IN_BROWSER to anything other the…
-
After Installing a model and running catai serve I get this error:
```
catai use 30B
$ cd /usr/lib/node_modules/catai
$ npm run use 30B
> catai@0.3.0 use
> zx scripts/use.js 30B
Model se…
-
Running install with an unrecognised model gives the following output:
```
➜ models catai install gpt4all …
-
Usecase: running catai instances on cloud vms and accessing the UI over the network
-
It would be nice to allow people to specify settings like data directory & port to use instead of hard-coded values without editing the package source.