cocktailpeanut / dalai

The simplest way to run LLaMA on your local machine
https://cocktailpeanut.github.io/dalai
13.09k stars 1.42k forks source link

Does not work. How to start ? #93

Open oaefou opened 1 year ago

oaefou commented 1 year ago

C:\Users\Pop>npx dalai serve mkdir C:\Users\Pop\dalai Server running on http://localhost:3000/

query: { method: 'installed' } modelsPath C:\Users\Pop\dalai\alpaca\models { modelFolders: [ '7B' ] } exists 7B modelsPath C:\Users\Pop\dalai\llama\models { modelFolders: [ '7B' ] } query: { seed: -1, threads: 4, n_predict: 200, top_k: 40, top_p: 0.9, temp: 0.1, repeat_last_n: 64, repeat_penalty: 1.3, debug: false, models: [ 'alpaca.7B' ], model: 'alpaca.7B', prompt: 'write a story about a dog', id: 'TS-1679139786881-32398' } { Core: 'alpaca', Model: '7B' } exec: C:\Users\Pop\dalai\alpaca\build\Release\llama --seed -1 --threads 4 --n_predict 200 --model models/7B/ggml-model-q4_0.bin --top_k 40 --top_p 0.9 --temp 0.1 --repeat_last_n 64 --repeat_penalty 1.3 -p "write a story about a dog" in C:\Users\Pop\dalai\alpaca ice_screenshot_20230318-144354

gadzbi123 commented 1 year ago

Turn on debug mode, maybe we will know more

oaefou commented 1 year ago

[2J[m[HWindows PowerShell (C) Microsoft Corporation. All rights reserved.

Try the new cross-platform PowerShell (https://aka.ms/pscore6) ]0;C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe [?25h [25l [6;1H ]0;Administrator: C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe [?25hPS C:\Users\Pop\dalai\alpaca> [?25l PS C:\Users\Pop\dalai\alpaca> [93mC:\Users\Pop\dalai\alpaca\build\Release\llama [m [90m--seed [m -1 [90m--threads [m [97m4 [m [90m--n_predict [m [97m200 [m [90m--model [m models/7B/ggml-model-q4_0.bin [90m--top_k [m [97m40 [m [90m--top_p [m [97m0.9 [m [90m--temp [m [97m0.1 [m [90m--repeat] _last_n [m [97m64 [m [90m--repeat_penalty [m [97m1.3 [m [90m-p [m [36m"yku" [m [K [?25h [91mC:\Users\Pop\dalai\alpaca\build\Release\llama : The name 'C:\Users\Pop\dalai\alpaca\build\Release\llama' is not recognized as a cmdlet, function, script file or executable program. Check [m [91m If the name is spelled correctly, and if the path is present and correct, then try again.[m [19X [91m string:1 character:1 [m [102X [91m

GitGudGandalf commented 1 year ago

fixed it. It was the visual studio installation. I reinstalled it with the correct settings following the guide and this time the build completed and the error disappeared. now it generates text.

bleriot14 commented 1 year ago

fixed it. It was the visual studio installation. I reinstalled it with the correct settings following the guide and this time the build completed and the error disappeared. now it generates text. When I reinstall VS, powershell is being intsalled automaticaly. How did you solve your problem exactly ?

Tarbian commented 1 year ago

fixed it. It was the visual studio installation. I reinstalled it with the correct settings following the guide and this time the build completed and the error disappeared. now it generates text.

How?